Wikimedia binaries
From Wikitech
(Difference between revisions)
(update based on current HEAD (production) in gerrit) |
(→scap) |
||
| (4 intermediate revisions by one user not shown) | |||
| Line 21: | Line 21: | ||
=== <code>sync-common-all</code> === | === <code>sync-common-all</code> === | ||
: ''This is an [[#All-script|all-script]]!'' | : ''This is an [[#All-script|all-script]]!'' | ||
| − | * syncs <code>/home/wikipedia/common</code> -> <code>/apache/common</code> | + | * <s>syncs <code>/home/wikipedia/common</code> -> <code>/apache/common</code></s><br/>=> Runs [[#scap|scap]] |
=== <code>sync-common-file</code> === | === <code>sync-common-file</code> === | ||
| Line 56: | Line 56: | ||
: ''This is an [[#All-script|all-script]]!'' | : ''This is an [[#All-script|all-script]]!'' | ||
{{shortcut|scap}} | {{shortcut|scap}} | ||
| − | * | + | * lints PHP files in <code>./wmf-config</code>, <code>./multiversion</code> and <code>php-*</code> |
| − | * rebuilds localization caches and texvc | + | * for all mediawiki versions currently deployed (usually 2) it: |
| − | * syncs <code>/home/wikipedia/common/ | + | ** rebuilds localization caches of core and extensions |
| + | ** recompiles texvc | ||
| + | * runs [[sync-wikiversions]] | ||
| + | * syncs <code>/home/wikipedia/common/php-{versions}</code> -> <code>/apache/common/php-{versions}</code> | ||
| + | * <small>(does it also sync other directories in <code>/common</code> such as <code>live-1.5</code> and <code>docroot</code>?)</small> | ||
== Unsorted == | == Unsorted == | ||
| Line 106: | Line 110: | ||
== See also == | == See also == | ||
| − | * [[Heterogeneous deployment]] | + | * [[Heterogeneous deployment]] |
| + | |||
[[Category:Software]] | [[Category:Software]] | ||
[[Category:How-To]] | [[Category:How-To]] | ||
Latest revision as of 08:45, 27 February 2013
Contents |
The following executable binaries are maintained in version control (operations/puppet : files/misc/scripts) and copied/synced to servers (such as fenari) by puppet into /usr/local/bin.
[edit] bin
[edit] apache-graceful
- Performs the action only on the one server from which the command is ran
[edit] apache-graceful-all
- This script operates on all servers in the following dsh groups: apaches
- Runs
apache-gracefullocally on all apaches.
[edit] sync-apache
- This script operates on all servers in the following dsh groups: apaches, image_scalers, snapshot, searchidx
- Note: The conf files are outside of
/home/wikipedia/common, and as such are not synced by thesync-common-like scripts.
- syncs
/home/wikipedia/conf/httpdto/apache/conf
[edit] sync-common
- Performs the action only on the one server from which the command is ran
- syncs
/home/wikipedia/common->/apache/common
[edit] sync-common-all
- This is an all-script!
-
syncs/home/wikipedia/common->/apache/common
=> Runs scap
[edit] sync-common-file
- This is an all-script!
- for a single directory or file
- syncs
/home/wikipedia/common/ (some path)->/apache/common
[edit] sync-dblist
- This is an all-script!
- syncs
/home/wikipedia/common/*.dblist->/apache/common
[edit] sync-docroot
- This is an all-script!
- syncs
/home/wikipedia/common/docroot->/apache/common/docroot
[edit] sync-dir
- This is an all-script!
- for a single directory
- checks PHP syntax
- syncs
/home/wikipedia/common/ (some dir)->/apache/commonwithsync-common-file
[edit] sync-file
- This is an all-script!
- for a single file
- checks PHP syntax
- syncs
/home/wikipedia/common/ (some file)->/apache/commonwithsync-common-file
[edit] sync-wikiversions
- This script operates on all servers in the following dsh groups: mediawiki-installation
- syncs
common/wikiversions.dat->/apache/common-local/wikiversions.dat - syncs
common/wikiversions.cdb->/apache/common-local/wikiversions.cdb
[edit] scap
- This is an all-script!
shortcut: scap
- lints PHP files in
./wmf-config,./multiversionandphp-* - for all mediawiki versions currently deployed (usually 2) it:
- rebuilds localization caches of core and extensions
- recompiles texvc
- runs sync-wikiversions
- syncs
/home/wikipedia/common/php-{versions}->/apache/common/php-{versions} - (does it also sync other directories in
/commonsuch aslive-1.5anddocroot?)
[edit] Unsorted
- These are outdated, redundant, broken or otherwise undocumented:
- scap14, scap14-1, scap14-2
- obsolete from MediaWiki 1.4 days
- scap15, scap15-1, scap15-1skins
- 'scap15' is actual script for 'scap' currently; probably could use cleanup
- sync-file13, sync-file14
- sync-file-log14 ?
- sync-to-seoul
- sync-common-allphp
- sync-common-clean
- sync-common-it
- sync-common-php
- sync-common-php-x
- sync-mirror-dag.sh
- sync-mirror-fedora.sh
- sync-users-and-groups.sh
- syncout
- sync-cgibin
[edit] All-script
An all-script is a script that operates on mediawiki-installation boxes via dsh. These scripts performs the action on all servers. These servers to be exact:
- apaches
- image scalers
- misc other hosts running apache:
[edit] Examples
[edit] sync-apache example
- On fenari:
- (optionally) run:
sync-apache-simulated
This just has an "-n" added to the rsync commands. (--dry-run |show what would have been transferred) - If that looks fine, actually sync:
sync-apache - Connect to a single random "srv" server, confirm the expected change has arrived here, and restart Apache to check your change did not break things.
- (how to restart that apache?)
- If that also looks fine, restart all Apaches:
apache-graceful-all
After this you might want to purge a URL from Squid cache. Also see Squids#Purge a given external (non WMF) url.
In most cases this is enough. However if the change involves more than a simple change to redirects, depooling/ repooling may be necessary. Make sure you find out whether this is needed ahead of time (while at it, start the depooling page and link to it, we need documentation!).
