LocalisationUpdate

From Wikitech
(Difference between revisions)
Jump to: navigation, search
(Where it runs)
Line 8: Line 8:
 
== Where it runs ==
 
== Where it runs ==
  
* [[hume]] (not yet set up)
+
* [[hume]]  
** run l10nupdate every 24h to update master cache files (can be sped up if desired)
+
** run l10nupdate every 24h at 2am GMT to update master cache files (can be sped up if desired)
 
*** Must be on a mediawiki-installation host with access to /home and a SVN client.
 
*** Must be on a mediawiki-installation host with access to /home and a SVN client.
* all mediawiki-installation boxes (not yet set up)
+
* all mediawiki-installation boxes  
** Update wmf-deployment/cache/l10n directory from NFS master
+
** Update wmf-deployment/cache/l10n directory from NFS master every day at 3am GMT (Cron setup by Puppet)
  
 
== Batch frequency ==
 
== Batch frequency ==
Line 21: Line 21:
  
 
Batch job in /home/wikipedia/bin/l10nupdate. Does roughly:
 
Batch job in /home/wikipedia/bin/l10nupdate. Does roughly:
 
+
  echo "Starting l10nupdate at `date`."
 
   svn up /home/wikipedia/l10n/trunk/phase3
 
   svn up /home/wikipedia/l10n/trunk/phase3
 
   svn up /home/wikipedia/l10n/trunk/extensions
 
   svn up /home/wikipedia/l10n/trunk/extensions
Line 28: Line 28:
 
     --outdir=/home/wikipedia/common/wmf-deployment/cache/l10n \
 
     --outdir=/home/wikipedia/common/wmf-deployment/cache/l10n \
 
     --all
 
     --all
 +
  echo "Completed."
  
Files will be updated in /h/w/wmf-deployment/cache/l10n; Apache clients should sync updates from that every X hours or at scap time.
+
Files will be updated in /h/w/wmf-deployment/cache/l10n; Apache clients should sync updates from that every 24 hours or at scap time.
  
 
== Files ==
 
== Files ==

Revision as of 18:11, 25 September 2009

Contents

Purpose

This MediaWiki extension fetches updates to MediaWiki core and extension localisation files and makes them available to an installation without updating its own source. This allows us to pull updated translations being committed to development trunk even though our live install is running wmf-deployment branch.

Source

Where it runs

  • hume
    • run l10nupdate every 24h at 2am GMT to update master cache files (can be sped up if desired)
      • Must be on a mediawiki-installation host with access to /home and a SVN client.
  • all mediawiki-installation boxes
    • Update wmf-deployment/cache/l10n directory from NFS master every day at 3am GMT (Cron setup by Puppet)

Batch frequency

  • not yet set up; planned daily?

How it works

Batch job in /home/wikipedia/bin/l10nupdate. Does roughly:

 echo "Starting l10nupdate at `date`."
 svn up /home/wikipedia/l10n/trunk/phase3
 svn up /home/wikipedia/l10n/trunk/extensions
 php /home/wikipedia/common/wmf-deployment/extensions/LocalisationUpdate/update.php \
   --wiki=aawiki \
   --outdir=/home/wikipedia/common/wmf-deployment/cache/l10n \
   --all
 echo "Completed."

Files will be updated in /h/w/wmf-deployment/cache/l10n; Apache clients should sync updates from that every 24 hours or at scap time.

Files

  • /home/wikipedia/l10n/trunk
    • MediaWiki checkouts of trunk phase3 and extensions
  • /home/wikipedia/common/wmf-deployment/cache/l10n
    • Storage for serialized updates
  • /apache/common/wmf-deployment/cache/l10n
    • Synced home of serialized updates per web server

Config

In MW config:

  • $wmgUseLocalisationUpdate (to enable/disable ext load)
  • $wgLocalisationUpdateSVNURL = '/home/wikipedia/l10n/trunk'
  • $wgLocalisationUpdateDirectory = '/apache/common/wmf-deployment/cache/l10n'

Todo

Trim out test DBs/tables from previous incarnation:

Databases used:

  • Singletons:
    • enwiki on s1
    • dewiki on s2dewiki
    • frwiki on s3frja
    • jawiki on s3frja
    • commonswiki on s4
  • Shared:
    • l10nwiki on s2 (run via bgwiki)
    • l10nwiki on s3 (run via aawiki)
Personal tools
Namespaces

Variants
Actions
Navigation
Ops documentation
Wiki
Toolbox