Cron jobs

Revision as of 08:46, 27 August 2008

Note: the job queue runs continuously on many servers and is not a cron job.

QueryPage update

srv31:/var/spool/cron/tstarling: updates the special pages derived from QueryPage

PATH=/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/home/wikipedia/bin:/home/tstarling/bin:/usr/local/bin:/usr/local/mysql/bin:/home/tstarling/bin
00 4 * * * /home/wikipedia/bin/update-special-pages-small > /home/wikipedia/logs/updateSpecialPages-small.log 2>&1
00 5 */3 * * /home/wikipedia/bin/update-special-pages > /home/wikipedia/logs/updateSpecialPages.log 2>&1

update-special-pages-small

#!/bin/bash

cd /home/wikipedia/common/php-1.5/maintenance
for db in `</home/wikipedia/common/small.dblist`; do
	echo $db
	/usr/local/bin/php updateSpecialPages.php $db
	echo
	echo
done

update-special-pages

#!/bin/bash

cluster=`</etc/cluster`
cd /home/wikipedia/common/php-1.5/maintenance
for db in `</home/wikipedia/common/$cluster.dblist`; do
	echo $db
	/usr/local/bin/php updateSpecialPages.php $db
	echo
	echo
done

Tor exit list update

hume:/var/spool/cron/crontabs/tstarling: Loads the tor exit list from check.torproject.org and saves it into memcached for later use by the TorBlock extension.

PATH=/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/home/wikipedia/bin:/home/tstarling/bin:/usr/local/bin:/usr/local/mysql/bin:/home/tstarling/bin
*/20 * * * * php -n /home/wikipedia/common/php/extensions/TorBlock/loadExitNodes.php 2>&1

FlaggedRevs stats update

hume:/var/spool/cron/crontabs/tstarling: Updates the flaggedrevs_stats table

* */2 * * * /home/wikipedia/common/php/extensions/FlaggedRevs/maintenance/wikimedia-periodic-update.sh 2>&1

wikimedia-periodic-update.sh

#!/bin/bash
for db in `</home/wikipedia/common/flaggedrevs.dblist`;do
	echo $db
	php -n /home/wikipedia/common/php/extensions/FlaggedRevs/maintenance/updateStats.php $db
done

Ganglia RRD commit

zwinger:/etc/cron.hourly/save-gmetad-rrds: The live RRD files for ganglia are kept in a tmpfs, for performance reasons. This script copies them back to disk in case of server restart

#!/bin/sh
/usr/local/bin/save-gmetad-rrds >> /var/log/save-gmetad-rrds.log 2>&1

save-gmetad-rrds

#!/bin/bash
service gmetad_pmtpa stop
echo "Saving RRDs..."
time rsync -a /mnt/ganglia_tmp/rrds.pmtpa/ /var/lib/ganglia/rrds.pmtpa
echo "Done"
service gmetad_pmtpa start