Backup procedures

This page is an inventory of our backups for both clusters data and office data.

Some definitions:

On-site

here means the backup is in the same physical location as the master, but on a different machine.

Off-site

means the backup is in a physically separate location. In most cases it's nice to have both!

Red cells

denote a lacking area which we want/need.

Service backup state

Service	Master	On-site	Off-site	Notes	Approx. Space Needed
Wiki primary data
Wiki main databases	PMTPA db*	PMTPA slave replication	ESAMS toolserver replication / EQIAD db slaves & snapshots
External storage	PMTPA db*	PMTPA slave replication	ESAMS toolserver replication
Wiki data dumps	PMTPA dataset2		eBart, AWS	Offsite syncs ad-hoc schedule - tfinc	250GB
Images and media
Uploads	PMTPA ms7	PMTPA ms8	ESAMS ms6 (partial)/EQIAD ms1002	]	7T
Thumbs	PMTPA ms4		EQIAD ms1004		2T
Software development and configuration
MediaWiki config	PMTPA NFS	tridge	Subversion
Apache config	PMTPA NFS	tridge	Automatic	rsync
Subversion	Formey	tridge			3 GB
Bugzilla data	PMTPA db9	db10 replication	EQIAD db1008/db1025		1 GB
Bugzilla config	PMTPA db9	db10 replication	EQIAD db1008/db1025		1.5 GB
Bugzilla frontend	PMTPA isidore	daily rsync to Tridge
Wikitech wiki	linode		PMTPA tridge; ESAMS ?
Communications
OTRS data	PMTPA db9	db10 replication	EQIAD db1008/db1025		57 GB
OTRS config	PMTPA bart				19 GB
blogs frontend data	PMTPA singer	Daily backups to Tridge
bugzilla	PMTPA isidore	Daily backups to Tridge
IMAP mail	PMTPA sanger	PMTPA mchenry, Daily backups to tridge		see Mail#Backups	32 GB
Mailing lists	ESAMS lily		PMTPA mchenry	See Mailing lists#Backups	50 GB
DNS	PMTPA ns0, ns1	checkin to sockpuppet SVN	ESAMS ns2	In SVN now
Google docs	Google :P			ad-hoc downloads
Soft data
Search databases	PMTPA various			regeneratable
HTTP logs	PMTPA locke	emery		/a/squid
MediaWiki logs	PMTPA NFS	tridge		/home/wikipedia/logs
Misc data
Fundraising Front-End	PMTPA grosley		Software now in SVN	tridge /data/civicrm-frontend/ Backs up once a week via a tar of the directory and rsync	10 MB
Fundraising Databases	PMTPA db9	db10 replication	EQIAD db1008/1025	tridge /data/db10/ Backups every other day	160 MB
Office fileserver	OFFICE fileserver	weekly rsync to USB drive	rsync to tridge not running		2 GB(?)
Office workstations	OFFICE *			currently no backups done (can be enabled, if needed; MacOS only)
Office laptops	OFFICE *			Time Machine backups to usb drive on Imac (MacOS only)
Server home directories	PMTPA nfs1 / nfs2	tridge		Daily backups to Tridge	30 GB