Backup procedures
From Wikitech
(Difference between revisions)
(→Software development and configuration: +notes about svn) |
(fixup tables) |
||
| Line 18: | Line 18: | ||
|| PMTPA slave replication | || PMTPA slave replication | ||
|| KNAMS [[toolserver]] replication | || KNAMS [[toolserver]] replication | ||
| + | || | ||
|| | || | ||
|- | |- | ||
| Line 24: | Line 25: | ||
|| PMTPA slave replication | || PMTPA slave replication | ||
|| KNAMS [[toolserver]] replication | || KNAMS [[toolserver]] replication | ||
| + | || | ||
|| | || | ||
|- | |- | ||
| Line 60: | Line 62: | ||
|| OFFICE - brion | || OFFICE - brion | ||
|| ad-hoc rsync | || ad-hoc rsync | ||
| + | || | ||
|- | |- | ||
|| Apache config | || Apache config | ||
| Line 66: | Line 69: | ||
|| Automatic | || Automatic | ||
|| rsync | || rsync | ||
| + | || | ||
|- | |- | ||
|| Subversion | || Subversion | ||
| Line 100: | Line 104: | ||
|| PMTPA [[tridge]]; ESAMS ? | || PMTPA [[tridge]]; ESAMS ? | ||
|| Offsite thing - is this automated? tfinc | || Offsite thing - is this automated? tfinc | ||
| + | || | ||
|- | |- | ||
|colspan=6| | |colspan=6| | ||
| Line 151: | Line 156: | ||
|| | || | ||
|| ESAMS [[ns2]] | || ESAMS [[ns2]] | ||
| + | || | ||
|| | || | ||
|- | |- | ||
| Line 158: | Line 164: | ||
|class="missing"| | |class="missing"| | ||
|| ad-hoc downloads | || ad-hoc downloads | ||
| + | || | ||
|- | |- | ||
|colspan=6| | |colspan=6| | ||
| Line 168: | Line 175: | ||
|class="missing"| | |class="missing"| | ||
|| regeneratable | || regeneratable | ||
| + | || | ||
|- | |- | ||
|| HTTP logs | || HTTP logs | ||
| Line 174: | Line 182: | ||
|class="missing"| | |class="missing"| | ||
|| /a/squid | || /a/squid | ||
| + | || | ||
|- | |- | ||
|| MediaWiki logs | || MediaWiki logs | ||
| Line 180: | Line 189: | ||
|class="missing"| | |class="missing"| | ||
|| /home/wikipedia/logs | || /home/wikipedia/logs | ||
| + | || | ||
|- | |- | ||
|colspan=6| | |colspan=6| | ||
Revision as of 19:52, 20 July 2010
"On-site" here means the backup is in the same physical location as the master, but on a different machine. "Off-site" means the backup is in a physically separate location. In most cases it's nice to have both!
Service backup state
| Service | Master | On-site | Off-site | Notes | Approx. Space Needed |
|---|---|---|---|---|---|
Wiki primary data | |||||
| Wiki main databases | PMTPA db* | PMTPA slave replication | KNAMS toolserver replication | ||
| External storage | PMTPA db* | PMTPA slave replication | KNAMS toolserver replication | ||
| Wiki data dumps | PMTPA storage2 | eBart, AWS | Offsite syncs ad-hoc schedule - tfinc | 250GB | |
Images and media | |||||
| Uploads | PMTPA ms1 | PMTPA ms5 | ESAMS ms6 (partial) | In discussion on ms1 | 7T |
| Thumbs | PMTPA ms4 | 2T | |||
Software development and configuration | |||||
| MediaWiki config | PMTPA NFS | tridge | OFFICE - brion | ad-hoc rsync | |
| Apache config | PMTPA NFS | tridge | Automatic | rsync | |
| Subversion | KNAMS mayflower | Storage2 | Cron on mayflower does weekly incremental dumps, only using ~1GB so far. | 3 GB | |
| Bugzilla data | PMTPA db9 | db10 replication | 1 GB | ||
| Bugzilla config | PMTPA db9 | db10 replication | 1.5 GB | ||
| Bugzilla frontend | PMTPA isidore | daily rsync to Tridge | |||
| Wikitech wiki | linode | PMTPA tridge; ESAMS ? | Offsite thing - is this automated? tfinc | ||
Communications | |||||
| OTRS data | PMTPA db9 | db10 replication | 57 GB | ||
| OTRS config | PMTPA bart | 19 GB | |||
| blogs frontend data | PMTPA singer | Daily backups to Tridge | |||
| bugzilla | PMTPA isidore | Daily backups to Tridge | |||
| IMAP mail | PMTPA sanger | PMTPA mchenry | see Mail#Backups | 32 GB | |
| Mailing lists | KNAMS lily | PMTPA mchenry | See Mailing lists#Backups | 50 GB | |
| DNS | PMTPA ns0, ns1 | ESAMS ns2 | |||
| Google docs | Google :P | ad-hoc downloads | |||
Soft data | |||||
| Search databases | PMTPA various | regeneratable | |||
| HTTP logs | PMTPA locke | /a/squid | |||
| MediaWiki logs | PMTPA NFS | tridge | /home/wikipedia/logs | ||
Misc data | |||||
| Fundraising Front-End | PMTPA grosley | Software now in SVN | tridge /data/civicrm-frontend/ Backs up once a week via a tar of the directory and rsync | 10 MB | |
| Fundraising Databases | PMTPA db9 | db10 replication | tridge /data/db10/ Backups every other day | 160 MB | |
| Office fileserver | OFFICE fileserver | weekly rsync to USB drive | rsync to tridge not running | 2 GB(?) | |
| Office workstations | OFFICE * | currently no backups done (can be enabled, if needed; MacOS only) | |||
| Office laptops | OFFICE * | Time Machine backups to usb drive on Imac (MacOS only) | |||
| Server home directories | PMTPA db20 | tridge | Weekly backups to Tridge | 30 GB | |
