Backup procedures
From Wikitech
(Difference between revisions)
ArielGlenn (Talk | contribs) (→Wiki primary data) |
ArielGlenn (Talk | contribs) (→Service backup state) |
||
| Line 41: | Line 41: | ||
|| [[Offsite_Backups#eBart|eBart]], [[Amazon Public Data Sets|AWS - ??]], HTTP: http://wikipedia.c3sl.ufpr.br/, FTP: ftp://wikipedia.c3sl.ufpr.br/wikipedia/, rsync: rsync://wikipedia.c3sl.ufpr.br/wikipedia/. | || [[Offsite_Backups#eBart|eBart]], [[Amazon Public Data Sets|AWS - ??]], HTTP: http://wikipedia.c3sl.ufpr.br/, FTP: ftp://wikipedia.c3sl.ufpr.br/wikipedia/, rsync: rsync://wikipedia.c3sl.ufpr.br/wikipedia/. | ||
|| Site: Centro de Computação Científica e Software Livre (C3SL), at the Universidade Federal do Paraná in Brazil. | || Site: Centro de Computação Científica e Software Livre (C3SL), at the Universidade Federal do Paraná in Brazil. | ||
| − | || | + | || 6T (last 5 good)/ 29T (all) |
|- | |- | ||
|colspan=6| | |colspan=6| | ||
| Line 52: | Line 52: | ||
|| EQIAD ms1002 / ESAMS [[ms6]] (partial) | || EQIAD ms1002 / ESAMS [[ms6]] (partial) | ||
|| | || | ||
| − | || | + | || 18T |
|- | |- | ||
|| Thumbs | || Thumbs | ||
| Line 59: | Line 59: | ||
|| EQIAD ms1004 | || EQIAD ms1004 | ||
|| | || | ||
| − | || | + | || 8T |
|- | |- | ||
|colspan=6| | |colspan=6| | ||
Revision as of 09:15, 1 February 2012
This page is an inventory of our backups for both clusters data and office data.
Some definitions:
- On-site
- here means the backup is in the same physical location as the master, but on a different machine.
- Off-site
- means the backup is in a physically separate location. In most cases it's nice to have both!
- Red cells
- denote a lacking area which we want/need.
Contents |
Service backup state
| Service | Master | On-site | Off-site | Notes | Approx. Space Needed |
|---|---|---|---|---|---|
Wiki primary data | |||||
| Wiki main databases | PMTPA db* | PMTPA slave replication | EQIAD db slaves & snapshots / ESAMS toolserver replication | ||
| External storage | PMTPA db* | PMTPA slave replication | EQIAD ES1004 replicates ms03; ES1001-3 is a copy of rc1 & cl1-cl21 /ESAMS toolserver replication | ||
| Wiki data dumps | PMTPA dataset2 | eBart, AWS - ??, HTTP: http://wikipedia.c3sl.ufpr.br/, FTP: ftp://wikipedia.c3sl.ufpr.br/wikipedia/, rsync: rsync://wikipedia.c3sl.ufpr.br/wikipedia/. | Site: Centro de Computação Científica e Software Livre (C3SL), at the Universidade Federal do Paraná in Brazil. | 6T (last 5 good)/ 29T (all) | |
Images and media | |||||
| Uploads | PMTPA ms7 | PMTPA ms8 | EQIAD ms1002 / ESAMS ms6 (partial) | 18T | |
| Thumbs | PMTPA ms5 | EQIAD ms1004 | 8T | ||
Software development and configuration | |||||
| MediaWiki config | PMTPA NFS | tridge | Subversion | ||
| Apache config | PMTPA NFS | tridge | Automatic | rsync | |
| Subversion | Formey | tridge | 3 GB | ||
| Bugzilla data | PMTPA db9 | db10 replication | EQIAD db1008/db1025 & snapshots | 1 GB | |
| Bugzilla config | PMTPA db9 | db10 replication | EQIAD db1008/db1025 & snapshots | 1.5 GB | |
| Bugzilla frontend | PMTPA isidore | daily rsync to Tridge | |||
| Wikitech wiki | linode | PMTPA tridge; ESAMS ? | |||
Communications | |||||
| OTRS data | PMTPA db9 | db10 replication | EQIAD db1008/db1025 & snapshots | 57 GB | |
| OTRS config | PMTPA bart | 19 GB | |||
| blogs frontend data | PMTPA singer | Daily backups to Tridge | |||
| bugzilla | PMTPA isidore | Daily backups to Tridge | |||
| IMAP mail | PMTPA sanger | PMTPA mchenry, Daily backups to tridge | see Mail#Backups | 32 GB | |
| Mailing lists | ESAMS lily | PMTPA mchenry | See Mailing lists#Backups | 50 GB | |
| DNS | PMTPA ns0, ns1 | checkin to sockpuppet SVN | ESAMS ns2 | In SVN now | |
| Google docs | Google :P | ad-hoc downloads | |||
Soft data | |||||
| Search databases | PMTPA various | regeneratable | |||
| HTTP logs | PMTPA locke | emery | /a/squid | ||
| MediaWiki logs | PMTPA NFS | tridge | /home/wikipedia/logs | ||
Misc data | |||||
| Fundraising Front-End | PMTPA grosley | Software now in SVN | tridge /data/civicrm-frontend/ Backs up once a week via a tar of the directory and rsync | 10 MB | |
| Fundraising Databases | PMTPA db9 | db10 replication | EQIAD db1008/1025 + snapshots | tridge /data/db10/ Backups every other day | 160 MB |
| Office fileserver | OFFICE fileserver | weekly rsync to USB drive | rsync to tridge not running | 2 GB(?) | |
| Office workstations | OFFICE * | currently no backups done (can be enabled, if needed; MacOS only) | |||
| Office laptops | OFFICE * | Time Machine backups to usb drive on Imac (MacOS only) | |||
| Server home directories | PMTPA nfs1 / nfs2 | tridge | Daily backups to Tridge | 30 GB | |
