Main Page

From Wikitech
(Difference between revisions)
Jump to: navigation, search
 
(58 intermediate revisions by 24 users not shown)
Line 1: Line 1:
−
{{Topnavbar}}
+
Welcome to '''Wikitech'''! This wiki is for internal technical documentation for the Wikimedia Foundation. For technical documentation of MediaWiki software, see [https://www.mediawiki.org/wiki/MediaWiki MediaWiki.org].
  
−
<font size=+2>DO NOT RUN SLAVE SERVERS WITH READ_ONLY=0</font>
+
{| style="width: 100%" class="leftalign-table messagebox"
 +
!style="width:100px" | Servers
 +
| [[Apaches]] '''&middot;''' [[Squids]] '''&middot;''' [[Image scalers|Scalers]] '''&middot;''' [[NFS]] '''&middot;''' [[DNS]] '''&middot;''' [[PowerDNS]] '''&middot;''' [[Memcached]] '''&middot;''' [[MySQL]] '''&middot;''' [[LDAP]] '''&middot;''' [[Multicast HTCP purging]] '''&middot;''' [[Virtualization]] '''&middot;''' [[Https|HTTPS]] '''&middot;''' [[Build a new server]] '''&middot;'''  [[PartMan]]
 +
|-
 +
! Backups
 +
| [[Backup procedures|Current status]] '''&middot;''' [[Disaster Recovery]] '''&middot;''' [[Dumps|XML database dumps]]  '''&middot;''' [[Offsite Backups|Offsite]]<br />
 +
OSs: [http://www.ubuntu.com/ Ubuntu] ([[:Category:Ubuntu|Ubuntu]]) '''&middot;''' [[Automated installation]] '''&middot;''' [[Distribution upgrades]] '''&middot;''' [[Puppet]] '''&middot;''' [[APT repository]] '''&middot;''' [[Solaris]]
 +
|-
 +
! Inner
 +
| [[Sensors]] '''&middot;''' [[Console server]] '''&middot;''' [[IPMI]]
 +
|-
 +
! War
 +
| [[Security]]
 +
|-
 +
! Maps
 +
| [[Batch jobs]] '''&middot;''' [[Locations]] <small>of backups, mirrors, etc.</small> '''&middot;''' [[Scripts]]
 +
|-
 +
! Email
 +
| [[Mail]] '''&middot;''' [[IMAP]] '''&middot;''' [[Mailing lists]] '''&middot;''' [[OTRS]]
 +
|-
 +
! Guides
 +
| [[How-To|How-Tos]] '''&middot;''' [[Wiki farm]] '''&middot;''' [[Profiling]] ([http://noc.wikimedia.org/cgi-bin/report.py web interface]) '''&middot;''' [[Using the local certificate authority]] '''&middot;''' [[Puppet and iptables]]
 +
|-
 +
! Network
 +
| [[Network design|Design]] '''&middot;''' [[BGP]] '''&middot;''' [[IP addresses|IPs]] '''&middot;''' [[Network utils|Utils]] '''&middot;''' [[802.1Q]] '''&middot;''' [[RANCID]] '''&middot;''' [http://puck.nether.net/netops/ NOC Phones] '''&middot;''' [[LVS]] '''&middot;''' [[Link aggregation]] ''&middot;'' [[Network cheat sheet]]
 +
|-
 +
! Other
 +
| [[Status monitors]] '''&middot;''' [[Platform-specific documentation]]
 +
|-
 +
! Wiki
 +
| [[:Category:Main|Browse root category]] '''&middot;''' [[:Category:Wiki]] '''&middot;''' [[:Category:Templates]]
 +
|}
 +
* [[:Category:Bot and monitoring]]
 +
* [[:Category:Clusters]]
 +
* [[Presentations]]
 +
* [[Software deployments]]
  
−
==Suggestions for stuff to put in this wiki==
+
* Please add general MediaWiki documentation to [[mw:|the MediaWiki.org wiki]]
−
* Checklist for apache, squid, DB, to avoid snafus like the whole site going down because logrotate wasn't set up properly on a single squid.
+
−
* Explanations of stuff which you look after so that others can fix it more easily if it breaks and you're not around.
+
−
* Some faqs about common unix tools, useful scripts.
+
  
 
==Links==
 
==Links==
 
<div class="plainlinks">
 
<div class="plainlinks">
−
* Please add general MediaWiki documentation at [http://meta.wikipedia.org/wiki/MediaWiki_User%27s_Guide MediaWiki User's Guide].
+
* Mark's Request Stats: [http://wiki.wikked.net/wiki/Wikimedia_statistics/Daily Combined] [http://www.nedworks.org/~mark/reqstats/ raw]
−
 
+
* Ganglia [http://ganglia.wikimedia.org graphs]
−
* ganglia graphs: [http://download.wikimedia.org/ganglia/ small] | [http://download.wikimedia.org/ganglia2/ medium] | [http://download.wikimedia.org/ganglia3/ large]
+
−
** small graphs: [http://download.wikimedia.org/ganglia/?m=cpu_report&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4  cpu_report] | [http://download.wikimedia.org/ganglia/?m=http_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 http_in] | [http://download.wikimedia.org/ganglia/?m=squ_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 squ_in] | [http://download.wikimedia.org/ganglia/?m=mysql_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 mysql_in] | [http://download.wikimedia.org/ganglia/?m=mysql_out&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 mysql_out] | [http://download.wikimedia.org/ganglia/?m=mysql_qps&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 mysql_qps]
+
−
** medium graphs: [http://download.wikimedia.org/ganglia2/?m=cpu_report&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 cpu_report] | [http://download.wikimedia.org/ganglia2/?m=http_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 http_in] | [http://download.wikimedia.org/ganglia2/?m=squ_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 squ_in] | [http://download.wikimedia.org/ganglia2/?m=mysql_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 mysql_in] | [http://download.wikimedia.org/ganglia2/?m=mysql_out&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 mysql_out] | [http://download.wikimedia.org/ganglia2/?m=mysql_qps&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 mysql_qps]
+
−
{{Topnavbar}}
+
−
 
+
−
<font size=+2>DO NOT RUN SLAVE SERVERS WITH READ_ONLY=0</font>
+
−
 
+
−
==Suggestions for stuff to put in this wiki==
+
−
* Checklist for apache, squid, DB, to avoid snafus like the whole site going down because logrotate wasn't set up properly on a single squid.
+
−
* Explanations of stuff which you look after so that others can fix it more easily if it breaks and you're not around.
+
−
* Some faqs about common unix tools, useful scripts.
+
−
 
+
−
==Links==
+
−
<div class="plainlinks">
+
−
* Please add general MediaWiki documentation at [http://meta.wikipedia.org/wiki/MediaWiki_User%27s_Guide MediaWiki User's Guide].
+
−
 
+
−
* ganglia graphs: [http://download.wikimedia.org/ganglia/ small] | [http://download.wikimedia.org/ganglia2/ medium] | [http://download.wikimedia.org/ganglia3/ large]
+
−
** small graphs: [http://download.wikimedia.org/ganglia/?m=cpu_report&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4  cpu_report] | [http://download.wikimedia.org/ganglia/?m=http_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 http_in] | [http://download.wikimedia.org/ganglia/?m=squ_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 squ_in] | [http://download.wikimedia.org/ganglia/?m=mysql_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 mysql_in] | [http://download.wikimedia.org/ganglia/?m=mysql_out&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 mysql_out] | [http://download.wikimedia.org/ganglia/?m=mysql_qps&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 mysql_qps]
+
−
** medium graphs: [http://download.wikimedia.org/ganglia2/?m=cpu_report&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 cpu_report] | [http://download.wikimedia.org/ganglia2/?m=http_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 http_in] | [http://download.wikimedia.org/ganglia2/?m=squ_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 squ_in] | [http://download.wikimedia.org/ganglia2/?m=mysql_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 mysql_in] | [http://{{Topnavbar}}
+
−
 
+
−
<font size=+2>DO NOT RUN SLAVE SERVERS WITH READ_ONLY=0</font>
+
−
 
+
−
==Suggestions for stuff to put in this wiki==
+
−
* Checklist for apache, squid, DB, to avoid snafus like the whole site going down because logrotate wasn't set up properly on a single squid.
+
−
* Explanations of stuff which you look after so that others can fix it more easily if it breaks and you're not around.
+
−
* Some faqs about common unix tools, useful scripts.
+
−
 
+
−
==Links==
+
−
<div class="plainlinks">
+
−
* Please add general MediaWiki documentation at [http://meta.wikipedia.org/wiki/MediaWiki_User%27s_Guide MediaWiki User's Guide].
+
−
 
+
−
* ganglia graphs: [http://download.wikimedia.org/ganglia/ small] | [http://download.wikimedia.org/ganglia2/ medium] | [http://download.wikimedia.org/ganglia3/ large]
+
−
** small graphs: [http://download.wikimedia.org/ganglia/?m=cpu_report&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4  cpu_report] | [http://download.wikimedia.org/ganglia/?m=http_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 http_in] | [http://download.wikimedia.org/ganglia/?m=squ_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 squ_in] | [http://download.wikimedia.org/ganglia/?m=mysql_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 mysql_in] | [http://download.wikimedia.org/ganglia/?m=mysql_out&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 mysql_out] | [http://download.wikimedia.org/ganglia/?m=mysql_qps&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=4 mysql_qps]
+
−
** medium graphs: [http://download.wikimedia.org/ganglia2/?m=cpu_report&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 cpu_report] | [http://download.wikimedia.org/ganglia2/?m=http_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 http_in] | [http://download.wikimedia.org/ganglia2/?m=squ_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 squ_in] | [http://download.wikimedia.org/ganglia2/?m=mysql_in&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 mysql_in] | [http://download.wikimedia.org/ganglia2/?m=mysql_out&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 mysql_out] | [http://download.wikimedia.org/ganglia2/?m=mysql_qps&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 mysql_qps]
+
−
 
+
−
* http://wikimedia.org/stats/live/ - live traffic graphs from the squids ([[MRTG]])
+
−
* '''[http://noc.wikimedia.org/~mark/cgi-bin/cricket/grapher.cgi Cricket stats]''': [http://noc.wikimedia.org/~mark/cgi-bin/cricket/grapher.cgi?target=%2Fsquid Squids] | [http://noc.wikimedia.org/~mark/cgi-bin/cricket/grapher.cgi?target=%2Fswitchports Switchports]
+
 
* [http://meta.wikimedia.org/wiki/Wikimedia_servers Meta:Wikimedia servers]
 
* [http://meta.wikimedia.org/wiki/Wikimedia_servers Meta:Wikimedia servers]
 
</div>
 
</div>
−
 
+
[[Category:Wiki]]
−
==Things to do==
+
−
[[Datacenter tasks]]
+
−
{{todo}}
+
−
download.wikimedia.org/ganglia2/?m=mysql_out&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 mysql_out] | [http://download.wikimedia.org/ganglia2/?m=mysql_qps&r=hour&s=descending&c=Florida+cluster&h=&sh=1&hc=2 mysql_qps]
+
−
 
+
−
* http://wikimedia.org/stats/live/ - live traffic graphs from the squids ([[MRTG]])
+
−
* '''[http://noc.wikimedia.org/~mark/cgi-bin/cricket/grapher.cgi Cricket stats]''': [http://noc.wikimedia.org/~mark/cgi-bin/cricket/grapher.cgi?target=%2Fsquid Squids] | [http://noc.wikimedia.org/~mark/cgi-bin/cricket/grapher.cgi?target=%2Fswitchports Switchports]
+
−
* [http://meta.wikimedia.org/wiki/Wikimedia_servers Meta:Wikimedia servers]
+
−
</div>
+
−
 
+
−
==Things to do==
+
−
[[Datacenter tasks]]
+
−
{{todo}}
+
−
 
+
−
* http://wikimedia.org/stats/live/ - live traffic graphs from the squids ([[MRTG]])
+
−
* '''[http://noc.wikimedia.org/~mark/cgi-bin/cricket/grapher.cgi Cricket stats]''': [http://noc.wikimedia.org/~mark/cgi-bin/cricket/grapher.cgi?target=%2Fsquid Squids] | [http://noc.wikimedia.org/~mark/cgi-bin/cricket/grapher.cgi?target=%2Fswitchports Switchports]
+
−
* [http://meta.wikimedia.org/wiki/Wikimedia_servers Meta:Wikimedia servers]
+
−
</div>
+
−
 
+
−
==Things to do==
+
−
[[Datacenter tasks]]
+
−
{{todo}}
+

Latest revision as of 08:43, 27 February 2013

Welcome to Wikitech! This wiki is for internal technical documentation for the Wikimedia Foundation. For technical documentation of MediaWiki software, see MediaWiki.org.

Servers Apaches · Squids · Scalers · NFS · DNS · PowerDNS · Memcached · MySQL · LDAP · Multicast HTCP purging · Virtualization · HTTPS · Build a new server · PartMan
Backups Current status · Disaster Recovery · XML database dumps · Offsite

OSs: Ubuntu (Ubuntu) · Automated installation · Distribution upgrades · Puppet · APT repository · Solaris

Inner Sensors · Console server · IPMI
War Security
Maps Batch jobs · Locations of backups, mirrors, etc. · Scripts
Email Mail · IMAP · Mailing lists · OTRS
Guides How-Tos · Wiki farm · Profiling (web interface) · Using the local certificate authority · Puppet and iptables
Network Design · BGP · IPs · Utils · 802.1Q · RANCID · NOC Phones · LVS · Link aggregation · Network cheat sheet
Other Status monitors · Platform-specific documentation
Wiki Browse root category · Category:Wiki · Category:Templates

[edit] Links

Retrieved from "http://wikitech-old.wikimedia.org/index.php?title=Main_Page&oldid=56873"
Personal tools
Namespaces

Variants
Actions
Navigation
Ops documentation
Wiki
Toolbox