External storage

From Wikitech
(Difference between revisions)
Jump to: navigation, search
Line 3: Line 3:
 
'''That means they all go down at once if a breaker flips!'''
 
'''That means they all go down at once if a breaker flips!'''
 
</div>
 
</div>
 +
 +
{{fixme|This page claims five clusters, but [[server admin log]] implies we have more.}}
  
 
The '''external storage''' database cluster are [[MySQL]] servers storing page revision text. The main database only stores a link of the form DB://cluster''x''/''blob_id'', where ''x'' is the number of the cluster and ''blob_id'' is the key to the blob table.
 
The '''external storage''' database cluster are [[MySQL]] servers storing page revision text. The main database only stores a link of the form DB://cluster''x''/''blob_id'', where ''x'' is the number of the cluster and ''blob_id'' is the key to the blob table.

Revision as of 15:04, 10 July 2007

Please don't put ES hosts in a cluster on adjacent hosts anymore. That means they all go down at once if a breaker flips!

FIXME: This page claims five clusters, but server admin log implies we have more.

The external storage database cluster are MySQL servers storing page revision text. The main database only stores a link of the form DB://clusterx/blob_id, where x is the number of the cluster and blob_id is the key to the blob table.

External storage clusters are replicated, there's a master and several slaves. For clusters that are not written to, a failure of the master is not critical.

There are currently 5 external storage clusters in Tampa:

Currently, clusters 4 and 5 are used for storage of new revisions' text blobs, using a round robin load balancing.

Cluster3 has 4 nodes because it stores the text of many current revisions and has a high read load.

Personal tools
Namespaces

Variants
Actions
Navigation
Ops documentation
Wiki
Toolbox