Upload.wikimedia.org
(→Caching layer) |
(→Backend: storage) |
||
| Line 8: | Line 8: | ||
== Backend: storage == | == Backend: storage == | ||
| + | |||
| + | {|border=1 | ||
| + | !server | ||
| + | !path | ||
| + | !purpose | ||
| + | |- | ||
| + | |[[amane]] | ||
| + | |upload3 | ||
| + | |Most primary image dirs... | ||
| + | |- | ||
| + | |[[storage1]] | ||
| + | |upload4 | ||
| + | |Some thumbs and... maybe some primary image dirs? | ||
| + | |- | ||
| + | |[[amane]] | ||
| + | |math | ||
| + | |texvc-rendered images | ||
| + | |} | ||
| + | |||
| + | Some horrible snipped from squid conf: | ||
| + | <pre> | ||
| + | 'apaches' => array( | ||
| + | 'pmtpa' => array( | ||
| + | 'amane.pmtpa.wmnet', | ||
| + | '=de_wiki' => 'storage1.wikimedia.org', | ||
| + | '=en_thumbs' => 'storage1.wikimedia.org', | ||
| + | '=commons_thumbs' => 'storage1.wikimedia.org', | ||
| + | '=wikisource_images' => 'storage1.wikimedia.org', | ||
| + | #'=en_thumbs' => 'anthony.wikimedia.org', | ||
| + | #'=de_thumbs' => 'srv6.wikimedia.org', | ||
| + | ), | ||
| + | ), | ||
| + | </pre> | ||
== Backend: scaling == | == Backend: scaling == | ||
Revision as of 23:06, 12 August 2008
Uploaded image and media files for Wikimedia's wikis appear on the separate subdomain upload.wikimedia.org.
This provides separate physical hosting for efficiency, a separate domain name to aid in browser connection splitting, and a separate domain name to aid in JavaScript security rules.
Contents |
Caching layer
Uploads have a separate set of squid proxy caches from the text squids; this avoids contention between the two data sets, which have different characteristics for object size, update rate, etc.
Backend: storage
| server | path | purpose |
|---|---|---|
| amane | upload3 | Most primary image dirs... |
| storage1 | upload4 | Some thumbs and... maybe some primary image dirs? |
| amane | math | texvc-rendered images |
Some horrible snipped from squid conf:
'apaches' => array(
'pmtpa' => array(
'amane.pmtpa.wmnet',
'=de_wiki' => 'storage1.wikimedia.org',
'=en_thumbs' => 'storage1.wikimedia.org',
'=commons_thumbs' => 'storage1.wikimedia.org',
'=wikisource_images' => 'storage1.wikimedia.org',
#'=en_thumbs' => 'anthony.wikimedia.org',
#'=de_thumbs' => 'srv6.wikimedia.org',
),
),
Backend: scaling
[3:33pm] mark: 01:31:52 <TimStarling> the first is for thumb.php requests by users, the second is for ordinary requests via the 404 handler [3:34pm] mark: so it's accessed in two ways [3:34pm] mark: one via squid directly
please add more documentation thx
Private wikis
Our private wikis do not serve their files to the public through this interface; they're served through img_auth.php on the local domain, which enforced authentication.
Compatibility links
Most of our wikis have an rewrite rule to redirect requests from /upload and /math on the primary wiki domain to the appropriate subdirectory on upload.wikimedia.org. This provides compatbility for old direct image links from the days before the separate image hosting.
Special:Filepath can also send redirects here.
