Memcached

From Wikitech
(Difference between revisions)
Jump to: navigation, search
(new allocations)
(temporary memcached changes until size/number per machine can be changed.)
Line 1: Line 1:
 
Memcached configuration.
 
Memcached configuration.
 +
 +
/usr/local/bin/run-memcached.sh contains a read only copy of /etc/rc.local
  
 
==new allocations==
 
==new allocations==
−
New size 140 megabytes each. Something between 20 and 35 megabytes of swap each appears not to cause high page fault rates.
+
New size 280 megabytes each. Something between 20 and 35 megabytes of swap each appears not to cause high page fault rates.
  
 
<table border=1>
 
<table border=1>
−
<tr><th>server<th>IP<th>copies<th>total<th>swp each
+
<tr><th>server<th>IP<th>copies<th>total<th>inc code<th>swp each
−
<tr><td>dalembert
+
−
  <td>207.142.131.194
+
−
  <td>1
+
−
  <td>140
+
−
  <td>8m
+
 
<tr><td>Bart
 
<tr><td>Bart
 
   <td>207.142.131.227
 
   <td>207.142.131.227
−
   <td>7
+
   <td>4
−
   <td>980
+
   <td>1120
−
   <td>0
+
   <td>1360
 +
  <td>4m
 
<tr><td>Bayle
 
<tr><td>Bayle
 
   <td>207.142.131.228
 
   <td>207.142.131.228
−
   <td>7
+
   <td>4
−
   <td>980
+
   <td>1120
 +
  <td>1360
 
   <td>4m
 
   <td>4m
 
<tr><td>Isidore
 
<tr><td>Isidore
 
   <td>207.142.131.231
 
   <td>207.142.131.231
−
   <td>2
+
   <td>1
 
   <td>280
 
   <td>280
 +
  <td>340
 
   <td>0
 
   <td>0
 
<tr><td>Moreri
 
<tr><td>Moreri
 
   <td>207.142.131.232
 
   <td>207.142.131.232
−
   <td>2
+
   <td>1
 
   <td>280
 
   <td>280
 +
  <td>340
 
   <td>0
 
   <td>0
 
<tr><td>Yongle
 
<tr><td>Yongle
 
   <td>207.142.131.237
 
   <td>207.142.131.237
−
   <td>13
+
   <td>7
−
   <td>1820
+
   <td>1960
−
   <td>11m
+
   <td>2380
−
<tr><td>Avicenna
+
   <td>0
−
   <td>207.142.131.249
+
<tr><th>total<th>&nbsp;<th>17<th>4760<th>&nbsp;<th>&nbsp;
−
  <td>1
+
−
  <td>140
+
−
  <td>14m
+
−
<tr><th>total<th>&nbsp;<th>33<th>4620<th>&nbsp;
+
  
 
</table>
 
</table>
  
 +
==temporary changes==
 +
Until the memcached size can be changed from 180MB.
  
 +
<table border=1>
 +
<tr><th>server<th>IP<th>copies<th>total<th>inc code<th>swp each
 +
<tr><td>Bart
 +
  <td>207.142.131.227
 +
  <td>6
 +
  <td>1080
 +
  <td>1440
 +
  <td>15m
 +
<tr><td>Bayle
 +
  <td>207.142.131.228
 +
  <td>6
 +
  <td>1080
 +
  <td>1440
 +
  <td>21m
 +
<tr><td>Isidore
 +
  <td>207.142.131.231
 +
  <td>2
 +
  <td>360
 +
  <td>480
 +
  <td>22m
 +
<tr><td>Moreri
 +
  <td>207.142.131.232
 +
  <td>1
 +
  <td>180
 +
  <td>240
 +
  <td>0
 +
<tr><td>Yongle
 +
  <td>207.142.131.237
 +
  <td>11
 +
  <td>1980
 +
  <td>2640
 +
  <td>27m
 +
<tr><th>total<th>&nbsp;<th>26<th>4680<th>&nbsp;<th>&nbsp;
 +
</table>
 +
 +
CommonSettings.php entry looks like this:
 +
<pre>
 +
$wgMemCachedServers = array(
 +
        "207.142.131.227:11000", # bart
 +
        "207.142.131.227:11001",
 +
        "207.142.131.227:11002",
 +
        "207.142.131.227:11003",
 +
        "207.142.131.227:11004",
 +
        "207.142.131.227:11005",
 +
        "207.142.131.228:11000", # bayle
 +
        "207.142.131.228:11001",
 +
        "207.142.131.228:11002",
 +
        "207.142.131.228:11003",
 +
        "207.142.131.228:11004",
 +
        "207.142.131.228:11005",
 +
        "207.142.131.231:11000", # isidore
 +
        "207.142.131.231:11001",
 +
        "207.142.131.232:11000", # moreri
 +
        "207.142.131.237:11000", # yongle
 +
        "207.142.131.237:11001",
 +
        "207.142.131.237:11002",
 +
        "207.142.131.237:11003",
 +
        "207.142.131.237:11004",
 +
        "207.142.131.237:11005",
 +
        "207.142.131.237:11006",
 +
        "207.142.131.237:11007",
 +
        "207.142.131.237:11008",
 +
        "207.142.131.237:11009",
 +
        "207.142.131.237:11010",
 +
);
 +
</pre>
  
 
==swap analysis==
 
==swap analysis==
−
Done just after peak time after 8 days running (for most systems). New size 140M
+
Done just after peak time after 8 days running (for most systems). Mmecached itself seems to use about 60 megabytes per copy.
  
 
<table border=1>
 
<table border=1>
−
<tr><th>server<th>IP<th>copies<th>total<th>pg flt<th>CPU min<th>cached<th>MC swapped
+
<tr><th>server<th>IP<th>copies<th>total<th>inc code<th>pg flt<th>CPU min<th>cached<th>MC swapped
 
<tr><td>dalembert
 
<tr><td>dalembert
 
   <td>207.142.131.194
 
   <td>207.142.131.194
 
   <td>1
 
   <td>1
 
   <td>180
 
   <td>180
 +
  <td>240
 
   <td>43000
 
   <td>43000
 
   <td>12
 
   <td>12
Line 64: Line 130:
 
   <td>1
 
   <td>1
 
   <td>180
 
   <td>180
 +
  <td>240
 
   <td>143000
 
   <td>143000
 
   <td>25
 
   <td>25
Line 72: Line 139:
 
   <td>1
 
   <td>1
 
   <td>180
 
   <td>180
 +
  <td>240
 
   <td>192000
 
   <td>192000
 
   <td>39
 
   <td>39
Line 80: Line 148:
 
   <td>1
 
   <td>1
 
   <td>180
 
   <td>180
 +
  <td>240
 
   <td>170000
 
   <td>170000
 
   <td>61
 
   <td>61
Line 88: Line 157:
 
   <td>1
 
   <td>1
 
   <td>180
 
   <td>180
 +
  <td>240
 
   <td>142000
 
   <td>142000
 
   <td>31
 
   <td>31
Line 96: Line 166:
 
   <td>6
 
   <td>6
 
   <td>1080
 
   <td>1080
 +
  <td>1440
 
   <td>1820
 
   <td>1820
 
   <td>516
 
   <td>516
Line 104: Line 175:
 
   <td>6
 
   <td>6
 
   <td>1080
 
   <td>1080
 +
  <td>1440
 
   <td>3734
 
   <td>3734
 
   <td>425
 
   <td>425
Line 112: Line 184:
 
   <td>2
 
   <td>2
 
   <td>360
 
   <td>360
 +
  <td>480
 
   <td>2486
 
   <td>2486
 
   <td>224
 
   <td>224
Line 120: Line 193:
 
   <td>2
 
   <td>2
 
   <td>360
 
   <td>360
 +
  <td>480
 
   <td>52000
 
   <td>52000
 
   <td>693
 
   <td>693
Line 128: Line 202:
 
   <td>12
 
   <td>12
 
   <td>2160
 
   <td>2160
 +
  <td>2880
 
   <td>16574
 
   <td>16574
 
   <td>208
 
   <td>208
 
   <td>13640k
 
   <td>13640k
 
   <td>476m/40e
 
   <td>476m/40e
−
<tr><td>Avicenna
+
<tr><td>Browne 2GB
−
   <td>207.142.131.249
+
   <td>207.142.131.229
−
   <td>1
+
   <td>0
−
   <td>180
+
   <td>0
−
   <td>101000
+
   <td>&nbsp;
−
   <td>14
+
   <td>broken
−
   <td>212892k
+
   <td>&nbsp;
−
   <td>54m
+
   <td>&nbsp;
 +
  <td>&nbsp;
 +
<tr><td>Coronelli 3GB
 +
  <td>207.142.131.230
 +
  <td>0
 +
  <td>0
 +
  <td>&nbsp;
 +
  <td>&nbsp;
 +
  <td>&nbsp;
 +
  <td>237668 buf 622124 cache
 +
  <td>squid 514M of 2341M
 +
<tr><td>Maurus 4GB
 +
  <td>207.142.131.238
 +
  <td>0
 +
  <td>0
 +
  <td>&nbsp;
 +
  <td>&nbsp;
 +
  <td>&nbsp;
 +
  <td>264640 buf
 +
  <td>squid 514M of 1936M
 +
<tr><td>Rabanus 4GB
 +
  <td>207.142.131.239
 +
  <td>0
 +
  <td>0
 +
  <td>&nbsp;
 +
  <td>&nbsp;
 +
  <td>&nbsp;
 +
  <td>267476k buf 727132 cache
 +
  <td>squid 514MB of 2557M
 
<tr><th>total<th>&nbsp;<th>34<th>6120<th>&nbsp;<th>&nbsp;<th>&nbsp;<th>&nbsp;
 
<tr><th>total<th>&nbsp;<th>34<th>6120<th>&nbsp;<th>&nbsp;<th>&nbsp;<th>&nbsp;
  

Revision as of 07:38, 29 September 2004

Memcached configuration.

/usr/local/bin/run-memcached.sh contains a read only copy of /etc/rc.local

Contents

new allocations

New size 280 megabytes each. Something between 20 and 35 megabytes of swap each appears not to cause high page fault rates.

serverIPcopiestotalinc codeswp each
Bart 207.142.131.227 4 1120 1360 4m
Bayle 207.142.131.228 4 1120 1360 4m
Isidore 207.142.131.231 1 280 340 0
Moreri 207.142.131.232 1 280 340 0
Yongle 207.142.131.237 7 1960 2380 0
total 174760  

temporary changes

Until the memcached size can be changed from 180MB.

serverIPcopiestotalinc codeswp each
Bart 207.142.131.227 6 1080 1440 15m
Bayle 207.142.131.228 6 1080 1440 21m
Isidore 207.142.131.231 2 360 480 22m
Moreri 207.142.131.232 1 180 240 0
Yongle 207.142.131.237 11 1980 2640 27m
total 264680  

CommonSettings.php entry looks like this: 

$wgMemCachedServers = array(
        "207.142.131.227:11000", # bart
        "207.142.131.227:11001",
        "207.142.131.227:11002",
        "207.142.131.227:11003",
        "207.142.131.227:11004",
        "207.142.131.227:11005",
        "207.142.131.228:11000", # bayle
        "207.142.131.228:11001",
        "207.142.131.228:11002",
        "207.142.131.228:11003",
        "207.142.131.228:11004",
        "207.142.131.228:11005",
        "207.142.131.231:11000", # isidore
        "207.142.131.231:11001",
        "207.142.131.232:11000", # moreri
        "207.142.131.237:11000", # yongle
        "207.142.131.237:11001",
        "207.142.131.237:11002",
        "207.142.131.237:11003",
        "207.142.131.237:11004",
        "207.142.131.237:11005",
        "207.142.131.237:11006",
        "207.142.131.237:11007",
        "207.142.131.237:11008",
        "207.142.131.237:11009",
        "207.142.131.237:11010",
);

swap analysis

Done just after peak time after 8 days running (for most systems). Mmecached itself seems to use about 60 megabytes per copy.

serverIPcopiestotalinc codepg fltCPU mincachedMC swapped
dalembert 207.142.131.194 1 180 240 43000 12 214756 48m
Tingxi 207.142.131.195 1 180 240 143000 25 252928k 112m
Alrazi 207.142.131.196 1 180 240 192000 39 13232k 127m
Friedrich 207.142.131.197 1 180 240 170000 61 234780 147m
Harris 207.142.131.199 1 180 240 142000 31 304076 136m
Bart 207.142.131.227 6 1080 1440 1820 516 441232 87m/15e
Bayle 207.142.131.228 6 1080 1440 3734 425 420096 127m/21e
Isidore 207.142.131.231 2 360 480 2486 224 341100 44m/22e
Moreri 207.142.131.232 2 360 480 52000 693 352312 71m/35e
Yongle 207.142.131.237 12 2160 2880 16574 208 13640k 476m/40e
Browne 2GB 207.142.131.229 0 0   broken      
Coronelli 3GB 207.142.131.230 0 0       237668 buf 622124 cache squid 514M of 2341M
Maurus 4GB 207.142.131.238 0 0       264640 buf squid 514M of 1936M
Rabanus 4GB 207.142.131.239 0 0       267476k buf 727132 cache squid 514MB of 2557M
total 346120    


new

180MB each. 200MB looked too tight for two copies each on Isidore and Moreri. Vincent wasn't used because it showed cyclic high RAM use. Switched on 19 September 2004.

serverIPcopiestotalnotes
dalembert 207.142.131.194 1 180  
Tingxi 207.142.131.195 1 180  
Alrazi 207.142.131.196 1 180  
Friedrich 207.142.131.197 1 180  
Harris 207.142.131.199 1 180  
Bart 207.142.131.227 6 1080  
Bayle 207.142.131.228 6 1080  
Isidore 207.142.131.231 2 360  
Moreri 207.142.131.232 2 360  
Yongle 207.142.131.237 12 2160  
Avicenna 207.142.131.249 1 180  
total 346120 

CommonSettings.php entry looks like this: 

$wgMemCachedServers = array(
        "207.142.131.194:11000", # dalembert
        "207.142.131.195:11000", # tingxi
        "207.142.131.196:11000", # alrazi
        "207.142.131.197:11000", # friedrich
        "207.142.131.199:11000", # harris
        "207.142.131.227:11000", # bart
        "207.142.131.227:11001",
        "207.142.131.227:11002",
        "207.142.131.227:11003",
        "207.142.131.227:11004",
        "207.142.131.227:11005",
        "207.142.131.228:11000", # bayle
        "207.142.131.228:11001",
        "207.142.131.228:11002",
        "207.142.131.228:11003",
        "207.142.131.228:11004",
        "207.142.131.228:11005",
        "207.142.131.231:11000", # isidore
        "207.142.131.231:11001",
        "207.142.131.232:11000", # moreri
        "207.142.131.232:11001",
        "207.142.131.237:11000", # yongle
        "207.142.131.237:11001",
        "207.142.131.237:11002",
        "207.142.131.237:11003",
        "207.142.131.237:11004",
        "207.142.131.237:11005",
        "207.142.131.237:11006",
        "207.142.131.237:11007",
        "207.142.131.237:11008",
        "207.142.131.237:11009",
        "207.142.131.237:11010",
        "207.142.131.237:11011",
        "207.142.131.249:11000", # avicenna
);

old

512MB each, used prior to 19 September 2004.

serverIPcopiestotalnotes
Rabanus 207.142.131.239 4 2048 moving to squid
Yongle 207.142.131.237 4 2048 keeping - runs stats job
Bart 207.142.131.227 2 1024  
Bayle 207.142.131.228 2 1024  
total 126144 

CommonSettings.php entry looked like this: 

$wgMemCachedServers = array(
        "207.142.131.227:11000", # bart
        "207.142.131.227:11001",
        "207.142.131.228:11000", # bayle
        "207.142.131.228:11001",
        "207.142.131.237:11000", # yongle
        "207.142.131.237:11001",
        "207.142.131.237:11002",
        "207.142.131.237:11003",
        "207.142.131.239:11000", # rabanus
        "207.142.131.239:11001",
        "207.142.131.239:11002",
        "207.142.131.239:11003"
);
Retrieved from "http://wikitech-old.wikimedia.org/index.php?title=Memcached&oldid=2228"
Personal tools
Namespaces

Variants
Actions
Navigation
Ops documentation
Wiki
Toolbox