Job queue

From Wikitech
(Difference between revisions)
Jump to: navigation, search
(Emergency kill)
 
(23 intermediate revisions by 7 users not shown)
Line 1: Line 1:
{{Document me}}
+
__TOC__
  
A certain percentage of things in the job queue are taken care of by random runs during page views.
+
==Overview==
 +
Job queue runners run on the job-runners node group. Install a new job runner using the application::jobrunner class in puppet.
  
There is also a batch runner, [[runJobs.php]]. We have a script to run it in a loop, [[jobs-loop.sh]].
+
The daemon is controlled via <tt>/etc/init.d/mw-job-runner</tt> and will start on boot by default.
  
* What machine does it run on?
+
See also http://www.mediawiki.org/wiki/Manual:Job_queue
** srv31, probably
+
* What user does it run as?
+
** ??
+
* What starts it?
+
** ??
+
  
== Current status ==
+
==Emergency kill==
 
+
If there's an urgent call to kill job queues everywhere for example because they're causing clusterwide swapdeath:<br />
* 2006-04-19
+
- on the job-runner group (see /home/config/others/usr/local/dsh/node_groups) . . .<br />
** ???
+
- as root . . .<br />
 +
- dsh -g job-runners pkill -9 -f obs (this matches jobs-loop and RunJobs and few others, we don't trap sinals in our php scripts so there's no need to kill gracefully)<br />
 +
- if you end up having to power cycle hosts that are nonresponsive, remember to rerun the dsh afterward to make sure job-runners is stopped there as well until someone can investigate the memory issue

Latest revision as of 15:55, 19 January 2012

Contents


[edit] Overview

Job queue runners run on the job-runners node group. Install a new job runner using the application::jobrunner class in puppet.

The daemon is controlled via /etc/init.d/mw-job-runner and will start on boot by default.

See also http://www.mediawiki.org/wiki/Manual:Job_queue

[edit] Emergency kill

If there's an urgent call to kill job queues everywhere for example because they're causing clusterwide swapdeath:
- on the job-runner group (see /home/config/others/usr/local/dsh/node_groups) . . .
- as root . . .
- dsh -g job-runners pkill -9 -f obs (this matches jobs-loop and RunJobs and few others, we don't trap sinals in our php scripts so there's no need to kill gracefully)
- if you end up having to power cycle hosts that are nonresponsive, remember to rerun the dsh afterward to make sure job-runners is stopped there as well until someone can investigate the memory issue

Personal tools
Namespaces

Variants
Actions
Navigation
Ops documentation
Wiki
Toolbox