php-censor/docs/en/workers/worker.md

110 lines
4.5 KiB
Markdown
Raw Permalink Normal View History

2017-01-09 17:58:44 +01:00
Run builds using a worker
2017-01-04 13:22:20 +01:00
=========================
2016-07-19 11:12:28 +02:00
The PHP Censor Worker runs in the background on your server and waits for new builds to be added to a Beanstalkd queue.
Unless already running a build, the worker will pick up and start running new builds almost immediately after their
creation.
2016-07-17 16:20:35 +02:00
The worker is the recommended way to run PHP Censor builds. You can run several workers all watching one queue,
allowing jobs to be run simultaneously without the overhead of polling your database.
2016-07-17 16:20:35 +02:00
If you can't run Beanstalkd on your server, or would prefer to run builds on a regular schedule, you should consider
2017-04-10 14:53:13 +02:00
using the [running builds via Cron](cron.md).
2016-07-17 16:20:35 +02:00
2016-07-19 11:12:28 +02:00
Pre-Requisites
2017-01-04 13:22:20 +01:00
--------------
2016-07-17 16:20:35 +02:00
* You need to install [Beanstalkd](http://kr.github.io/beanstalkd/) - On Ubuntu, this is as simple as running
`apt-get install beanstalkd`.
2016-07-17 16:20:35 +02:00
* [Supervisord](http://supervisord.org/) needs to be installed and running on your server.
2016-07-19 13:05:02 +02:00
Setting up the PHP Censor worker
2017-01-04 13:22:20 +01:00
--------------------------------
2016-07-17 16:20:35 +02:00
2016-07-19 11:12:28 +02:00
### On a new installation
2016-07-17 16:20:35 +02:00
2017-07-18 15:54:24 +02:00
Setting up the worker on a new installation of PHP Censor is as simple as entering the appropriate values for your
Beanstalkd server hostname and queue name when running the PHP Censor installer. By default, the installer assumes that
you'll be using beanstalkd on `localhost` and will use the queue name `php-censor-queue`.
2016-07-17 16:20:35 +02:00
2016-07-19 11:12:28 +02:00
### On an existing installation
2016-07-17 16:20:35 +02:00
2017-07-18 15:54:24 +02:00
On an existing installation, to set up the worker, you simply need to add the beanstalkd host and queue names directly
into your `config.yml` file. You should add a `worker` key beneath the `php-censor` section, with the properties `host`
and `queue` as outlined in the screenshot below:
2016-07-17 16:20:35 +02:00
2016-07-19 13:05:02 +02:00
Running the PHP Censor worker
2017-01-04 13:22:20 +01:00
-----------------------------
2016-07-17 16:20:35 +02:00
2017-07-18 15:54:24 +02:00
Once you've set up PHP Censor to add your jobs to a beanstalkd queue, you need to start the worker so that it can pick
up and run your builds. On most servers, it is best to manage this using supervisord. The following instructions work
on Ubuntu, but will need slight amendments for other distributions.
2016-07-17 16:20:35 +02:00
2017-07-18 15:54:24 +02:00
Using your preferred text editor, create a file named `php-censor.conf` under `/etc/supervisor/conf.d`. In it, enter
the following config:
2016-07-17 16:20:35 +02:00
```
[program:php-censor]
command=/path/to/php-censor/bin/console php-censor:worker
2016-07-17 16:20:35 +02:00
process_name=%(program_name)s_%(process_num)02d
stdout_logfile=/var/log/php-censor.log
stderr_logfile=/var/log/php-censor-err.log
user=php-censor
2016-07-17 16:20:35 +02:00
autostart=true
autorestart=true
environment=HOME="/home/php-censor",USER="php-censor"
2016-07-17 16:20:35 +02:00
numprocs=2
```
2017-07-18 15:54:24 +02:00
You'll need to edit the '/path/to/php-censor', the `user` value and the `environment` value to suit your server.
The user needs to be an actual system user with suitable permissions to execute PHP and PHP Censor.
2016-07-17 16:20:35 +02:00
2017-07-18 15:54:24 +02:00
Once you've created this file, simply restart supervisord using the command `service supervisor restart` and 2
instances of PHP Censor's worker should start immediately. You can verify this by running the command
`ps aux | grep php-censor`, which should give you output as follows:
2016-07-17 16:20:35 +02:00
```
➜ ~ ps aux | grep php-censor
php-censor 19057 0.0 0.9 200244 18720 ? S 03:00 0:01 php /php-censor/console php-censor:worker
php-censor 19058 0.0 0.9 200244 18860 ? S 03:00 0:01 php /php-censor/console php-censor:worker
2016-07-17 16:20:35 +02:00
```
Also you can simple daemonise worker by `nohup`:
```
nohup /path/to/php-censor/bin/console php-censor:worker &> /var/log/php-censor-worker.log </dev/null & # and you can save pid in pidfile with echo "$!" > /var/run/php-censor-worker.pid, but it's not really necessary
```
2017-07-18 15:54:24 +02:00
But keep in mind: it won't restart your worker if it fails and can be inconvenient to manage worker process in contrast
with other solutions. So, it's good for debug purposes or as temporary solution.
Also you can use systemd to run the worker.
Configuration for the unit is almost the same as supervisord's configuration.
Just copy this config to `/etc/systemd/system/php-censor.service` with right permissions, enable
`systemctl enable php-censor.service` and run it by `systemctl start php-censor.service`. If you want to start more
than one worker, just create more unit files with different name and repeat previous steps.
```
[Unit]
Description=PHPCensor Worker
After=network.target
[Service]
Type=simple
ExecStart=/your/path/bin/console php-censor:worker
Restart=always
#Could be changed
User=php-censor
#Could be changed
Group=php-censor
[Install]
WantedBy=multi-user.target
```
And check that it works properly by `systemctl status php-censor.service`
2016-07-19 13:05:02 +02:00
That's it! Now, whenever you create a new build in PHP Censor, it should start building immediately.