Skip to content

yanked - Concurrent Worker

Pre-release
Pre-release
Compare
Choose a tag to compare
@ryandotsmith ryandotsmith released this 05 Sep 20:53
· 271 commits to master since this release

This release was pulled because it was fundamentally flawed.

This release boasts one new feature: Concurrent Job Processing.

Concurrency in the worker is achieved by forking child processes to carry out the execution of jobs. The parent worker process will dequeue a job from the queue and fork a new process to carry out job execution. The parent process is capable of handling many dequeue/fork operations concurrently up to a defined maximum level of concurrency. The control for the max number of child processes is controlled the by QC_CONCURRENCY environment variable. The forking implementation has the side effect of increasing the number of connections to the database, so caution should be exercised.

$ QC_CONCURRENCY=4 bundle exec rake qc:work