http://movesonrails.com/articles/tag/process?tag=process en-us 40 New ways to look at software <p>Yes, I know there are a lot of background runners available for rails (I tried most of them), and they all seemed to have their downsides:</p> <ul> <li>BackgroundRB -> Major memory leaks when performing large tasks and bloaty.</li> <li>Spawn -> I really do not want to fork on every request. I use merb for that.</li> <li>Starling -> Memcache and only does sequential processing.</li> <li>ActiveMessaging -> Round hole Square peg.</li> </ul> <p>Also non of these can handle big file uploads nicely and reliable. That is when I decided to create my own: WorkerQueue.</p> <p>Main features:</p> <ul> <li>Simple</li> <li>Fast</li> <li>Works via a rake task and prefers cron</li> <li>Can handle large amounts of data</li> <li>Sequential and Parallel execution on demand</li> <li>Simple error reporting</li> <li>Offload tasks to other or multiple machines</li> </ul> <p>You can clone a copy here:</p> <pre><code> git clone git://github.com/barttenbrinke/worker_queue.git vendor/plugins/worker_queue </code></pre> <p>Or visit <a href="http://github.com/barttenbrinke/worker_queue/tree/master/README">github</a>.</p> <p>UPDATE: WorkerQueue 1.0 Stable is now available on Github.</p> Wed, 13 Aug 2008 21:08:00 +0200 urn:uuid:7a88acf9-b4fa-45a2-9c8a-959bb6153ca5 bart.tenbrinke@movesonrails.com (Bart ten Brinke) http://movesonrails.com/articles/2008/08/13/background-processing-with-workerqueue Rails background process worker queue