In Rails world I would write small admin app that would just push the jobs to Redis and handle those jobs in backround scaling the workers whenever needed.
I am looking for something similar that would give me: - transparent queueing and running jobs on multiple workers - dashboard like functionality so we can monitor the jobs - get errors, statistcs etc... - I don't care what I use as a transport it can be Redis or RabbitMQ or anything else - I would like to concentrate on business logic and not on writing the framework for running jobs
Maybe I just have wrong approach being spoiled by Rails, maybe in Java world you can do it completely differently - but current solution where we start hundreds of threads and we cannot restart the main app because we would loose all the work is crazy for me.
I cannot imagine that there nothing like that :)
UPDATE1: Is anybody using this? http://gresrun.github.io/jesque/
