Jobs magically disappear from queue (delayed_job mongoid 2 on heroku)
- by Hayk Saakian
lets say i do something like
arrs = Article.where(:body => nil)
i'll have arrs.count is let's say 900
and i do
arrs.each do |ar|
ar.delay.download_via_diffbot #a method that takes some time, does some http, and writes a non-nil value to ar.body
end
now i'll watch the logs, and a wait a few minutes on ~5 dynos do the jobs, and do a count again: arrs.count is now ~800
so wtf, i thought i just told my workers to do ~900 jobs, what happened to the other 800?
i can confirm that i'm only making ~100 HTTP requests b/c the api reporting shows me this, also simply watching the logs is telling enough that 900 jobs are not happening.
