Throttling an AMQP Consumer Using RabbitMQ

Posted by Nicholas on Stack Overflow See other posts from Stack Overflow or by Nicholas
Published on 2013-06-24T16:18:57Z Indexed on 2013/06/24 16:21 UTC
Read the original article Hit count: 580

Filed under:

rabbitmq

|

amqp

I'm using AMQP in a reliability pattern and my use-case is to put messages in a queue, then consume them and insert the information into a web service. My web service is slow, and my queue can have many, many messages and I would like to ensure that the consumer doesn't kill my database.

Is there a build-in way to perform throttling in RabbitMQ, either time-based(only X messages per minute/second/hour) or some other mechanism?

© Stack Overflow or respective owner

Related posts about rabbitmq

Unable to start rabbitmq-server on Ubuntu 12.04

as seen on Server Fault - Search for 'Server Fault'
I try to install rabbitmq-server on ubuntu-server 12.04 but failed. Then I add the apt source list following the guide in http://www.rabbitmq.com/install-debian.html But reinstall still have the same error as following: $ sudo aptitude install rabbitmq-server ... Setting up rabbitmq-server (2.8… >>> More
Veewee, Vagrant, Puppet, Erlang and RabbitMQ

as seen on Server Fault - Search for 'Server Fault'
I am kinda stuck with a problem I am trying to wrap my head around for days now. Here is what I am doing: By using Veewee, I am creating a VirtualBox image and then I create a Vagrant box from it. See here, here Finally I run puppet from Vagrant to install RabbitMQ, see here. Veewee, Vagrant… >>> More
RabbitMQ and persistence (blocking writes?)

as seen on Server Fault - Search for 'Server Fault'
I want to create a RabbitMQ server on a virtual machine (VMware) to be used in production. It will contain persistent queues. I'm wondering if it is a bad idea to store the server on a NAS that's accessed over NFS. Basically my questions are: Will RabbitMQ's writes be blocking? Will the entire… >>> More
php amqp error while running make

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I'm trying to install php amqp according to this answer http://stackoverflow.com/a/9997263/2271028 but at the make command i see following: /bin/bash /var/www/rabbitmq-c/amqp-1.4.0/libtool --mode=compile cc -I. -I/var/www/rabbitmq-c/amqp-1.4.0 -DPHP_ATOM_INC -I/var/www/rabbitmq-c/amqp-1.4.0/include… >>> More
Does RabbitMq do round-robin from the exchange to the queues

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am currently evaluating message queue systems and RabbitMq seems like a good candidate, so I'm digging a little more into it. To give a little context I'm looking to have something like one exchange load balancing the message publishing to multiple queues. I don't want to replicate the messages… >>> More

Related posts about amqp

php amqp error while running make

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I'm trying to install php amqp according to this answer http://stackoverflow.com/a/9997263/2271028 but at the make command i see following: /bin/bash /var/www/rabbitmq-c/amqp-1.4.0/libtool --mode=compile cc -I. -I/var/www/rabbitmq-c/amqp-1.4.0 -DPHP_ATOM_INC -I/var/www/rabbitmq-c/amqp-1.4.0/include… >>> More
Flushing a queue using AMQP, Rabbit, and Ruby

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm developing a system in Ruby that is going to make use of RabbitMQ to send messages to a queue as it does some work. I am using: Ruby 1.9.1 Stable RabbitMQ 1.7.2 AMQP gem v0.6.7 (http://github.com/tmm1/amqp) Most of the examples I have seen on this gem have their publish calls in an EM.add_periodic_timer… >>> More
AMQP 'connection.open' reserved parameters

as seen on Stack Overflow - Search for 'Stack Overflow'
I am writing an AMQP Client Library in Erlang. For the 'connection.open' method, there are 2 reserved parameters "documented" in AMQP 0.9.1 out of a total of 3. When I send the method in question without the "reserved parameters", I get "unable to decode method" in the error log. What should I… >>> More
erlang AMQP client library

as seen on Stack Overflow - Search for 'Stack Overflow'
Is there an Erlang AMQP client library that isn't tied to the hip with RabbitMQ ? I know about http://hg.rabbitmq.com/rabbitmq-erlang-client/ but I would like something more decoupled... pain when it comes to packaging this stuff for a Debian repository, installation etc... >>> More
Posting messages in two RabbitMQ queue, instead of one (using py-amqp)

as seen on Stack Overflow - Search for 'Stack Overflow'
I've got this strange problem using py-amqp and the Flopsy module. I have written a publisher that sends messages to a RabbitMQ server, and I wanted to be able to send it to a specified queue. On the Flopsy module that is not possible, so I tweaked it adding a parameter and a line to declare the queue… >>> More