Alex Vandiver f9358d5330 queue: Switch batch interface to use the channel.consume iterator. ... This low-level interface allows consuming from a queue with timeouts. This can be used to either consume in batches (with an upper timeout), or one-at-a-time. This is notably more performant than calling `.get()` repeatedly (what json_drain_queue does under the hood), which is "*highly discouraged* as it is *very inefficient*"[1]. Before this change: ``` $ ./manage.py queue_rate --count 10000 --batch Purging queue... Enqueue rate: 11158 / sec Dequeue rate: 3075 / sec ``` After: ``` $ ./manage.py queue_rate --count 10000 --batch Purging queue... Enqueue rate: 11511 / sec Dequeue rate: 19938 / sec ``` [1] https://www.rabbitmq.com/consumers.html#fetching		2020-10-11 14:19:40 -07:00
..
__init__.py	…
queue_processors.py	queue: Switch batch interface to use the channel.consume iterator.	2020-10-11 14:19:40 -07:00