1. What did you do this week?
Last week I was splitting the pull request into two parts: One part that goes into the Scrapy core, and one part that goes into a new library scrapy-external-queues. I also refactored the payload generation code in scrapy-bench to not duplicate code and use random payloads instead of fixed ones.
2. What is coming up next?
The new project scrapy-external-queues needs a bit of cleanup. It also lacks tooling like flake8, tox or Travis. Additionally, I want to add support for RabbitMQ as a second message queue backend.
3. Did you get stuck anywhere?