load testing

[elimelt]

Added a connection pooler since I was hitting the connection limit resulting in dropped requests. Things were working nicely, until the thread safety of pika came into play. Thus, I added add_callback_threadsafe in, as well as a few more changes to properly work with the blocking connection in a multithreaded environment.

With very spammy users (req every .1-.5 sec), we can handle a pretty high throughput without dropping any requests now. For reference, I wasn't able to get above 30 RPS beforehand

With less spammy users (req every 1-5 sec), but more overall, we start to run into issues

[Copilot]

Copilot reviewed 6 out of 11 changed files in this pull request and generated 1 comment.

Files not reviewed (5)

• Dockerfile: Language not supported
• Dockerfile.manager: Language not supported
• requirements-dev.txt: Language not supported
• requirements-rabbit.txt: Language not supported
• requirements-server.txt: Language not supported

Comments suppressed due to low confidence (1)

server/mq/core/producer.py:159

• Accessing the private _loop attribute of the connection may lead to maintainability issues; consider storing the event loop in a dedicated public instance variable for improved clarity.

asyncio.run_coroutine_threadsafe(self._set_event(publish_event), self._connection._loop)

[github-actions]

Marking as stale since there has been no activity for 30 days. Will close in 7 days if no activity.

[github-actions]

Marking as stale since there has been no activity for 30 days. Will close in 7 days if no activity.