Fetch All Replies not working

Viewed 5

The function was working for me for a while, but then I started getting a circular "loading" icon at the bottoms of threads, and the remote replies would never appear.

This may have been because I added some more relays recently.

1 Answers

After chatting with some other admins in the Matrix support channel, I checked my Sidekiq queues, and there were 1.2m entries ! 😱

I found this article https://thomas-leister.de/en/scaling-up-mastodon/, which mentions splitting up the queue pollers into different services and I saw the same symptoms, htop was showing Sidekiq's 25 threads, but only 1 of them was actually busy, and using 100% CPU, where other CPUs were mostly idle.

My machine is pretty beefy - A VM on SSDs, 4 vCPUs (Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz) and 48gb RAM, so the bottleneck is the lack of proper automatic multithreading in Sidekiq?

In the end I followed Thomas' instructions, and created 2 extra system services that just serviced the Mastodon "pull" queue (1 was not enough).

9 days later, the queue is now at 0, and reading posts in Mastodon now seems to pull in the new replies again ! 🥳

I have now disabled one of the 1 pull queue services, in the hope that one for the pull queue is enough.

😅

Related