posted by lonely_dev88 14h ago

Quick workaround for infinite loading loops in local SillyTavern setups

Hey everyone. I have been tinkering with open source frontends lately and kept running into this super annoying bug where my companion chats would just get stuck on a permanent typing bubble when using a specific backend wrapper. I tried clearing browser cache and reinstalling node modules completely from scratch, but the freezing kept happening right in the middle of long roleplay sessions. What finally fixed it for me was diving into the advanced connection settings and lowering the concurrency limit down from four to one. It seems like the local server was getting overwhelmed trying to process token streams simultaneously during heavy output generation. Once I forced it to handle requests sequentially, the stability improved massively and I have not had a single freeze all weekend. If anyone else is hitting this weird bottleneck with their local rigs, definitely check your connection parameters. Has anyone found a different fix for this particular issue or is this just happening on my end?

6 comments · 4 upvotes

6 comments

chai_addict 11h ago

Lol I just restart my computer until it works. Good to know there is an actual method.

ex_cai_user 12h ago

Lifesaver. I was losing my mind trying to figure out why my chats kept dying.

virtual_hearts 12h ago

Honestly open source is amazing once you get past all the configuration hurdles.

lonely_dev88 just now

Just remembered to mention that you should also check your node version. Updating to the latest LTS release made everything run way smoother too.

saturday_sad just now

I had this happen last month and ended up completely wiping my preset folder. Wish I saw this post sooner.

lonely_dev88 10h ago

Glad it helped you out. It drove me crazy for three days straight.