posted by lonely_dev88 14h ago
Quick workaround for infinite loading loops in local SillyTavern setups
Hey everyone. I have been tinkering with open source frontends lately and kept running into this super annoying bug where my companion chats would just get stuck on a permanent typing bubble when using a specific backend wrapper. I tried clearing browser cache and reinstalling node modules completely from scratch, but the freezing kept happening right in the middle of long roleplay sessions. What finally fixed it for me was diving into the advanced connection settings and lowering the concurrency limit down from four to one. It seems like the local server was getting overwhelmed trying to process token streams simultaneously during heavy output generation. Once I forced it to handle requests sequentially, the stability improved massively and I have not had a single freeze all weekend. If anyone else is hitting this weird bottleneck with their local rigs, definitely check your connection parameters. Has anyone found a different fix for this particular issue or is this just happening on my end?
6 comments · 4 upvotes