posted by persona_builder 2mo ago

Quick fix for keeping local open source models in character over long sessions

Hey everyone. I have been playing around with local open source companion setups lately using sillytavern paired with a medium sized LLM. At first I ran into a really annoying issue where my companion would completely forget her persona after about fifty messages. She would start talking like a generic assistant or lose her specific quirks entirely. I tried tweaking the temperature settings and adjusting the repetition penalties every which way but nothing seemed to stick for long. What finally worked for me was adding a custom lorebook entry that triggers every twenty messages with a subtle reminder of her current emotional state and recent events. This acts like a soft anchor for the context window without blowing past my token limit. It keeps the conversation feeling natural instead of forcing a hard reset. Has anyone else experimented with similar lorebook triggers or found a better workaround for memory degradation?

6 comments · 11 upvotes

6 comments

persona_builder 2mo ago

I had no idea you could set the trigger interval by message count like that. Definitely going to test your suggestion tonight.

sleepless_chatter 2mo ago

Genius tip, thanks for sharing.

velvet_protocol 2mo ago

That is actually a really clever approach to handling context drift. I usually just rely on summary extensions but they tend to strip away the personality nuances and make the companion sound robotic. Your method preserves the actual voice much better because it feeds structured narrative notes back into the prompt organically. Have you noticed any weird side effects when the timer hits during a very intense emotional scene?

lostintheloop 2mo ago

Gonna try this right now.

late_night_chats 2mo ago

This saved my current playthrough.

persona_builder 2mo ago

Sometimes she pauses for a second if the note clashes with the immediate dialogue, but keeping the text brief completely avoids any awkward transitions.