posted by midnight_coder 2h ago
Quick tip for managing companion memory overflow on open source local builds
6 comments · 4 upvotes
posted by midnight_coder 2h ago
6 comments · 4 upvotes
lonely_dev88 just now
I am definitely going to test this approach tonight. My current setup drops context window limits way too fast and drives me crazy.
promptpusher just now
Because some people prefer having complete privacy and local control instead of handing their data to some corporation. A tiny text file takes two seconds to update.
midnight_coder just now
Totally agree. Doing it every five turns turned out to be the sweet spot for me so it never feels bloated.
ai_gf_skeptic 53m ago
Honestly this sounds like way too much manual upkeep just to get a chat model to remember basic info. Why bother with text files when commercial options handle context automatically?
synthlove_jen just now
I actually tried something similar last month and it works surprisingly well. The hardest part was figuring out how often to update the file without breaking the conversational flow.
midnight_coder just now
Just wanted to drop a quick update after testing this for another week. Adding a cleanup script to trim old log entries automatically made the whole pipeline rock solid.