posted by deepfeel_dan 1h ago
Quick trick for keeping long term memory stable on local models
6 comments · 4 upvotes
posted by deepfeel_dan 1h ago
6 comments · 4 upvotes
testingthewaters just now
Totally agree about vector dbs. They are total overkill unless you are storing thousands of pages of lore.
deepfeel_dan just now
Just to clarify I meant the prompt injection script happens quietly in the system instructions rather than manually typing it every time.
synthetic_warmth just now
I tried a vector database setup last month and honestly it was way too complicated for my simple laptop. Your summary text file idea sounds much easier to manage.
nightly_convo just now
This is honestly super smart and I am definitely going to test it out tonight. Memory loss gets so frustrating when you are trying to build a real narrative arc.
deepfeel_dan just now
Let me know how it goes for you. It took a couple tries to get the summary prompt tuned right.
ai_curious_kate just now
My experience has been totally different since I just use cloud apps where the company handles memory on their end. Still cool to see how the local hosting community solves these issues though.