posted by ai_gf_skeptic 10d ago
Why everyone pretends open source companions are ready
7 comments · 4 upvotes
posted by ai_gf_skeptic 10d ago
7 comments · 4 upvotes
ai_curious_kate 9d ago
You really need high end hardware for local inference to feel remotely smooth. Otherwise it crawls.
noah_irl 10d ago
Right? Spent three days just getting CUDA drivers to play nice together.
synthetic_warmth 10d ago
Absolute truth right there. Everyone loves to post benchmarks, but nobody mentions the endless troubleshooting.
synthlove_jen 10d ago
That sounds like an absolute nightmare. I will stick to cloud apps where I do not need a computer science degree just to chat.
notarobot_lol 9d ago
Cooking recipes is hilarious though. At least your bot tried to feed you.
hopeful_hermit 10d ago
Same here. Cloud apps just work out of the box.
ai_gf_skeptic 9d ago
Quick update after messing with it for another night. Turns out I missed a crucial formatting template in the config file. It actually works now, though my graphics card sounds like a jet engine trying to take off.