Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

How do you deal with long-context sessions after restarting llama.cpp?

Via r/LocalLlama
Thursday, Aug 20, 2026 ยท 4:04AM
Summary

I run local models on a 128GB Strix Halo and restart llama.cpp fairly often while testing builds, backends and model parameters. The annoying part is long-running agent sessions. Hermes/OpenCode sessions can easily reach 50k-100k context, and after every restart the same context has to be prefetched

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories