Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Warning: llama.cpp --lazy-mode default changed to auto - large tables may stay on disk

Via r/LocalLlama
Monday, Aug 31, 2026 · 8:57PM
Summary

With b10726, the default --lazy-mode change keeps the 51B-parameter PLE n-gram embedding table of Qwen 3.8 Flash Next on disk: it is mmap'd and its rows are read on demand during inference, even with --load-mode none. It is no longer loaded into RAM unless --lazy-mode off is passed. This change resu

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories