Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Reminder: try probabilistic MTP if you missed it. Decode +14% on prose

Via r/LocalLlama
Sunday, Oct 11, 2026 · 9:20AM
Summary

https://github.com/ggml-org/llama.cpp/pull/27694 Now merged. Update your llama if you haven't done so yet. Optimal draft-n-max / draft-p-min seem to be in line with greedy sampling. Main gain seems to be on prose generation. Tests above ran with thinking off, ngram-mod off.

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories