Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

If your t/s is low enough, you can see speculative decoding with your own eyes

Via r/LocalLlama
Saturday, Aug 29, 2026 · 10:51AM
Summary

The other day I was trying out a distillation of DS4 Pro, and it came with MTP. It was slow as hell on my hardware, barely 2-3 t/s, BUT the speed got bumps every once in a while, and I noticed it was in moments like: United States of America First law of thermodynamics The enshittification of the in

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories