Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

I re-trained the DFlash 2 drafter for Ternary Bonsai 2 27B: 2.2x on an L4 (3.2x on code edits with ngram lookup), 1.5x on a Mac, 1.2x in Chrome

Via r/LocalLlama
Wednesday, Oct 7, 2026 · 8:13AM
Summary

PrismML's Ternary Bonsai 2 27B fits a 24 GB card or Mac, but decodes at ~30 tok/s on an L4 and ~21 on an M4 Pro. z-lab's DFlash 2 drafter was trained on bf16 Qwen3.8-27B, so it guesses worse on the ternary model. I fine-tuned it on 1.5M tokens of Bonsai 2's own greedy output. Drafter (safetensors +

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories