Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

New in llama.cpp: Decision Models

Via r/LocalLlama
Friday, Oct 2, 2026 · 2:25PM
Summary

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Related in Community
Strata on a power limited 5090 and 96GB of DDR5-6400 is cranking out 150-200 tok/s decode and 5-6k prefill! Qwen3.8-Flash-Next at IQ3_S, CTX at 128k tokens (8-bit).
r/LocalLlama
AxiomicLabs' new benchmark, Tiny Theory of Mind, meant to gauge small models' theory of mind capabilities, has made it to the front page of Hugging Face's Datasets
r/LocalLlama
Help me with a better hardware setup for Local LLm
r/LocalLlama
Tuned/abliterated Qwen3.8-27b into a 24gb card 262k guff using the newest unreleased version of LexiPanel. It's fast with reliable draft acceptance. Made for 7900xtx but should work on whatever 24gb card with this setup and headless. Doesn't get dumber while coding like most of the other fine-tunes.
r/LocalLlama
Two 96 GB Ascend cards crun Qwen3.8-flash-next hardware notes, vLLM work, benchmarks, and what is next
r/LocalLlama
More from Best AI News
Pope Leo XIV is not a fan of AI-generated art
TechCrunch AI · Industry & Money
Open-sourcing AstaBrief, the fast report-generation model in Asta
Hugging Face Blog · Models & Research
The latest AI news we announced in September 2026
Google AI · Models & Research
TechCrunch Disrupt 2026: Blackstone’s Jas Khaira on building the next generation of AI giants
TechCrunch AI · Industry & Money
Back to all stories