Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Is there still strong interest in a dense 9b model?

Via r/LocalLlama
Sunday, Sep 13, 2026 · 6:08AM
Summary

I have a full model, it's ready to train. It's ~9b parameters. 9.4b to be more exact. That includes a 1/2/3 Engram table, Moonshot's AttnRes modeling, and RoPE / NoPE layering at 3:1 as more or less validated by most major labs. It uses the Llama 3 series tokenizer and LM Head as an initial start. T

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories