Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

Via r/LocalLlama
Wednesday, Oct 14, 2026 · 2:23PM
Summary

Performance on Model Prompt tokens master tok/s pr tok/s Change RTX PRO 6000 Blackwell Qwen3.5-35B-A3B-Q8_0 2048 13,653.58 16,459.56 +20.6% RTX PRO 6000 Blackwell Qwen3.5-35B-A3B-Q8_0 4096 14,090.26 16,595.47 +17.8% RTX PRO 6000 Blackwell Qwen3.8-27B-Q8_0 2048 4,470.39 4,757.20 +6.4% RTX PRO 6000 Bl

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories