Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Given how common RTX 3090 use is for LLMs, why don't we see more INT8 W8A8 models ?

Via r/LocalLlama
Tuesday, Sep 1, 2026 · 10:27PM
Summary

Based on https://huggingface.co/hardware, the RTX 3090 is the second most used GPU by LLM enthusiasts. Because RTX 3090 has native INT8 tensors cores, it can provide better performance with INT8 W8A8. However people seems to default to FP8 or smaller quants anyway. I suppose I am missing information

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories