With 560B total parameters, 25B active parameters per token, and a 1M-token context window, wait what? 3.0 was just 127B
