xAI's next Grok 4.6 model will have 2 trillion parameters
Elon Musk revealed that xAI's next-generation Grok 4.6 model will have 2 trillion parameters, with initial training expected to complete next week. It will outperform the current 1.5 trillion parameter version while maintaining similar inference speed and token efficiency.
Musk guesses Grok 4.6 might beat Kimi 3 from Moonshot AI. xAI hasn't announced an official release date or full technical details. Previously, the Grok base model V9-Medium (1.5T parameters) finished training and is seen as the base for Grok 4.5.
Parameter count is one measure of model capability, but actual performance also depends on training data quality, methods, inference architecture, and more. xAI is increasing computing resources, using the Colossus cluster with around 200,000 GPUs for Grok 4.
Comments
Loading comments…