Elon Musk informed traders this month that his startup xAI is planning to construct a supercomputer by the autumn of 2025 that might energy a future, smarter iteration of its Grok chatbot, The Information reviews. This supercomputer, which Musk reportedly known as a “gigafactory of compute,” would depend on tens of hundreds of NVIDIA H100 GPUs and value billions of {dollars} to construct. Musk has previously said the third model of Grok would require at the least 100,000 of the chips — a fivefold enhance over the 20,000 GPUs mentioned to be in use for coaching Grok 2.0.
In accordance with The Info, Musk additionally informed traders within the presentation that the deliberate GPU cluster could be at the least 4 instances the scale of something used right now by xAI opponents. Grok is at present in model 1.5, which was launched in April, and is now touted to process visual information like pictures and diagrams in addition to textual content. X earlier this month began rolling out AI-generated news summaries powered by Grok for premium customers.