Patel predicts OpenAI will have 300,000 to 500,000 GPU equivalent clusters next year across multiple sites.
“Next year, 300 to 500,000 depending on whether it's one side or many. Right? 300 to, like, 700,000, I think, is the upper bound of that.”
Patel says current models use 100,000 GPUs while next generation will require hundreds of thousands or millions.
“And next generation models that are trained on hundreds of thousands or even millions GPUs, right?”
Patel calculates networking for 65,000 GPU cluster costs $500 million total, or $55,000 per server.
“You know the total cost of that networking for that cluster is is close to $500,000,000. Right? It's $55,000 per server.”