Patel says current models use 100,000 GPUs while next generation will require hundreds of thousands or millions.
“And next generation models that are trained on hundreds of thousands or even millions GPUs, right?”
Patel predicts OpenAI will have 300,000 to 500,000 GPU equivalent clusters next year across multiple sites.
“Next year, 300 to 500,000 depending on whether it's one side or many. Right? 300 to, like, 700,000, I think, is the upper bound of that.”