The Minutes of Dylan Patel on gpu clusters https://minutesof.com/dylan-patel/on/gpu-clusters/ Everything Dylan Patel has said on gpu clusters: 2 verbatim quotes between October 2024 and March 2025, each with a timestamp and a link to the recording… en Sun, 30 Aug 2026 16:22:23 +0000 Patel says current models use 100,000 GPUs while next generation will require hundreds of thousands or million https://minutesof.com/q/561bd369-2c88-4ea1-8fa4-3d02389be50d/ https://minutesof.com/q/561bd369-2c88-4ea1-8fa4-3d02389be50d/ “And next generation models that are trained on hundreds of thousands or even millions GPUs, right?” — Special Competitive Studies Project Thu, 13 Mar 2025 16:42:15 +0000 gpu clusters Patel predicts OpenAI will have 300,000 to 500,000 GPU equivalent clusters next year across multiple sites. https://minutesof.com/q/5492cf90-3909-4724-b977-ca95780911b3/ https://minutesof.com/q/5492cf90-3909-4724-b977-ca95780911b3/ “Next year, 300 to 500,000 depending on whether it's one side or many. Right? 300 to, like, 700,000, I think, is the upper bound of that.” — Dwarkesh Patel Wed, 02 Oct 2024 14:59:36 +0000 gpu clusters