Dylan Patel · Scaling Intelligence · 12 November 2024
“GPT four was trained with 24,000 GPUs roughly, and GPT five is on the order of a 100,000. And then they're trying to build this data center over the next few years. That's a million.”
Verbatim excerpt with a timestamp. The full recording is at the source; we link out and do not host it. Everything Dylan Patel is on record saying.