Patel says GPT-5 will be first model to massively scale both pre-training and post-training simultaneously.
“Right? And this would be the first time we see a model that was was a step up in both at the same time.”
Patel explains GPT-5 will combine massive pre-training and post-training scale for the first time.
“Along the way, another team at OpenAI made the big breakthrough of reasoning. Right? Strawberry training. And they released o one, and then they released o three.”
Patel reports GPT-5 expected within three to six months with insider knowledge suggesting even sooner release.
“OpenAI says is coming. They say it's coming, you know, this year, hopefully, the next three to six months, maybe sooner. I've heard sooner, but, you know, we'll we'll see.”
Patel reports GPT-5 is expected in three to six months, possibly sooner based on his sources.
“They say it's coming, you know, this year, hopefully, the next three to six months, maybe sooner. I've heard sooner, but, you know, we'll we'll see.”
Patel says GPT-5 will combine massive pre-training like GPT-4.5 with massive post-training like o1 and o3.
“GPT five, as Sam calls it, is is gonna be a model that has huge pre training scale, right, like GPT 4.5, but also huge post training scale like o one and o three and continuing to scale that up.”
Patel reports that OpenAI's Orion training run did not improve enough over GPT-4.5 to qualify as GPT-5.
“There were hopes that Orion could be used for for GPT five, but its improvement was, like, not enough to be, like, really a GPT five.”
Patel reveals GPT 4.5's Orion training run fell short of GPT-5 level using only classical pre-training methods.
“Furthermore, it was trained on the classical method, which is, like, which is a ton of pre training and then some reinforcement learning with human feedback”
Patel reveals OpenAI's major GPT-5 training cluster is in Arizona and runs GPUs at lower power to fit more chips.
“And in some deployments, you'll be completely limited on power. And so there's many deployments. For example, OpenAI's major training cluster in Arizona that did GPT-five and such.”
Patel reports Microsoft aims to 10x training capacity every 18-24 months, representing a 10x increase from GPT-5 training.
“We try to 10x the training capacity every eighteen to twenty four months. And so this would be effectively a 10x increase. 10x from what GPD five was trained with.”
Patel says GPT-5 pre-training uses fewer than 100,000 GPUs despite OpenAI having over 500,000 GPUs for R&D.
“Right? Like like, g p d five, not even a 100 k GPU pre training scale.”