Patel says OpenAI and Meta run NVIDIA GPUs at lower power to fit 10% more chips despite worse TCO.
“Even though it's terrible on a TCO basis, they were able to get, you know, 10% more GPUs in, and it's great. And Meta has done similar.”
Patel reports new Trump tax bill allows year-one GPU depreciation, worth $10 billion annually to Meta alone.
“the new the new Trump, you know, tax bill institutes something really incredible, which is that you can depreciate all of the GPU cluster cost in year one, which we put out, like, a note about how, like, the tax implications to, like, meta are, like, $10,000,000,000 a year. And across each of the major hyperscalers, it's, like, massive.”
Patel explains how MOE routing works and how some of Meta's experts weren't being used at all.
“And and each expert learns its own independent things and it's like really not something observable by people. But what you can see is tokens when which experts do they route to?”
Patel identifies a major shift in Zuckerberg's strategy toward pursuing superintelligence recently.
“He was chasing like AI is good and great, but like AGI is not a thing that is gonna happen soon. So sort of this is a big shift in strategy”
Patel directly contradicts Sam Altman's claim that no top researchers have left OpenAI for Meta.
“As far as Sam is saying that no top researchers have gone, I don't believe that's accurate. I initially the top researchers definitely did say no, the best researchers, the best people.”
Patel claims Meta offered over $1 billion to one OpenAI researcher as retention or acquisition offer.
“And you said $100,000,000 I've heard a number for someone over 1,000,000,000 actually, for one person at OpenAI. But anyways, you know, it's a ridiculous amount of money,”
Patel reports hearing Meta offered over one billion dollars to a single OpenAI researcher.
“I've heard a number for someone over 1,000,000,000 actually, for one person at OpenAI. But anyways, you know, it's a ridiculous amount of money,”
Unsupervised Learning: With Jacob Effron
“Meta, they accidentally open sourced this code. It's literally called PowerPlant node blowup. It's a flag.”