Patel argues training costs are irrelevant, noting GPT-4 used 20,000 A100s.
“training costs are irrelevant. Right? Like, GPT four, right, like, 20,000 a one hundreds, that's that's like, I know it sounds like a lot of money.”
Patel says GPT-4 cost hundreds of millions to train but generates billions in revenue for Microsoft.
“Hundreds of millions of dollars to train g p d four. Yep. And it's generating billions of dollars of revenue. So when you say, like, hey.”
Patel says many entities can afford 100x DeepSeek's $5 million cost, ensuring open models will continue emerging.
“DeepSeek has this shocking $5,000,000 number. Think about how many entities in the world can afford a 100 times that to have the best open source model that people use in the world.”