Patel reports Meta's 16,000 GPU cluster had failures every few hours while next-generation models train on 100,000 GPUs or more.
“And that was a measly 16,000 GPUs. Right? And when you look at like the next generation Llamas, the next generation GPTs, etcetera, they're training on a 100,000 GPUs or more.”
Patel reports five or six neo clouds have already gone out of business in just a few years.
“There's I believe five or six that have already gone out of business. It's only been a few years. Right. Right?”