Patel reports Amazon's CPU server installations have tripled year-on-year with no capacity remaining anywhere.
“So then you've just seen everyone run out of CPUs, Amazon's volumes on CPUs, of CPU servers they're installing have three x year on year, right, from this year versus last year.”
Patel reveals OpenAI ported entire stack from x86 to ARM to access Amazon's CPU capacity for recent deal.
“A lot of the impetus for the recent Amazon and OpenAI deal was, yes, OpenAI wanted money, yes, they needed compute, but they also just went to Amazon and were like, give us your CPUs, And before, OpenAI's stack was pretty much only on x86 CPUs, but Amazon had tons of ARM CPUs and so they ported the whole thing,”