Patel reports Amazon's CPU server installations have tripled year-on-year with no capacity remaining anywhere.
“So then you've just seen everyone run out of CPUs, Amazon's volumes on CPUs, of CPU servers they're installing have three x year on year, right, from this year versus last year.”
Patel reports Amazon's CPU server installations have tripled year-over-year with no spare capacity.
“Amazon's volumes on CPUs, of CPU servers they're installing have three x year on year, right, from this year versus last year. And so there's just no capacity anywhere”
Patel says Amazon's CPU server installations have tripled year-on-year, causing capacity shortages and GitHub instability.
“And so there's just no capacity anywhere and that's causing a lot of instability, not just in GitHub but probably other places too.”
Patel reveals OpenAI ported entire stack from x86 to ARM to access Amazon's CPU capacity for recent deal.
“A lot of the impetus for the recent Amazon and OpenAI deal was, yes, OpenAI wanted money, yes, they needed compute, but they also just went to Amazon and were like, give us your CPUs, And before, OpenAI's stack was pretty much only on x86 CPUs, but Amazon had tons of ARM CPUs and so they ported the whole thing,”
Patel says Google will make five to seven million TPU chips while Amazon targets three to five million.
“They're going to make something like five to 7,000,000 chips, right? Of their own TPUs. You look at Amazon, they're trying to make three to 5,000,000.”
Patel dubs Amazon's Trainium chip the Amazon Basics TPU due to less efficient but cost-effective design.
“Yeah. So so funnily enough, Amazon's chip is the Amazon I I call it the Amazon's basics TPU. Right?”
post Patel praises team's title 'I can make your Bedrock' for Amazon Bedrock revenue note
https://x.com/dylan522p/status/2085610927760511360
post Patel praises team's title 'I can make your Bedrock' for Amazon Bedrock revenue note
https://x.com/dylan522p/status/2085610927760511360