Huang says traditional supercomputers take three years to plan plus one year to get working.
“A supercomputer that you would build would take normally three years to plan. Right. And then they deliver the equipment and it takes one year to get it all working.”
Huang says xAI built a 100,000 GPU supercomputer in nineteen days versus the normal four-year timeline.
“100,000 GPUs, that's easily the fastest supercomputer on the planet as one cluster. A supercomputer that you would build would take normally three years to plan.”