Baker states only NVIDIA and Amazon Trainium have functioning switched scale-up networks for inference today.
“And the only two functioning switched scale up networks in the world today are the ones that power NVIDIA GPUs and Amazon's Trainiums.”
Baker argues Trainium is most underestimated because frontier mixture-of-expert models require switched scale-up networks for inference.
“And so Trainium is for sure the most underestimated, not only because of those design choices, but because the all of these frontier models are what are called mixture of expert models.”
Baker predicts Trainium will be to 2026 what TPUs were to 2025 as Trainium 3 ramps.
“Tranium, by far. Tranium is going to be to 2026, especially in the second half of this year when Tranium three really ramps, as TPUs were to twenty twenty five.”