Patel calculates that without Supermicro's liquid cooling solution, servers would consume 30% more power.
“So that's why Shibbol Micro dedicated deep cooling so aggressively. And if the liquid cooling solution from Super Micro didn't exist, then those servers would be consuming 30% more power.”
Patel states Supermicro's liquid cooling reduces Hopper server power from 10 kilowatts to 7-8 kilowatts versus air-cooled competitors.
“Everyone else's hopper servers h 100 air cooled. And so each server consumes, you know, 10 kilowatts almost. Right?”
Patel quantifies GB200 as 10x more power efficient than H200 at certain interactivity rates.
“at certain interactivity rates, I. E. Tokens per second per user, it's 10x more efficient per watt, right, compared to H200.”
Patel quantifies that 20% performance per watt advantage translates to only 4% TCO difference on NVIDIA deployments.
“But capital is far more of a limiting factor. Because if you have enough power, a 20% difference in performance per watt only ends up being a 4% difference in TCO.”
Patel calculates 20% power efficiency difference translates to only 4% TCO difference on NVIDIA deployments.
“Because if you have enough power, a 20% difference in performance per watt only ends up being a 4% difference in TCO.”