Patel predicts another 50-100% Blackwell performance improvement from software optimization of standard libraries.
“I see another 50% to doubling in the cards, just from the fact that there is so much low hanging fruit or performance left on the table if you are using the general open libraries, right? Whether it's cuDNN, VLM, SGLANG, all these other things,”
Patel predicts general-purpose Blackwell users could see another performance doubling over the next year from software improvements.
“for the general purpose user, yeah, you're going to have another doubling of performance potentially on the tables over the next year.”
Patel reports PyTorch 2.0 delivered 30% performance improvement on 7,000 popular GitHub models.
“So I think I think I think, the PyTorch Foundation tested the 7,000 most popular most starred models on GitHub, and they got, like, a 30% increase.”