Patel predicts another 50-100% Blackwell performance improvement from software optimization of standard libraries.
“I see another 50% to doubling in the cards, just from the fact that there is so much low hanging fruit or performance left on the table if you are using the general open libraries, right? Whether it's cuDNN, VLM, SGLANG, all these other things,”
Patel predicts general-purpose Blackwell users could see another performance doubling over the next year from software improvements.
“for the general purpose user, yeah, you're going to have another doubling of performance potentially on the tables over the next year.”
Patel reports AMD performance improved dramatically over two months, similar to NVIDIA Blackwell's software optimization trajectory.
“Over two months, the performance of AMD dramatically improved because they went from, hey, software problems are always a thing, to over a two month period, they've dramatically improved.”
Patel says InferenceMax runs daily benchmarks to track hardware performance improvements as software optimizes.
“And why this is important is you can see the progress of hardware over time as the software stack gets more optimized.”