Patel explains Inference X was created because vendor-claimed performance is unattainable with any available framework.
“There's no way to get the performance that vendors like to claim. And so our whole thing there was, well, how do we actually have a benchmark that represents what people actually get on performance?”
Patel asserts vendors cannot achieve their advertised flops specifications in real-world conditions.
“There there is no functional way to get anywhere close to their flops that they advertise.”