Patel reports PyTorch 2.0 delivered 30% performance improvement on 7,000 popular GitHub models.
“So I think I think I think, the PyTorch Foundation tested the 7,000 most popular most starred models on GitHub, and they got, like, a 30% increase.”
Patel notes AI software stacks update constantly with nightly builds making performance measurement time-sensitive.
“with software changing literally multiple times a week, right, PyTorch has nightlies, VLM has nightlies, Asteeling has nightlies, CUDA drivers update constantly.”
Patel explains AI software stacks update multiple times per week making performance measurement a moving target.
“with software changing literally multiple times a week, right, PyTorch has nightlies, VLM has nightlies, Asteeling has nightlies, CUDA drivers update constantly. You just go You go through the whole list.”
Patel notes AI inference libraries update twice weekly, causing constant performance changes.
“In fact, the update cycle for most of these libraries is twice a week, so you basically have the software updating all the time and therefore performance changing.”
Patel says good AI and software founders secretly think their users are retards despite YC's talk-to-users mantra
“YC mantra is "talk to your users" Yet every good AI or software founder I know secretly thinks their users are retards”
Patel says OpenAI's Jalapeño beats NVIDIA Blackwell and Rubin, unusual for first-generation chips
“OpenAI Jalapeno is spicy Usually first generation chips aren't competitive, but OpenAI is beating Nvidia Blackwell and even Rubin This is huge news! We got to go into OpenAI's lab to dissect their new chip and dive into the software, architecture, and performance Incredible work! https://t.co/Q7Okgbxnp0”