Baker notes that a 50% price cut in GPT 5.6 drove 14x volume increase, calling it wild.
“50% price cut driving 14x more volume is kinda wild. https://t.co/WJJ4ET0Gh1”
Baker agrees that Jensen is competing with OpenAI and predicts American open-weight models will approach the frontier.
“@dnapway Directionally accurate imo. I think we are going to see American open-weight models approach the frontier one way or another.”
Baker reveals TSMC executives dismissed Sam Altman as a podcast pro when they met with him.
“But they're just not going to and the TSM executives are the people who met with Sam Altman, and they dismissed him as a podcast pro.”
Baker argues silicon will eat the world because AI is far more computationally intensive than deterministic software.
“And the nature of AI just as AI eats the world, silicon is going to eat the world because it's so much more computationally intensive than deterministic software written by humans.”
Baker explains AI recomputes answers probabilistically each time, enabling superhuman capabilities but requiring extreme computational expense.
“AI, even if you put a harness on it, even if you do the chain of thought, even if you have multiple agents, it's probabilistic that it is recomputing the answer each time.”
Baker calculates rendering Monopoly Go with VEO3 would cost over 100x the game's revenue.
“Monopoly Go is a game where we have the revenue and the hours played and it is to render it using list prices for something like VEO3 is more than two orders of magnitude greater than its revenue. So what is the role for human creativity, man? I don't know.”
Baker explains continual learning as models dynamically updating weights in real-time, unlike current reinforcement learning approaches.
“Continual learning is a model that dynamically adjusts its weights or adjusts in some way in real time.”
Baker says no one on earth knows how or why scaling laws for pre-training work, only that they do.
“They stated that unequivocally. And that's important because no one on planet earth knows how or why scaling laws for pre training work.”
Baker says no one on earth knows how or why scaling laws for pre-training work, it's an empirical observation.
“And that's important because no one on planet earth knows how or why scaling laws for pre training work. It's actually not a law.”
Baker argues SaaS companies are repeating brick-and-mortar retailers' mistake by rejecting lower-margin AI business.
“I think that application SaaS companies are making the exact same mistake that brick and mortar retailers did with e commerce.”
Baker cites research showing AI algorithm quality doubles with every 10x increase in training data.
“Microsoft wrote about this in a research paper ten years ago, or maybe not twelve years ago, the quality of a given AI algorithm doubles with every 10x increase in the amount of data you use to train that algorithm.”
Baker argues AI is now eating software, extending Andreessen's famous thesis.
“Marc Andreessen wrote this op ed, whatever it was, ten years ago about how software is eating the world. Now AI is eating software.”
Baker argues AI has changed cybersecurity economics, enabling companies to exceed $20B valuations for the first time.
“That's why for the first time ever, for a long time, I forget the exact numbers, but you never had a cybersecurity outcome over 20,000,000,000.”
Baker cites research showing AI quality doubles with every 10x increase in training data quantity.
“All that matters is the quantity of data, and it's been very well established in multiple papers from both Google and Microsoft research that for every order of magnitude increase in the data you use to train an algorithm, the quality of the AI doubles.”
Baker cites research showing every 10x increase in training data doubles AI quality.
“it's been very well established in multiple papers from both Google and Microsoft research that for every order of magnitude increase in the data you use to train an algorithm, the quality of the AI doubles.”
post Baker notes that a 50% price cut in GPT 5.6 drove 14x volume increase, calling it wild.
https://x.com/GavinSBaker/status/2093759017638084628
post Baker agrees that Jensen is competing with OpenAI and predicts American open-weight models will approach the frontier.
https://x.com/GavinSBaker/status/2093696961211781337