Baker says no one on earth knows how or why scaling laws for pre-training work, it's an empirical observation.
“And that's important because no one on planet earth knows how or why scaling laws for pre training work. It's actually not a law.”
Baker claims tech founders believe creating AGI first is worth tens or hundreds of trillions.
“And if you create that first digital god, we can debate whether it's tens of trillions or hundreds of trillions in value, and we can debate whether or not that's ridiculous.”