On the record about

scaling

6 people · 22 quotes · 11 Dec 2012 to 12 May 2026

Who is on this subjectordered by the date of their first quote here

4 of 6 lanes rest on fewer than 5 quotes and are marked thin. Offsets are days from the middle first-quote date, 23 Jun 2020 — a date, and nothing else. It is not a claim about who reached a view first.

The chronologysourced and dated, oldest first

    1. Bill Gurley

      Gurley argues that while starting is cheap, scaling a company requires both capital and expertise.

      “And what I think has come out of it is that you may be able to start a company for nothing but if you want to scale a company you will need capital and you'll need expertise to scale it to the next level.”

      11 Dec 2012 · GigaOm · 1:03 · source · permalink
    2. Bill Gurley

      Gurley argues scaling requires capital and expertise even if starting a company is cheap.

      “I think has come out of it is that you may be able to start a company for nothing but if you want to scale a company you will need capital and you'll need expertise to scale it to the next level. Not every single player, Benioff who got it up without venture”

      11 Dec 2012 · GigaOm · 1:04 · source · permalink
    1. Bill Gurley

      Gurley says marketplace success requires doing unscalable things early, which frustrates most business school-trained entrepreneurs.

      “And if you took 90% of the entrepreneurs that have been to business school and understand scaling, it drives them nuts.”

      2 Jul 2019 · Invest Like the Best · 10:14 · source · permalink
    2. Gavin Baker

      Baker cites research showing AI quality doubles with every 10x increase in training data quantity.

      “All that matters is the quantity of data, and it's been very well established in multiple papers from both Google and Microsoft research that for every order of magnitude increase in the data you use to train an algorithm, the quality of the AI doubles.”

      26 Nov 2019 · Invest Like the Best · 39:15 · source · permalink
    1. Brad Gerstner

      Gerstner argues AWS, GCP and Azure enable software companies to scale faster and more capital efficiently than before.

      “But the fact of the matter is because of AWS, GCP and Azure, software companies are scaling faster and in a more capital efficient way”

      23 Jun 2020 · Invest Like the Best · 55:24 · source · permalink
    1. David Friedberg

      Friedberg says Climate Corp's average data use increased 40x every year for seven consecutive years.

      “In the seven years we ran Climate Corp, by the way, we did a study that our average data use per year increased by 40x every year for seven years.”

      2 Oct 2023 · AgFunder · 38:18 · source · permalink
    2. Dylan Patel

      Patel predicts open source will match GPT-4 but frontier models will continue advancing beyond it.

      “Open source will match GPT-four, but then it's like, what about GPT-four Vision? Or what about five and six and all these kind of stuff?”

      5 Dec 2023 · Latent Space · 34:27 · source · permalink
    3. Dylan Patel

      Patel identifies distributed training across data centers with lower bandwidth as a key unsolved problem that would unlock massive scaling.

      “Everything that we've seen so far is that large scale training has to happen in an individual data center with very high speed networking.”

      5 Dec 2023 · Latent Space · 1:06:07 · source · permalink
    1. Dylan Patel

      Patel says GPT-4 used 24,000 GPUs, GPT-5 uses 100,000, and Microsoft is building toward a million GPUs.

      “GPT four was trained with 24,000 GPUs roughly, and GPT five is on the order of a 100,000. And then they're trying to build this data center over the next few years. That's a million.”

      12 Nov 2024 · Scaling Intelligence · 9:51 · source · permalink
    2. Dylan Patel

      Patel calculates that multi-trillion parameter models require transmitting 40 terabytes of data every two seconds during training.

      “They're doing it for like multi trillion. Right? So let's call it 10,000,000,000,000 parameters, four bytes parameter, that's 40 terabytes of data you need to transmit in two seconds.”

      12 Nov 2024 · Scaling Intelligence · 23:38 · source · permalink
    3. Bill Gurley

      Gurley notes AI leaders previously implied linear scaling gains but current reality differs from that impression.

      “They had left that impression. And so we get to this place as you described it, it's not quite like that.”

      23 Dec 2024 · BG2 Pod · 32:29 · source · permalink
    4. “You know, I can go from 10,000,000 to 100,000,000 to billion to $10,000,000,000 on reasoning in such a quick succession.”

      23 Dec 2024 · Bg2 Pod · 52:55 · source · permalink
    1. Dylan Patel

      Patel calculates next-generation clusters deliver 15x more compute through five times more GPUs and 3x performance gains.

      “So you got you have five x the GPUs, and you have three x the performance per GPU roughly. So then you're at, like, 15 x more compute.”

      21 Jan 2025 · Unsupervised Learning: With Jacob Effron · 26:01 · source · permalink
    2. “Or or that's what it looks like based on or, you know, one gigawatt in twenty twenty six ish. And Meta's Meta's, like, trying to do, like, two gigawatts by early to mid twenty seven.”

      21 Jan 2025 · Unsupervised Learning: With Jacob Effron · 39:00 · source · permalink
    3. Dylan Patel

      Patel says current models use 100,000 GPUs while next generation will require hundreds of thousands or millions.

      “And next generation models that are trained on hundreds of thousands or even millions GPUs, right?”

      13 Mar 2025 · Special Competitive Studies Project · 19:49 · source · permalink
    4. Dylan Patel

      Patel argues that efficiency gains alone without capability increases cannot justify massive AI infrastructure investments.

      “That would not pay for all of these build outs. Right? AI is useful today, but it's not capable of doing a lot of things.”

      23 Apr 2025 · Alex Kantrowitz · 33:53 · source · permalink
    5. Dylan Patel

      Patel states $10 billion data centers target automated software engineering, not chat models.

      “So no one is trying to make with these $10,000,000,000 data centers, they're not trying to make chat models. Right?”

      23 Apr 2025 · Alex Kantrowitz · 34:22 · source · permalink
    6. Brad Gerstner

      Gerstner argues AI is scaling faster than the Internet did, citing his investments in Google and Meta.

      “ChatGPT became the verb and I would argue, maybe just So, you know, if we go to this slide right here, You know, AI is scaling way faster than the Internet did.”

      10 Sep 2025 · Khosla Ventures · 11:34 · source · permalink
    7. Dylan Patel

      Patel reports Microsoft aims to 10x training capacity every 18-24 months, representing a 10x increase from GPT-5 training.

      “We try to 10x the training capacity every eighteen to twenty four months. And so this would be effectively a 10x increase. 10x from what GPD five was trained with.”

      12 Nov 2025 · Dwarkesh Patel · 1:19 · source · permalink
    1. Jensen Huang

      Huang contrasts Moore's law (100x per decade) with current AI acceleration (1 million times per decade).

      “Remember, Moore's law was two times every 18, 10 times every five years, a 100 times every ten. Okay? But where are we now? A million times every ten years.”

      4 Feb 2026 · Cisco · 18:48 · source · permalink
    2. Dylan Patel

      Patel estimates Anthropic needs to reach well above five gigawatts of compute capacity by year-end to support revenue growth.

      “Anthropic needs to get to well above five gigawatts by the end of this year, and it's gonna be really tough for them to get there, but it's possible.”

      13 Mar 2026 · Dwarkesh Patel · 3:56 · source · permalink
    3. David Friedberg

      Friedberg describes Koch Industries' 9,000X scaling as algorithmic compounding through continuous cash reinvestment.

      “The success at Coke Industries is built on an algorithm, your principles, and you've been able to adapt that algorithm and as a result scale your business, generate cash, reinvest that cash, generate more cash, reinvest that cash and so on. And you've scaled 9,000 X. You've built a compounding advantage in your business.”

      12 May 2026 · All-In Podcast · 1:25:44 · source · permalink

Where they overlapsame programme, same subject

Every subject on the record · RSS