The Minutes

Dylan Patel on

benchmarks

3 entries, 22 Jun 2025 to 21 Nov 2025

On the recordsourced and dated, oldest first

    1. spoken

      Patel reports AI models improved from below 4% to 70% accuracy on Frontier Math in six months across multiple companies.

      “frontier math. And the models went from sub 4% to 70% in six months. Right? And this is from not just OpenAI, but also Anthropic and Google and DeepSeek.”

      22 Jun 2025 · Going Direct · 12:46 · source · permalink
    2. spoken

      Patel reports AI models improved from under 4% to 70% on Frontier Math in six months.

      “Like, can't do all the math, all the problems in frontier math. And the models went from sub 4% to 70% in six months.”

      22 Jun 2025 · Going Direct · 12:41 · source · permalink
    3. spoken

      Patel says neo clouds that ranked highest on ClusterMax benchmarks booked significantly more revenue.

      “And since then we just released the second version, but in the middle, the clouds that ranked the highest actually ended up booking way, way, way more revenue.”

      21 Nov 2025 · Clockwork · 11:30 · source · permalink

Dylan Patel ontheir other subjects

Everything Dylan Patel is on record saying · RSS