The Minutes

Dylan Patel on

reliability

5 entries, 12 Nov 2024 to 13 Mar 2026

On the recordsourced and dated, oldest first

    1. spoken

      Patel claims four to five percent of NVIDIA GPUs fail during initial burn-in testing within two weeks.

      “Buy a good chip from NVIDIA, and then it ends up failing like constantly, right?”

      12 Nov 2024 · Scaling Intelligence · 34:55 · source · permalink
    2. spoken

      Patel says Google deployed water cooling years before NVIDIA and achieves higher reliability than NVIDIA GPUs.

      “Google's brought in water cooling for years. Right? NVIDIA only just realized they needed water cooling on this generation. And Google's brought in a level of reliability that NVIDIA GPUs don't have.”

      23 Dec 2024 · BG2 Pod · 1:11:47 · source · permalink
    1. spoken

      Patel explains GB200's 72-GPU configuration creates reliability challenges compared to 8-GPU systems due to higher failure probability.

      “If the reliability of each GPU is the same, then when a single GPU fails in 72 GPUs, you have a much higher chance of something failing, right?”

      3 Oct 2025 · Together AI · 12:40 · source · permalink
    1. spoken

      Patel reports 10-15% of NVIDIA GPUs fail and require RMA within first two weeks of cluster deployment.

      “When you first turn on the cluster, about ten to fifteen percent of them fail RMA in the first two weeks. Wow. And then that's fine. Like you have to receipt them, whatever.”

      3 Feb 2026 · TBPN · 4:35 · source · permalink
    2. spoken

      Patel reports 15% of deployed Blackwell GPUs require RMA within first deployment period.

      “Even today, 15% of Blackwells or so that get deployed have to be RMA'd. You have to take them out.”

      13 Mar 2026 · Dwarkesh Patel · 1:58:16 · source · permalink

Dylan Patel ontheir other subjects

Everything Dylan Patel is on record saying · RSS