The Minutes of Dylan Patel on gb200 https://minutesof.com/dylan-patel/on/gb200/ Everything Dylan Patel has said on gb200: 5 verbatim quotes from October 2025, each with a timestamp and a link to the recording it came from. en Sun, 30 Aug 2026 16:22:19 +0000 Patel quantifies GB200 as 10x more power efficient than H200 at certain interactivity rates. https://minutesof.com/q/5246be24-b713-4f40-9330-362372209a1f/ https://minutesof.com/q/5246be24-b713-4f40-9330-362372209a1f/ “at certain interactivity rates, I. E. Tokens per second per user, it's 10x more efficient per watt, right, compared to H200.” — Open Compute Project Thu, 23 Oct 2025 06:01:19 +0000 gb200 Patel notes GB200 expanded NVLink from 8 to 72 GPUs and rack power jumped from 10 to 140 kilowatts. https://minutesof.com/q/015334ac-c584-41cb-9262-58aa5ef55a91/ https://minutesof.com/q/015334ac-c584-41cb-9262-58aa5ef55a91/ “Now you have 72 GPUs. And if you go look at the rack, right? It's completely different, right? It's liquid cooled. It's an entire rack that consumes 140 kilowatts, whereas H100 servers consumed 10 kilowatts.” — Together AI Fri, 03 Oct 2025 20:23:30 +0000 gb200 Patel explains GB200's 72-GPU configuration creates reliability challenges compared to 8-GPU systems due to hi https://minutesof.com/q/e442c5ed-ed97-4cb7-8195-b9012b3b0fc8/ https://minutesof.com/q/e442c5ed-ed97-4cb7-8195-b9012b3b0fc8/ “If the reliability of each GPU is the same, then when a single GPU fails in 72 GPUs, you have a much higher chance of something failing, right?” — Together AI Fri, 03 Oct 2025 20:23:30 +0000 gb200 Patel confirms OpenAI runs production inference on GB200 despite reliability requiring workloads handle 64 of https://minutesof.com/q/63137c12-d683-47eb-9bf7-16977addf85c/ https://minutesof.com/q/63137c12-d683-47eb-9bf7-16977addf85c/ “OpenAI has said they're running production inference on GV200 a couple of months ago, in fact. Right?” — Together AI Fri, 03 Oct 2025 20:23:30 +0000 gb200 Patel says B200 is better for training while GB200 is better for inference, reversing expected use. https://minutesof.com/q/b34c2dfe-463a-4923-8ba7-41d8b89b38a6/ https://minutesof.com/q/b34c2dfe-463a-4923-8ba7-41d8b89b38a6/ “And so you've sort of Which is the exact opposite of what you would have expected. Oh, use the big thing for training and use the small thing for inference.” — Together AI Fri, 03 Oct 2025 20:23:30 +0000 gb200