The Minutes of Dylan Patel on distributed training https://minutesof.com/dylan-patel/on/distributed-training/ Everything Dylan Patel has said on distributed training: 2 verbatim quotes between December 2023 and November 2025, each with a timestamp and a link to… en Sun, 30 Aug 2026 16:22:23 +0000 Nadella describes connecting multiple Fairwater facilities on a petabit network spanning to Milwaukee for dist https://minutesof.com/q/ea637240-f2b4-42f0-b334-d334f1e45e01/ https://minutesof.com/q/ea637240-f2b4-42f0-b334-d334f1e45e01/ “Fairwater 4, which you're going to see under construction nearby, will also be on that one petabits network so that we can actually link the two at a very high rate.” — Dwarkesh Patel Wed, 12 Nov 2025 17:02:10 +0000 distributed training Patel identifies distributed training across data centers with lower bandwidth as a key unsolved problem that https://minutesof.com/q/8bdd8e52-1eff-46b4-82af-03f48966482c/ https://minutesof.com/q/8bdd8e52-1eff-46b4-82af-03f48966482c/ “Everything that we've seen so far is that large scale training has to happen in an individual data center with very high speed networking.” — Latent Space Tue, 05 Dec 2023 18:16:28 +0000 distributed training