The Minutes of Dylan Patel on interconnect https://minutesof.com/dylan-patel/on/interconnect/ Everything Dylan Patel has said on interconnect: 2 verbatim quotes between February 2023 and July 2026, each with a timestamp and a link to the recording… en Mon, 31 Aug 2026 13:10:14 +0000 Patel explains NVLink connects only 72 GPUs while Google ICI connects 8,000 chips without switches, creating a https://minutesof.com/q/5ca387af-4b9c-4a90-9c49-5374505ffeb1/ https://minutesof.com/q/5ca387af-4b9c-4a90-9c49-5374505ffeb1/ “NVIDIA, the NVLink can only connect 72 GPUs. For Google, their ICI can connect 8,000 chips at super high bandwidth, but you have to pass through other chips to get there because there's no switch.” — The AGI Post Mon, 06 Jul 2026 22:07:54 +0000 interconnect Patel argues interconnects between servers are now the key bottleneck, not individual chip speed. https://minutesof.com/q/9e80e3ac-3937-4220-880d-5bc04e1351f9/ https://minutesof.com/q/9e80e3ac-3937-4220-880d-5bc04e1351f9/ “The interconnects is the biggest bottleneck right? And so the problem set is it moved from you know just one, you know, hey, my chip is faster.” — Gradient Flow Thu, 02 Feb 2023 12:00:39 +0000 interconnect