The Minutes of Dylan Patel on mixture of experts https://minutesof.com/dylan-patel/on/mixture-of-experts/ Everything Dylan Patel has said on mixture of experts: 1 verbatim quote from February 2025, each with a timestamp and a link to the recording it came from. en Sun, 30 Aug 2026 16:22:24 +0000 Patel states mixture of experts architecture can achieve the same model performance with 30% less compute. https://minutesof.com/q/ea8addd1-3523-4de1-80ec-07b2ce862d42/ https://minutesof.com/q/ea8addd1-3523-4de1-80ec-07b2ce862d42/ “So you can get effectively the same performance model and evaluation scores with numbers like 30% less compute.” — Lex Fridman Mon, 03 Feb 2025 00:12:13 +0000 mixture of experts