Patel explains AI hardware companies made architectural bets that failed when model architectures evolved in unexpected directions.
“But still the model's way too big to fit on it. This is, like, very simple. Right? You know, the same thing's happening in the other direction.”
Patel reveals at least two AI hardware companies made wrong bets as models shifted to sparse MOEs.
“This is actually the case with at least two of the AI hardware companies today. Don't shittock them just because, you know, it's a let's be friendly.”