Baker questions whether AFD is compatible with data locality, disputes OpenAI bet against disaggregation
“@maxkan Hmm. I might ask @dylan522p if Attention-FFN disaggregation (AFD) is compatible with data locality and not moving the KV cache. That constraint is what OpenAI focused on with Jalapeño. They absolutely did not make an “explicit bet that disagg is not the way to go.” There are https://t.co/2lVjH2M5vS”
Baker hypothesizes tomorrow's Ultrafast will be GPUs or Jalapeño with CS-4 or CS-5
“@dylan522p @maxkan And they also said this followed by “Cerebras FTW.” I would be surprised if their head of Codex was unaware of their roadmap. Reasonable to hypothesize tomorrow’s Ultrafast will be either GPUs or Jalapeño working with CS-4 or CS-5. We shall see! https://t.co/QM0vs809x7”