Dylan Patel · Latent Space · 5 December 2023
“But on inference, it's not being talked about much, but model MBU, model bandwidth utilization is the important factor.”
Verbatim excerpt with a timestamp. The full recording is at the source; we link out and do not host it. Everything Dylan Patel is on record saying.