Gerstner estimates running a 7B model on-device requires 75 gigabytes of DRAM on phones.
“in order to do that, even a 7B model, you probably have to have, you know, 75 gigs of DRAM on your phone, right?”
Gerstner estimates Apple needs 75 gigs of DRAM on phones to run 7B on-device models.
“I think the question that Apple's probably struggling with, Bill, is in order to do that, even a 7B model, you probably have to have, you know, 75 gigs of DRAM on your phone, right?”