Gerstner reports inference costs fell 90% in eighteen months and are expected to drop another 90%.
“And our friend Sunny over the weekend when we were in our group chat, you know, said he expects it to come down by another 90% over the course of the next several years.”
Gerstner says $3 vs $15 inference cost is irrelevant when replacing $200/hour consultants with AI.
“It's just irrelevance. That inference cost difference is irrelevant if you're getting something that's bulletproof for $15.”