Patel explains OpenAI's router will send low-value queries to cheaper models but use expensive compute for high-value monetizable queries.
“if the user asks a low value query like, hey, why is the sky blue? Just route them to mini. The model can answer perfectly fine, and that is a chunk of queries.”
Patel says OpenAI's router enables monetization by routing low-value queries to cheaper models and high-value queries to expensive ones.
“And now this immediately clicks like, oh, if the user asks a low value query like, hey, why is the sky blue? Just route them to mini.”