The Minutes of Bill Gurley on inference https://minutesof.com/bill-gurley/on/inference/ Everything Bill Gurley has said on inference: 3 verbatim quotes between September 2024 and December 2024, each with a timestamp and a link to the… en Sun, 30 Aug 2026 16:22:02 +0000 Patel describes reasoning models generating thousands of thinking tokens, sometimes switching languages mid-re https://minutesof.com/q/476ea39f-bfb6-495d-9a59-81ea69699b0d/ https://minutesof.com/q/476ea39f-bfb6-495d-9a59-81ea69699b0d/ “It generates tons of things. It's like it it sometimes switches between Chinese and English. Right? Like, whatever it is. It's thinking. Right? It's churning.” — Bg2 Pod Mon, 23 Dec 2024 20:25:20 +0000 inference Patel explains reasoning models increase cost ten times by outputting 11,000 tokens versus 1,000 for same quer https://minutesof.com/q/9aed22e0-c898-4e8e-9a74-966679c754b1/ https://minutesof.com/q/9aed22e0-c898-4e8e-9a74-966679c754b1/ “I outputted a thousand tokens to I outputted 11,000 tokens. I've 10x'd my spend to generate no. Not the same thing. Right? It's higher quality.” — Bg2 Pod Mon, 23 Dec 2024 20:25:20 +0000 inference Patel calculates reasoning models cost fifty times more per query due to batch size and token generation combi https://minutesof.com/q/3af95131-05a1-45d4-ae2d-9578bd46190d/ https://minutesof.com/q/3af95131-05a1-45d4-ae2d-9578bd46190d/ “Cost increase for a single token to be generated is four to five x, but then I'm generating 10 x as many tokens.” — Bg2 Pod Mon, 23 Dec 2024 20:25:20 +0000 inference