In my April column, I talked about of the true price of AI is a probably deadly flaw for the worthwhile commercialization of the know-how long run. Curiously, within the two months since, we’ve seen some outstanding headlines from the tech {industry} probably validating my argument at catastrophic scale.
It feels just like the winds within the AI {industry} are altering route so quick that it’s troublesome to maintain monitor. A matter of some months in the past, tech firms and even another companies had been cracking the whip to get workers to make use of AI extra, demanding that groups combine it into workflows, no matter whether or not they had any clear want or specific need for the software program.
Hindsight is 20–20
As anybody who considered it might most likely have predicted, if you tie folks’s materials livelihoods to utilizing a factor extra, a big sector of individuals will, in reality, use the factor extra. This led to “tokenmaxxing”, token utilization leaderboards inside firms like Amazon, and stunning quarterly AI token expense figures at tons of locations equivalent to Uber (and different firms that haven’t been prepared to call names). It’s frankly unclear to me why these firms are stunned at these outcomes, however nonetheless, this has led to a pivot in the directions to workers each as a result of this price is unsustainable for any size of time, but in addition as a result of the usage of the AI has not produced sufficiently spectacular enterprise outcomes.
It’s potential that govt management believed that some semi-miraculous productiveness explosion was going to come back from AI utilization, but when so, they actually hadn’t performed their homework. Plenty of us within the subject in addition to folks in media masking the {industry} sounded warnings about how AI is a software, which can be utilized successfully or ineffectively, and anticipating miracles will at all times disappoint.
I’ve used this type of metaphor earlier than, however contemplate if these firms had been in development, and electrical drills had been newly invented, making distinctive productiveness enhancements in constructing potential. The right response wouldn’t be to purchase as many drills as they’ll, to the purpose of creating drill parts scarce and driving up their value, and instructing workers to make use of a drill in each job, producing scoreboards displaying who was utilizing drills for essentially the most minutes of the day. You’d have buildings that had swiss cheese patterns of holes in them, you’d have spent exorbitantly on the drills and the electrical energy to energy them, and also you’d have about as a lot to indicate for it as tech firms do from AI now.
Cash Isn’t Infinite
At any fee, actuality has begun to come back crashing down, and it was at the very least a fast return to earth. Some companies are nonetheless shopping for drills, however the massive gamers have seen that the cost-benefit ratio right here isn’t making sense, and are adjusting. Nonetheless, as I defined in April, this isn’t going to be as straightforward as they suppose. Some firms are starting to inform their groups that the usage of AI must be for fruitful functions, not simply tokenmaxxing, to try to deliver down prices whereas nonetheless reaping the advantages of the know-how the place it might generate worth.
What they don’t seem to be but greedy is that budgeting for tokens and clearly defining when AI goes to assist with an issue is a way more indeterminate job than utilizing different kinds of know-how. Let’s return to my April article and recollect the expertise of utilizing AI for the person.
“[Y]ou can ostensibly management what number of tokens you submit, and thus management your prices, however that management is proscribed. You may make your prompts temporary, restrict extraneous directions, and maintain down your prices for enter consequently. Nonetheless, when agentic instruments become involved, and the LLM is developing prompts to go to different LLMs, you’re now not answerable for the size of the prompts. Much more considerably, you might have solely essentially the most minimal management over the variety of tokens that any mannequin responds with (equivalent to by asking it to “be concise”). For essentially the most half, the variety of output tokens is part of that nondeterministic unknown I described earlier than. And, you’ll notice, an output token prices 5x the worth of an enter token.”
To increase this additional, any time you utilize AI, it has an opportunity of failing to efficiently reply your query. So the slot-machine part piles on to the issue. The tech employee doesn’t know A. what number of tokens any immediate will return or B. what number of occasions a immediate will have to be fed in (probably with edits) to get a profitable reply to a query. To calculate the associated fee, we have to sum all of the enter immediate token counts, and all of the output immediate token counts (A, which is unknown) for the size of the variety of makes an attempt required (B, which can be unknown). A and B range indeterminately based mostly on mannequin structure, the issue at hand, the randomness within the mannequin, and different components we’re most likely not even conscious of behind the scenes. Then, we multiply by the worth per token for no matter mannequin or fashions are getting used, which, as I defined in April, additionally varies.
So, should you’re within the monetary division of a tech firm, and you must decide the funds in {dollars} for AI tokens for the subsequent 12 months, I want you all the very best of luck. Even estimating based mostly on the previous utilization, or with very fantastic element concerning the firm’s productiveness targets, your probabilities of budgeting the right amount appear fairly slim to me. Nonetheless, you need to implement some type of restrict, this will’t be a clean verify situation, so that you’re going to have to chop folks off sooner or later.
Sensible Implications
How’s this going to really work? Is it “guide coding” within the second half of the 12 months, after spending the primary half utilizing AI intensively? Are all our emails and advertising paperwork hand written in Q3 and This autumn? Are we shutting down our AI transcription instruments and voice-to-text software program after a threshold is hit? This can be a fascinating query to me, as a result of I’ve personally witnessed how completely different the expertise is of writing code with AI is from doing it with out, and switching forwards and backwards between the 2 processes can be extremely disruptive.
This additionally brings up the query of how price slicing on AI goes to have an effect on the businesses offering AI-based options. Final October I mentioned how the hyperscalers (Anthropic, OpenAI, Google, and so forth) are pushing startups to implement AI-based options of their merchandise, as an try to earn earnings to return to the buyers who’ve sunk many billions of {dollars} into this {industry}. As the price of offering AI options will increase, and firms transfer an increasing number of to a pay-per-use mannequin, this flywheel goes to begin to collapse. If firms begin utilizing AI-based tooling much less as a result of their budgets can’t accommodate the spiraling prices, the pipeline of revenues again to the hyperscalers will dry up. Anthropic and OpenAI are planning IPOs this 12 months, each with extraordinarily unsure paths to profitability and lots of of billions of {dollars} owed again to buyers, so a slowdown in AI utilization is the very last thing they want.
It’s additionally price mentioning that Apple introduced their product foray into AI final week at WWDC, and critics are responding fairly positively to date. The brand new Siri utilizing know-how from Google Gemini could have substantial privateness safety (on gadget and personal cloud compute and minimal knowledge storage) and can be not going to price customers additional. With this accessible, and if the standard lives as much as expectations, common shopper use of ChatGPT and Claude may additionally be in danger.
Conclusion
Watch this area, as a result of whereas the tales of “firms shocked at AI payments” and “OpenAI and Anthropic capturing for the most important IPOs in historical past” are sometimes reported individually, they’re actually the identical narrative from completely different angles. Even when tech firms do really feel like AI is offering them advantages and giving productiveness features, they merely do not need limitless budgets to use to it. If they don’t have limitless budgets (and customers definitely don’t, with CPG costs straining budgets and financial sentiment the bottom it’s been in virtually a century of monitoring), now we have to come back again and ask the place the billions and billions that OpenAI, Anthropic, and others predict to generate in revenues are going to come back from. Mix this with the public pushback towards knowledge facilities and unfavourable sentiment about AI usually, and hyperscalers have an actual drawback on their palms.
Learn extra of my work at www.stephaniekirmer.com
Additional Studying
https://medium.com/@s.kirmer/can-we-save-the-ai-economy-b431b1f62f93
https://medium.com/@s.kirmer/the-llm-gamble-cc434c5a9f54
https://www.businessinsider.com/disney-ai-push-increase-velocity-tech-employees-tokenmaxxing-josh-damaro-2026-6
https://www.businessinsider.com/ai-spending-roi-concerns-tokenmaxxing-uber-coo-andrew-macdonald-reaction-2026-5
https://gizmodo.com/big-tech-is-quietly-admitting-that-if-it-wants-to-sell-people-on-ai-it-better-be-cheap-2000768710
https://tech.yahoo.com/ai/articles/amazon-latest-tech-giant-face-212500092.html
https://www.inc.com/georgia-fearn/palantir-ceo-just-accused-ai-labs-of-tokenmaxxing-at-corporate-companies-expense/91359321
https://www.businessinsider.com/meta-google-jpmorgan-make-ai-performance-reviews-goals-raises-promotions-2026-3
https://www.theverge.com/tech/949502/apple-macos-27-golden-gate-siri-ai-apple-intelligence
https://www.theverge.com/tech/947432/siri-ai-apple-intelligence-ios-27-wwdc
https://gizmodo.com/americans-are-starting-to-really-hate-data-centers-and-its-making-the-tech-industry-nervous-2000767088
https://gizmodo.com/companies-are-getting-burned-by-burning-tons-of-tokens-2000765232
