S&P 5007,600.50▲1.5% Nasdaq25,913.90▲2.1% Dow53,178.41▲1.3% Russell 2K2,981.91▲1.7% 10-Yr4.69%−6bp VIX15.86−0.13 WTI$80.00▼5.5% Gold$4,106.70▲1.4% EUR/USD1.151▼0.1% BTC$63,638▲0.2% Nikkei64,362▲4.0%
At close · Mon, Aug 3, 2026
Daily Market Updates.

US Markets

HomeUS MarketsSectorsAI providers face token cost uncertainty as agent use…

AI providers face token cost uncertainty as agent use expands

Firms are struggling to forecast future pricing because token consumption is rising much faster than unit token costs, leaving buyers unsure about what they will spend.

BBC Business highlights that many users start with free AI tools, while paid versions, such as offerings from Microsoft, Google, and Anthropic, add features for tasks like coding or billing. At the same time, third-party companies are packaging AI agent services built on large language models, which adds another layer of pricing and cost complexity for business customers.

The article explains that AI responses are broken into tokens, with prompts and outputs translated into chunks that models process. It says subtle changes in prompts, differences across models, and the use of multiple agents in agentic systems can all increase both token use and unpredictability in how much capacity a task will consume.

BBC Business also notes that while the cost of individual tokens or credits has fallen in recent years, overall token consumption has surged. Goldman Sachs analysis cited in the piece forecasts external token consumption will grow 24 times between 2026 and 2030 to 120 quadrillion tokens per month as companies shift to more AI agent usage.

The uncertainty has tangible consequences, the article says, because buyers may not know how many tokens they are burning through until bills arrive or services run out. It points to examples including Microsoft reportedly limiting some engineers' use of third-party coding tools and Uber using substantial amounts of AI resources.

More like this

Sources

Get the close, explained.

One email every trading day: what moved, why it moved, and what's on deck tomorrow. Read in 3 minutes.

Free. Unsubscribe anytime.