Oriel — AI & technology worth noticing, every day.

How much does it cost to run a text game with LLMs

Web page · https://azelianouski.dev/post/werewolf-real-llm-costs

AI costs are confusing. Providers give you a lot of numbers and nothing to actually know how much you are going to pay in the long run. There is no point in these input/cached/output token prices if you have no idea how many reasoning tokens you'll spend on your tasks. How much will be cached. We are going to review the real-world usage of 27 frontier models.

First seen by Oriel on .

AI summary

An analysis of 51,000 API calls across 27 frontier models shows that measured per-turn costs differ substantially from token-rate estimates because of reasoning output, tokenization, and unreliable caching.

  • A game lasting at least 50 turns averaged $1.49 across roughly 165 AI turns: $1.03 for text, $0.32 for images, and $0.13 for voice.
  • Switching free-tier limits from advertised output prices to measured turn costs reduced average free-tier cost from 0.91¢ to 0.50¢, although newer models also contributed.
  • Grok 4.7 cost 2.7 times its estimated rate-card price; Grok 4.6/4.7 produced about 2,200 output tokens per turn, 94% of them reasoning.
  • Only 29% of input tokens were cached overall; DeepSeek retained cache across long gaps, while Gemini largely lost it after five minutes.
  • Chinese models averaged 0.40¢ per turn versus 0.76¢ elsewhere, but the difference disappeared within matched cost bands, with DeepSeek V4 Pro as the exception.

#llm costs #prompt caching #reasoning tokens #text games

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Reactions

Total public reactions reported by the source; distinct from points and likes.

  • DEV Community: 87, latest observation ; +71 over observed period since

Comments

Comment count reported by the source.

  • DEV Community: 92, latest observation ; +76 over observed period since

Aliases

SourceExternal IDURL
DEV Community4999883https://azelianouski.dev/post/werewolf-real-llm-costs/ Read discussion