How much does it cost to run a text game with LLMs
Web page · https://azelianouski.dev/post/werewolf-real-llm-costs
AI costs are confusing. Providers give you a lot of numbers and nothing to actually know how much you are going to pay in the long run. There is no point in these input/cached/output token prices if you have no idea how many reasoning tokens you'll spend on your tasks. How much will be cached. We are going to review the real-world usage of 27 frontier models.
First seen by Oriel on .
AI summary
An analysis of 51,000 API calls across 27 frontier models shows that measured per-turn costs differ substantially from token-rate estimates because of reasoning output, tokenization, and unreliable caching.
- A game lasting at least 50 turns averaged $1.49 across roughly 165 AI turns: $1.03 for text, $0.32 for images, and $0.13 for voice.
- Switching free-tier limits from advertised output prices to measured turn costs reduced average free-tier cost from 0.91¢ to 0.50¢, although newer models also contributed.
- Grok 4.7 cost 2.7 times its estimated rate-card price; Grok 4.6/4.7 produced about 2,200 output tokens per turn, 94% of them reasoning.
- Only 29% of input tokens were cached overall; DeepSeek retained cache across long gaps, while Gemini largely lost it after five minutes.
- Chinese models averaged 0.40¢ per turn versus 0.76¢ elsewhere, but the difference disappeared within matched cost bands, with DeepSeek V4 Pro as the exception.
#llm costs #prompt caching #reasoning tokens #text games
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Reactions
Total public reactions reported by the source; distinct from points and likes.
- DEV Community: 87, latest observation ; +71 over observed period since
Comments
Comment count reported by the source.
- DEV Community: 92, latest observation ; +76 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| DEV Community | 4999883 | https://azelianouski.dev/post/werewolf-real-llm-costs/ Read discussion |