Cost Optimization
Why Do Multi-Turn Conversations Get More Expensive?
LLMs charge per input Token. Every turn requires resending the full conversation history — the longer the history, the more Tokens, and the higher the cost. Drag the slider to simulate cost accumulation.
Cost Simulator
Input Composition Per Turn
Input composition per turn (red = current turn, gray = history)
Per-Turn Cost Breakdown
| Turn | New Tokens | Input This Turn | Cost |
|---|
Why are the last few turns so expensive?
Turn 10's input = System Prompt + all Q&A from the previous 9 turns + the current question. Every turn re-submits the entire conversation history to the model.
Turn 10's input = System Prompt + all Q&A from the previous 9 turns + the current question. Every turn re-submits the entire conversation history to the model.
📈
Costs grow linearly with each turn. Next: how KV Cache reduces repeated-computation costs by over 70% through caching.