Tag

#prompt-caching

Posts tagged with prompt-caching

2 posts

AI agent token usage overtaking human-driven traffic on LLM API gateways and reshaping how platforms meter, price, and serve machine callers.

News • Aug 23, 2026 •11 min read

AI Agent Token Usage Overtook Humans on OpenRouter

OpenRouter data shows AI agent token usage passed human traffic on February 6, 2025, with 14x growth and ~70 percent cached. Here is how to audit your mix.

#ai-agents #token-usage +4

LLM context window management keeps a growing agent conversation within the limited space a model can actually read and reason over.

Guides • Aug 18, 2026 •11 min read

LLM Context Window Management With a Token Budget

Learn LLM context window management with a token budget ledger, a stepwise compression ladder, and the prompt cache trap that punishes trimming.

#context-windows #token-budget +4