AI dictionary

Prompt Caching

Reusing unchanged prompt or context segments so repeated model calls can be cheaper or faster.

Plain English

If the giant system prompt and docs are the same, the provider may not need to process them from scratch.

Example

An agent repeatedly includes the same tool definitions and project instructions across many turns.

Why it matters

Caching makes long-context and tool-heavy applications more practical in production.