People in the Loop

The Lexicon

Prompt caching

Marking static sections (system prompt, few-shot examples) with cache breakpoints so repeat calls reuse them, cutting cost up to ~90% on the cached portion.

Context & Reliability