AGI Pulse
ProductOpenAI · OpenAI

Better prompt caching for GPT-6: higher hit rates, diagnostics, and agent-friendly controls

4 reads

Published
2026-09-23
Type
Product
Organization
OpenAI
Source
OpenAI

Why it matters

  • OpenAI published Better prompt caching for GPT-6 (primary: openai.com/index/better-prompt-caching-for-gpt-6 RSS pubDate 2026-09-22T21:00:00Z).
  • For persistent multi-turn agents, shared instructions, tool definitions, and context can be cached across requests—cutting latency and offering up to ~90% discount on cached input tokens.
  • GPT-6 family raises default hit rates; eligible shared prefixes reused within a ~30-minute window get cache discounts.
  • New Prompt Caching Dashboard and diagnostics explain misses (e.g. tools_changed).
  • Optional controls: explicit cache breakpoints
  • change reasoning effort without breaking cache
  • keep tool defs/schemas/order stable (prefer allowed_tools / tool_choice=none over removing defs)
  • append developer messages
  • optional prewarming.
  • Customer quotes on the page are not independently verified here.
  • Editorial: infra/observability for agent economics

Read original →

Related developments

Aggregated by AGI Pulse. Titles and links only; no full text is republished. Editorial policy