OpenAI 增强 GPT-6 提示词缓存可靠性与可控性

Rohan Paul · @rohanpaul_ai · X·2026-09-23 07:33·3小时前
AI 导读

OpenAI 为 GPT-6 的提示词缓存带来更高命中率、诊断工具、断点、预热和保留缓存的推理变更。缓存复用可将缓存输入 token 成本降低最多 90%,新仪表盘展示缓存命中率及缓存与未缓存 token 量。作者指出高命中率仍是应用设计问题,开发者需让长时运行智能体的稳定指令和工具保持可复用。

Rohan Paul@rohanpaul_ai
53AI 编辑部评分,满分 100

OpenAI 增强 GPT-6 提示词缓存可靠性与可控性

2026-09-23 07:33· 3小时前
AI 导读

OpenAI 为 GPT-6 的提示词缓存带来更高命中率、诊断工具、断点、预热和保留缓存的推理变更。缓存复用可将缓存输入 token 成本降低最多 90%,新仪表盘展示缓存命中率及缓存与未缓存 token 量。作者指出高命中率仍是应用设计问题,开发者需让长时运行智能体的稳定指令和工具保持可复用。

OpenAI is making GPT-6 prompt caching more reliable and controllable, adding higher hit rates, diagnostics, breakpoints, prewarming, and cache-preserving reasoning changes.

Long-running agents often resend instructions, tool definitions, and earlier context, so caching avoids recomputing those prefixes across successive API calls.

That reuse can cut cached-input token costs by up to 90%, while a new dashboard exposes cache-hit rates and cached versus uncached token volume.

ofcourse, a high cache hit rate is still remains partly an application-design problem. because GPT-6’s improved caching alone doesn’t guarantee good economics; developers still need to structure long-running agents so stable instructions and tools remain reusable.