Epoch AI 实测:GPT-5.6 首字延迟随上下文呈二次增长,Claude 5 接近线性

Epoch AI · @EpochAIResearch · X·2026-09-09 05:12·57分钟前
AI 导读

Epoch AI 测量 GPT-5.6 与 Claude 5 的首字延迟(TTFT)随上下文长度的变化,发现 GPT-5.6 Terra 和 GPT-5.6 Sol 呈明显二次分量,而 Claude Sonnet 5 和 Claude Opus 5 更接近线性。

Epoch AI@EpochAIResearch
55AI 编辑部评分,满分 100

Epoch AI 实测:GPT-5.6 首字延迟随上下文呈二次增长,Claude 5 接近线性

2026-09-09 05:12· 57分钟前
AI 导读

Epoch AI 测量 GPT-5.6 与 Claude 5 的首字延迟(TTFT)随上下文长度的变化,发现 GPT-5.6 Terra 和 GPT-5.6 Sol 呈明显二次分量,而 Claude Sonnet 5 和 Claude Opus 5 更接近线性。

OpenAI GPT-5.6 models and Anthropic Claude 5 models have different pricing structures at long context lengths. GPT model costs increase in price past 272k input tokens, while Claude model costs remain fixed.

Does this reflect an underlying difference in the architecture of these models? Our measurements of serving latency suggest so.

We studied time to first token (TTFT) on these models and how it scales with increasing context length. We found a significant difference in how they scale, with GPT showing a noticeable quadratic component, while Claude models remain closer to linear.