跳到正文
Rohan Paul· @rohanpaul_ai · X·· 2026-07-10AI 评分49
AI 导读

Atomic Chat 在 HTML5 物理演示测试中对比 GPT-5.6 Sol Ultra、Opus 4.8、GPT-5.5 和 Grok 4.5,要求生成三个自包含 canvas 场景(怪物卡车后空翻压车、特技车飞越六辆巴士撞墙、火车出轨落水)。输出:Sol Ultra 消耗 32.9K tokens($0.33),GPT-5.5 仅 12.4K tokens($0.11),成本为 3 倍但物理效果更弱——画面细节更丰富,却在力、动量、碰撞时机等关键物理表现上不及前代。Opus 4.8 花费 $0.24,Grok 4.5 花费 $0.08 且失败两个测试。该测试揭示普通编码基准隐藏的弱点:模型能用更多 token 描绘丰富场景,却仍无法处理核心物理逻辑。

正文 · 原文

GPT-5.6 Sol Ultra vs GPT-5.5

In a surprising HTML5 physics test demo Atomic Chat found GPT-5.6 Sol Ultra is 3X more expensive vs GPT-5.5, but for no clear physics advantage.

The test asked each model to write self-contained HTML5 canvas demos for crashes, flips, jumps, and derailments.

Outputs:
GPT-5.6 Sol Ultra: 32.9K tokens, $0.33
Opus 4.8: 9.2K tokens, $0.24
GPT-5.5: 12.4K tokens, $0.11
Grok 4.5: 7.0K tokens, $0.08

Physics demos expose a weakness that ordinary coding benchmarks often hide: a model can spend more tokens describing a richer scene while still failing the hard part, which is maintaining force, momentum, collision timing, and believable object behavior across frames.

引用atomic.chat@atomic_chat_hq
GPT-5.6 Sol Ultra lost to GPT-5.5 on physics at 3× the cost! We gave 4 models the same prompt: build three self-contained HTML5 canvas scenes with real physics demos Prompts: - A monster truck backflipping onto a parked car - A stunt car jumping six buses into a brick wall - A train derailing off a broken bridge into the water Outputs: GPT-5.6 Sol Ultra: 32.9K tokens, $0.33 Opus 4.8: 9.2K tokens, $0.24 GPT-5.5: 12.4K tokens, $0.11 Grok 4.5: 7.0K tokens, $0.08 Sol Ultra draws just like GPT-5.5, only with more detail and it shows clearest on the bus jump where the two look almost identical. In the other tests Sol Ultra came out worse than its predecessor and the physics really got weaker. We think GPT-5.5 took the truck flip and the train outright. With Sol Ultra you basically get GPT-5.5 with weaker physics and a nicer picture for 3x the price. Newborn Grok 4.5 failed two of the three tests and only came good on the train
在 X 查看被引用的帖子

来源:Rohan Paul · x.com