Simon Willison 用 Mistral Large 4 等模型生成"火星穿网袜犰狳"SVG 测试基准饱和

Mistral Large 4

AI 导读

Simon Willison 针对 Mistral Large 4 的基准饱和评论，用 llm 工具分别调用 claude-opus-5.5、gpt-6.1-sol、gemini-3.8-flash 和 mistral/mistral-large-4 生成"火星上穿网袜乱穿马路的犰狳"SVG。该测试源于 Hacker News 用户 wren6991 对前沿模型基准饱和的调侃。

正文

My comment on Mistral Large 4 — Hacker News.

wren6991: The benchmark is saturated. Frontier models are tested with an armadillo in fishnet tights jaywalking on Mars.

OK well I couldn't resist this one:

llm -m claude-opus-5.5 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
llm -m gpt-6.1-sol 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
llm -m gemini-3.8-flash 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
llm -m mistral/mistral-large-4 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'

Default reasoning levels for each: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...