Artificial Analysis 推出 AA-Robotics v0.1 具身智能评测
Welcome to the era of embodied AI: Introducing AA-Robotics v0.1
Artificial Analysis 发布 AA-Robotics v0.1,用 8 项实体任务评测具身智能,包括按红色按钮、把鳄鱼玩具放进矩形、倒饮料、整理积木、形状匹配、写 hello world、搭最高塔和测量盒子。
Introducing AA-Robotics v0.1
The eight tasks
Results
Results per Task
- Full score (100)
- Partial (1 to 99)
- Zero (0)
| Task |
|
|
|
|
|
|---|---|---|---|---|---|
| Press the red button | Full score, 100 of 100 | Full score, 100 of 100 | Full score, 100 of 100 | Full score, 100 of 100 | Full score, 100 of 100 |
| Place the crocodile toy in the rectangle | Full score, 100 of 100 | Full score, 100 of 100 | Full score, 100 of 100 | Full score, 100 of 100 | Full score, 100 of 100 |
| Pour the drink into the cup | Full score, 100 of 100 | Zero, 0 of 100 | Full score, 100 of 100 | Partial, 25 of 100 | Partial, 30 of 100 |
| Tidy the blocks into the box | Partial, 40 of 100 | Full score, 100 of 100 | Partial, 40 of 100 | Partial, 40 of 100 | Partial, 40 of 100 |
| Complete the shape matching challenge | Partial, 44 of 100 | Full score, 100 of 100 | Zero, 0 of 100 | Partial, 38 of 100 | Full score, 100 of 100 |
| Write hello world | Full score, 100 of 100 | Full score, 100 of 100 | Partial, 45 of 100 | Partial, 45 of 100 | Zero, 0 of 100 |
| Build the tallest tower | Partial, 71 of 100 | Zero, 0 of 100 | Partial, 57 of 100 | Partial, 25 of 100 | Zero, 0 of 100 |
| Measure the box | Zero, 0 of 100 | Partial, 17 of 100 | Zero, 0 of 100 | Partial, 17 of 100 | Zero, 0 of 100 |
| AA-Robotics Score | 69.4 | 64.6 | 55.3 | 48.8 | 46.3 |
Each attempt is scored out of 100: completing the task scores 100, and a partial result earns points for the progress made.
GPT models run in Codex, Claude models in Claude Code, and Gemini 4 Argon in Antigravity, all at the high effort setting.
How AA-Robotics works
Time & cost
How each model spent its time
Physical accuracy
Mistake wall
来源:Artificial Analysis 完整文章 · artificialanalysis.ai