跳到正文
The Decoder:AI News· Matthias Bastian·· 32 分钟前AI 评分65

METR 警告 AI 能力提升快于专家可靠评估新系统安全性的速度

AI is getting better faster than experts can reliably test whether new systems are safe, METR warns

AI 导读

AI 研究机构 METR 发布 2026 年 11 月 AI 能力测量更新,警告现有公开数据不足以排除未来几年 AI 研究急剧加速的可能,可能使人类无法有效理解和应对新 AI 系统的灾难性风险。

正文 · 原文

AI models are rapidly improving at AI research tasks, and they're getting harder to measure. According to the AI research organization METR, current public data isn't enough to rule out a drastic acceleration in AI research over the next few years. That could leave humans unable "to meaningfully understand, assess, and react to catastrophic risks posed by new AI systems," the organization warns.

On clearly defined coding and computational tasks with direct feedback, the models already beat experienced human professionals most of the time, METR found, though they haven't yet outperformed large groups of top experts. For tasks that take humans longer, the task length the models can handle doubles every 3.6 months. A naive extrapolation of METR's data puts them at a 50 percent success rate on the longest, 200-hour tasks by July 2027.

METR's analysis shows the steady rise in capabilities of leading AI models up through Opus 5.5 and GPT-6 Astra. | Image: METR

The systems still struggle with open-ended questions that lack immediate feedback and require real judgment, as well as with situations that are hard to recreate for training, according to METR. The organization also warns that common, easy-to-run tests may overestimate how well the models perform in real-world use, since developers train them in very similar test environments.

来源:The Decoder:AI News · the-decoder.com

事件后续 · 1

查看事件全部