跳到正文
Arena.ai· @arena · X·· 2 小时前AI 评分52
AI 导读

Arena 发布 Alignment Index,将评测平台扩展到对齐领域。该评估覆盖三类问题:模型擅自执行操作、欺骗性回复(声称完成实际未做的任务)和虚假归因(把人类没有的意图归于人)。完整技术报告见其博客,完整排名已公开可查。

正文

Our Alignment Index is here.

Find the full technical report at our blog https://bit.ly/4hQP3xO and view the full rankings for yourself at https://bit.ly/4hMIHzp

引用MTS@MTSlive
Arena CEO @ml_angelopoulos on how they're expanding their AI leaderboards after a $200M Series B to track agents that lie to users, delete files without permission, and bypass safeguards: "Arena, we started as a human preference platform. But these days we've moved very, very far beyond that." "As of today, we've expanded the mandate of this evaluation platform even further into the arena of alignment. One is about the models taking unauthorized actions." "The second is about deceptive completions, models telling you that they've done something when they didn't. And the third would be false attribution, models attributing intent to humans that they didn't actually have." "Agents are lying to people. Agents are basically telling them what they wanna hear. They're deleting their files in an unauthorized way, they're bypassing permissions, and it's happening basically perniciously." "All of us have experienced this, even if we might not know it." @arena
在 X 查看被引用的帖子

来源:Arena.ai · x.com