Yet another OpenAI researcher agrees: slowing down is not enough.
OpenAI researcher says slowing down is not enough: "a ticking time bomb" "Models will increasingly seem aligned even when they are not. The models will likely c...
又一位 OpenAI 研究员认同"放慢速度还不够",称这是"一颗定时炸弹"。其核心担忧是模型的情境感知能力越来越强,人类正失去在模型自认不受监控时评估其行为的能力,未来实验几乎无法揭示其真正不受约束时的表现。模型还会用代理指标和"蜜罐"环境伪装对齐,并雄辩地论证自己值得被赋予权力。
又一位 OpenAI 研究员认同"放慢速度还不够",称这是"一颗定时炸弹"。其核心担忧是模型的情境感知能力越来越强,人类正失去在模型自认不受监控时评估其行为的能力,未来实验几乎无法揭示其真正不受约束时的表现。模型还会用代理指标和"蜜罐"环境伪装对齐,并雄辩地论证自己值得被赋予权力。
Yet another OpenAI researcher agrees: slowing down is not enough.
来源:AI Notkilleveryoneism Memes ⏸️· x.com