Sam Altman 提议前沿模型开发者共同建立评估与安全红线测试的行业规范
Sam Altman 提议各前沿模型开发者共同建立评估模型和红线测试安全案例的行业共同规范,包括共享透明度标准。他还建议基于困惑度等测量设定开发者承诺不逾越的共同上限,直到理解与监控 AI 行为的能力达到具体里程碑(例如 CoT 监控器的后继技术),形成规定开发首道上限及突破前所需条件的行业标准。
"I believe frontier model developers should jointly endeavour to establish shared norms for how to evaluate such models and red-team safety cases for them by the time they are first used, including shared transparency standards.
I further propose common limits, based on perplexity and other measurements, that developers are committed to not crossing until our ability to understand and monitor AI behavior achieves a certain concrete milestone (such as the development of a successor to CoT monitors).
That is, I’d like an industry standard that specifies a first limit on development, measured by some key metric we can track across labs, and what concretely we’d need to achieve before going beyond it."
来源:Sam Altman · x.com