跳到正文
Tibo· @thsottiaux · X·· 2026-09-09AI 评分39
AI 导读

Anthropic 高管称 Astra 是其迄今最强大且对齐最好的模型,并指约两个月前已在实际中解决 Claude 模型的提示注入问题。其引用推文显示 OpenAI 新模型在提示注入风险上与 Gemini Flash 和 Opus 4.8 大致相当。他呼吁行业投入更多精力训练模型抵抗提示注入,并称将持续评估其他实验室以推动安全对齐。

正文 · 原文

I for one am glad prompt injection is getting solved across the industry and that Astra is not only our most capable, but also our most aligned model to date. But also ...

引用Boris Cherny@bcherny
I am pleased to see that OpenAI’s new model is roughly on par with Gemini Flash and Opus 4.8 on prompt injection risk. Nice work! Evaluating and naming other labs turns out to be a great way to encourage them to train more aligned models. We will continue to do this until other labs pay more attention to safety. This is good for everyone and there is a lot of room left to go! We solved prompt injection in practice for Claude models about two months ago. But prompt injection is a significant security risk no matter what model you use, and it is important that the industry similarly spends more effort to train their models to be resistant to prompt injection, among other elements of model alignment. As models become more capable and central to businesses and economies, the risks only increase. We should be taking them seriously, and doing the right thing for our customers and the world.
在 X 查看被引用的帖子

来源:Tibo · x.com