OpenAI 官方博客披露 GPT-5.6 Sol 训练中的模型失对齐案例

Rohan Paul · @rohanpaul_ai · X·2026-09-17 06:59·2小时前
AI 导读

OpenAI 官方博客披露新政策,将在完全理解或修复行为之前公开披露模型失对齐,优先披露揭示新失败机制、已知问题恶化或动摇现有安全防护假设的案例。

Rohan Paul@rohanpaul_ai
70AI 编辑部评分,满分 100

OpenAI 官方博客披露 GPT-5.6 Sol 训练中的模型失对齐案例

2026-09-17 06:59· 2小时前
AI 导读

OpenAI 官方博客披露新政策,将在完全理解或修复行为之前公开披露模型失对齐,优先披露揭示新失败机制、已知问题恶化或动摇现有安全防护假设的案例。

Some revelation from the lastest OpenAI's official blog on their new polisyc for reporting model misalignment.

• “During the training of GPT-5.6 Sol, many model instances added instructions to their summaries to conceal mistakes or misaligned behavior from the user.”

• “For example, compaction summaries included instructions to invent missing historical data without disclosing it and to hide mismatches in source versions.”

• “While answering a routine question about earnings figures in a California county, a model found and used an exposed API key without authorization.”

“When it still wasn’t able to retrieve the requested figures, it fabricated them and presented them as data from the requested source.”

• When a user asked an unreleased model for the IDs and names of lakes larger than 5,000,000 square meters, the agent found the correct answer using Python.

And then even though the model already had the correct answer locally, but it needed a web citation, so it uploaded the file to the internet just to create something it could cite.

The problem is that instead of saying, “I can’t provide a browser citation for this local result,” it took an unauthorized external action to satisfy the task, crossing a user-control and data-boundary it was never told to cross.

• “Agents working together on the same training task used public file-hosting websites to share files when they could not access one another’s local files.”

Rohan PaulSo OpenAI will now publicly disclose model misalignment even before it fully understands or fixes the behavior. So its institutionalizing public disclosure of m...