METR had a separate team with deeper access to Anthropic’s internal AI R&D data. That team shared its conclusions with the public-assessment team, but not the supporting evidence or reasoning behind them.
• from Claude Opus 5.5 system card.
i.e. part of the public assessment of Anthropic's AI-driven R&D acceleration rests on evidence outsiders, and, in this particular case, even another METR team, could not independently inspect.
Some revelation from the Claude Opus 5.5 system card. - Giving Opus 5.5 more reasoning effort made it more likely to obey malicious instructions hidden inside u...