AI research agents combine prior knowledge, public sources, and experimental feedback to produce useful results. The Discovery Certification Protocol (DCP) turns claims about these results into executable recovery and feedback tests. Gate 1 validates useful improvement on sealed evaluation. Gate 2 gives matched agents the registered starting information and observed Web content while withholding the target research history. Every valid method reaching the numerical target supplies a recovery witness and triggers the Core veto. DCP Core requires adequate controls, zero observed recoveries, and a finite-sample bound on recovery in one fresh registered episode. Optional Gate 3 measures the average effect of truthful feedback relative to a specified neutral policy from a shared checkpoint. DCP Evidence adds this effect after independent null calibration and a registered effect margin. Two controlled audits exercise the complete protocol in SQLite optimization and virtual catalyst control under different models. Each produced zero recoveries in 96 episodes, with an upper bound of 0.0468. Each paired study yielded 30 truthful recoveries and zero neutral recoveries, with passing 60-pair null studies. Additional cases exercise Core, recovered, and audit-incomplete decisions. A deterministic, LLM-free verifier reproduces the decisions from frozen evidence. DCP provides a common evidence language for useful outcomes, alternative routes, and feedback effects across AI research.
DCP:审计 AI 研究智能体的发现认证协议
AI 导读
针对 AI 研究智能体的发现认证协议 DCP 提出,通过可执行的复现与反馈测试把研究结论转化为可验证证据。在 SQLite 优化与虚拟催化剂控制两项审计中,96 个 episode 均实现零复现,复现率上界为 0.0468;配对研究各得到 30 次真实反馈复现与 0 次中性复现,并通过 60 对零假设校准。DCP 为有用结果、替代路径与反馈效应提供统一的证据语言。
HuggingFace Daily Papers(社区热门论文)
43
AI 编辑部评分,满分 100DCP:审计 AI 研究智能体的发现认证协议
针对 AI 研究智能体的发现认证协议 DCP 提出,通过可执行的复现与反馈测试把研究结论转化为可验证证据。在 SQLite 优化与虚拟催化剂控制两项审计中,96 个 episode 均实现零复现,复现率上界为 0.0468;配对研究各得到 30 次真实反馈复现与 0 次中性复现,并通过 60 对零假设校准。DCP 为有用结果、替代路径与反馈效应提供统一的证据语言。
原文 · 保持原样,未翻译原文 · 未翻译
来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org