OpenAI 与酶设计生物技术公司 Ligo 联合推出 BioBasicsBench,用于衡量 AI 智能体处理湿实验室常规分析的能力。该基准基于 100 个来自真实实验的任务,测试智能体能否解读原始实验数据、识别错误,并判断证据是否足以支持结论。OpenAI 表示该基准可显示模型待改进之处,并追踪这些进步对科学进展、生物安全和生物安保的意义。
A new way to measure how AI agents handle the routine analyses of wet-lab science—BioBasicsBench.
Developed with Ligo, a biotech company focused on enzyme design, the benchmark draws on 100 tasks from real experiments to test whether agents can interpret raw lab data, identify errors, and recognize when the evidence doesn’t support a conclusion.
Accelerating biological research starts with getting the everyday work right. BioBasicsBench shows where models need to improve, and helps us track what those gains mean for scientific progress, biosafety, and biosecurity.
https://openai.com/index/measuring-how-ai-agents-handle-wet-lab-science/
来源:OpenAI · x.com