Rohan Paul· @rohanpaul_ai · X·· 22 小时前AI 评分49
OpenAI 发布 MedChemBench 药物化学基准
AI 导读
OpenAI 发布药物化学基准 MedChemBench,题目取自 117 篇论文与专利,覆盖 761 个分级分子结构,并隐藏研究者后续报告的结果。每个提示停在真实决策点,给出生物靶点、已合成化合物和部分测定结果。最佳模型 GPT-6.2 Astra 总体约 84%,化学结构读取接近满分,但真正关键的决策仅约一半正确。
正文 · 原文
OpenAI has now published MedChemBench, its medicinal chemistry benchmark.
Its problems come from 117 papers and patents, span 761 graded molecular structures, and withhold the results researchers reported later.
Each prompt stops at a real decision point, supplying the biological target, the compounds made so far and selected assay results.
the best model GPT-6.2 Astra gets about 84% overall, is near perfect at reading the chemistry, and is right about half the time on the decision that actually matters.
来源:Rohan Paul · x.com