Aravind Srinivas· @AravSrinivas · X·· 2 小时前AI 评分38
AI 导读
Perplexity Decider 在 Vals AI 的 Financial ClaimBench 上达到帕累托最优
正文 · 原文
Perplexity Decider pareto-optimal on Financial ClaimBench of Vals AI
Today we’re releasing ClaimBench, our new benchmark targeted towards decision models. It tests whether a model can tell if a financial document supports, contradicts, or doesn’t address a claim. We evaluated 15 models on 1,960 claims paired with 10-K excerpts, with Decider V1.2 leading the pack of decision models.在 X 查看被引用的帖子
来源:Aravind Srinivas · x.com