OpenAI 的 Astra for Law 6.2 在 Harvey LAB-AA v1.1 基准上以 20.8% 的 Hallucination-Gated All-Pass Rate 排名第一,GPT-6.2 Astra(max)以 15.0% 位居第二。
OpenAI leads Harvey LAB-AA v1.1 with Astra for Law 6.2, a specialized GPT-6.2 Astra configuration with an integrated legal search index
OpenAI describes Astra for Law 6.2 as a model configuration of GPT-6.2 Astra that pairs the model with an expanded legal search index and instructions for researching a question, weighing the authorities, and writing the answer.
Our implementation of Harvey’s LAB benchmark tests real-world legal work across 120 private tasks spanning 24 practice areas, penalizing hallucination in its headline metric, Hallucination-Gated All-Pass Rate. Astra for Law leads Harvey LAB-AA v1.1 with a score of 20.8%. GPT-6.2 Astra (max) comes in second with 15.0%.
来源:Artificial Analysis · x.com