Artificial Analysis 推出 Search Index,在 1700 个任务和 BrowseComp、DeepSearchQA、AA-Omniscience 三个搜索基准上,用同一基础模型和测试框架衡量各 Search API 的性能、成本与延迟。目前 Exa (auto) 和 Perplexity (medium) 领先,最好成绩为 80 分。开发者可借此为智能体选择搜索工具。
Search is one of the most important tools for agents, and they search very differently to humans. By the end of the year, agents are expected to search the web far more than humans do
The Artificial Analysis Search Index measures the performance, cost and latency of Search APIs across 1700 tasks and three search-specific benchmarks: BrowseComp, DeepSearchQA and AA-Omniscience using the same base model and harness.
Developers can use the Artificial Analysis Search Index to inform their choices when it comes to what search tool their agent should be using. Now you can see who’s #1 while waiting for the bus. Currently Exa (auto) and Perplexity (medium) lead in performances with their best models scoring 80.
来源:Artificial Analysis · x.com