跳到正文
Artificial Analysis· @ArtificialAnlys · X·· 1 小时前AI 评分56
AI 导读

Artificial Analysis 发布 Keenable Search 1.0 的搜索基准结果,pro 模式以 83 分居 Artificial Analysis Search Index 第一,realtime 以 82 分第二,领先 Exa(auto, dynamic highlights)和 Perplexity(medium)的 80 分。

正文 · 原文

Keenable Search 1.0 takes 1st (pro, 83) and 2nd (realtime, 82) on the Artificial Analysis Search Index: ahead of Exa (auto, dynamic highlights) and Perplexity (medium) at 80

We benchmarked both modes of @KeenableAI's Keenable Search 1.0, pro and realtime, in our Stirrup agent harness with Keenable Search as its web_search tool to complete 1700 search-focused tasks.

At $4 per 1k searches, Keenable costs about $0.040 per task in both modes, over a third below the board median ($0.063). It is also one of the fastest products we measure: 15.0s (realtime) and 15.5s (pro) per task, 2nd and 3rd on the board.

Key benchmarking results for Keenable Search 1.0:

  • Artificial Analysis Search Index: Keenable (pro) scores 83 and Keenable (realtime) 82, up from 67 for both modes when we first benchmarked Keenable in August, and a ~50-point lift over the same model with no search (33). Both lead Exa (auto, dynamic highlights) and Perplexity (medium) at 80
  • DeepSearchQA is Keenable's strongest benchmark: both modes score 88 F1, 1st and 2nd of 26, ahead of Exa (auto, dynamic highlights) at 86. Pro also ranks 1st on BrowseComp (87%, level with Perplexity (medium)) and on AA-Omniscience (73%, level with Exa (auto, dynamic highlights) and Firecrawl)
  • Fast search: realtime takes 2.3s of search time per task (2nd of 26) and pro 3.0s (3rd), against a board median of 12.5s. Each search returns in about 330ms (realtime) and 390ms (pro) on average

Key details:

  • Setup: GPT-5.6 Luna (medium) in Stirrup, Keenable Search API with mode=realtime and mode=pro
  • Pricing: $4 per 1k requests in both modes (public pay-as-you-go price)
  • Cards: We disabled Keenable's search cards for testing (disable_cards=true)

来源:Artificial Analysis · x.com