Octen Search debuts third on the Artificial Analysis Search Index with a score of 77, achieving the fastest Time per Task at 16.9 seconds and one of the lowest Costs per Task

We benchmarked Octen Search from @OctenAI using our search agent methodology: a fixed base model running inside our open-source agent harness, Stirrup, with tools for searching and fetching pages from the web. Only the provider behind the search tool changes.

Key results of Octen Search with highlights enabled:

➤ Strong Search Index performance, led by BrowseComp: Octen Search scores 77 on the Artificial Analysis Search Index, placing third behind Perplexity Search (medium, 80) and Perplexity Search (high, 79), and level with Perplexity Search (low, 77). Octen performs particularly well on BrowseComp, scoring 86, just one point behind the leader. It also scores within one point of the leaders on DeepSearchQA at 80, while its AA-Omniscience score of 66 trails Firecrawl Search (73) and Perplexity Search (medium, 72)

➤ Fastest search across providers: Octen Search averages 0.2 seconds per query, 5x faster than the Perplexity Search variants at 1.0 to 1.2 seconds. Its Time per Task is 16.9 seconds, the lowest of any provider result, against a board range of 16.9 to 62.9 seconds

➤ Low Cost per Task: Octen Search costs $0.058 per Search Index task at a price of $1 per 1k search queries. Only TinyFish Search, which offers search for free, has a lower Cost per Task. For comparison, Perplexity Search (medium) costs $0.091 per task