OpenRouter 推出 Jev Router,为每次 LLM 调用自动选择模型和推理力度

elvis · @omarsar0 · X·2026-09-26 23:51·2小时前
AI 导读

Jev 现以 typesafe/jev-router 形式打包上线,OpenRouter 会为每个请求自动选择模型和推理力度。作者用 Pi SDK 构建的支持智能体测试,同一 8 个案例对比固定 GPT-6 Sol 基线共 32 次真实调用,两者全部答对,路由成本低一半以上($0.008 vs $0.018),中位响应时间也更短(1.5s vs 1.9s)。

elvis@omarsar0
52AI 编辑部评分,满分 100

OpenRouter 推出 Jev Router,为每次 LLM 调用自动选择模型和推理力度

2026-09-26 23:51· 2小时前
AI 导读

Jev 现以 typesafe/jev-router 形式打包上线,OpenRouter 会为每个请求自动选择模型和推理力度。作者用 Pi SDK 构建的支持智能体测试,同一 8 个案例对比固定 GPT-6 Sol 基线共 32 次真实调用,两者全部答对,路由成本低一半以上($0.008 vs $0.018),中位响应时间也更短(1.5s vs 1.9s)。

This is one of the strongest use cases I've seen for System One models like Jev.

Pay close attention if you build custom harnesses.

Jev is now available as a packaged router.

What is it?

You send the conversation to typesafe/jev-router, and OpenRouter picks the model and reasoning effort for each request.

Choosing the right model and reasoning effort is an art, and doing it manually is inefficient, to say the least.

It makes sense to offload reasoning effort, but you want to do it efficiently, smartly, and cheaply. System One Models like Jev are a great fit for this.

Does it work?

I tested Jev Router on a small support agent built with a custom harness I built with the Pi SDK.

I ran the same 8 cases against a fixed GPT-6 Sol baseline, 32 real calls in total.

Both got every case right.

The router cost less than half as much ($0.008 vs $0.018) and had a lower median response time (1.5s vs 1.9s).

The sample is small, but it's clear that, at scale, this could make a huge difference in cost and efficiency.

One of my biggest concerns about Jev-as-a-Router is caching. While it's not fully solved, Jev Router gives me hope for smarter, more efficient routing patterns in custom harnesses that leads to better tradeoffs.

I have shared an implementation of a routing pattern I'm excited about here: https://academy.dair.ai/resources/jev-decisions-in-a-pi-sdk-harness

The takeaway here is that Jev is unlocking interesting new patterns (routing, verification, guardrails, dynamic workflows, judges, and more) that you can tap into in your custom harness.

I expect this trend to continue growing. And harnesses that are easier to customize, like Pi, will benefit even more.

TypeSafe AIYou've never routed like this before. @OpenRouter is bringing Jev to all of your LLM calls, so your agentic workflows never have to waste a token again. As alwa...