跳到正文
Rohan Paul· @rohanpaul_ai · X·· 2 小时前AI 评分45
AI 导读

Agent swarms 把大部分新增 token 用量导向更便宜的模型,agent token 消耗将超过前沿模型的收入。父 agent 负责规划、子 agent 处理搜索文件或跑测试等窄任务,这类任务易验证,可路由给最便宜且能通过的模型。a16z 数据显示 agent 消耗的 token 接近人类的 5 倍、六个月内增长 14 倍,按用户或按席位收费将让位于按量计费。

正文

Agent swarms send most new token volume to cheaper models, so agent token counts will outrun frontier-model revenue.

In a swarm, a parent agent plans while child agents handle narrow jobs like searching files or running tests. Narrow jobs are usually easy to check, so developers can route them to the cheapest model that passes.

And this massive token-explosion is also the major reason, flat-rate and per-seat pricing for AI software will give way to metering, because it relied on human prompting speed to cap usage.
A person sends only so many prompts a day, so vendors could charge per user and still predict inference bills.
But that equation will not hold with agent swarms working 24x7.

引用a16z@a16z
Your next users are machines Agents burn nearly 5x the tokens people do, up 14x in six months
在 X 查看被引用的帖子

来源:Rohan Paul · x.com