Nathan Lambert· @natolambert · X·· 2 小时前AI 评分68
AI 导读
Nathan Lambert 表示 DeepSeek 在单个集群上每日服务 150T token，超过 OpenRouter、Fireworks、Together 和 BaseTen 上开源模型推理量的总和，并引用了 DeepSeek 的 DeepInfer 部署问答文档。他还根据上述公司公布的推理量报告自行重建了一张开源模型推理增长对比图。
正文 · 原文
DeepSeek is serving 150T tokens a day on one cluster, more than the open model inference on OpenRouter, Fireworks, Together, and BaseTen combined.
Below is my reconstruction of various inference volume reports across said companies.
@natolambert right from the horse's mouth ah, right. That's "a single cluster", who knows how many they have https://github.com/deepseek-ai/DeepInfer/blob/main/doc/inference_deployment_qa.md在 X 查看被引用的帖子
来源：Nathan Lambert · x.com