Nathan Lambert· @natolambert · X·· 2 小时前AI 评分67
AI 导读
DeepSeek 宣布开源自研推理框架 DeepInfer,该框架以高吞吐、低延迟支撑 DeepSeek-V4.1-Flash 的规模化运行,代码见 github.com/deepseek-ai/DeepInfer。Nathan Lambert 转评称这是获取模型采用的独特方式,并指出发布时机恰逢美国政府刚在联邦机构禁用 DeepSeek,颇为讽刺。
正文 · 原文
This is really a wild way to get adoption on your models.
Really great for the community, and the timing is hilarious given the govt just banned deepseek in federal agencies.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4在 X 查看被引用的帖子
来源:Nathan Lambert · x.com