Tianyi Cui· @tianyi · X·· 2 小时前同事件AI 评分70
AI 导读
DeepSeek 开源自研推理框架 DeepInfer,以及 deepseek-recipe 等服务 DeepSeek 模型的关键组件,代码位于 github.com/deepseek-ai/DeepInfer。DeepInfer 已用于大规模支撑 DeepSeek-V4.1-Flash 的高吞吐低延迟推理,官方希望帮助更多企业和机构部署 DeepSeek 模型并从中获利。
同一件事,精选收录的是《DeepSeek 全面开源内部推理框架 DeepInfer》
正文 · 原文
We are releasing DeepInfer, deepseek-recipe, and other vital components for serving DeepSeek models in the hope that more companies and organizations around the world will deploy DeepSeek models and profit from doing so.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4在 X 查看被引用的帖子
来源:Tianyi Cui · x.com