跳到正文
Tianyi Cui· @tianyi · X·· 2 小时前同事件AI 评分70
AI 导读

DeepSeek 开源自研推理框架 DeepInfer,以及 deepseek-recipe 等服务 DeepSeek 模型的关键组件,代码位于 github.com/deepseek-ai/DeepInfer。DeepInfer 已用于大规模支撑 DeepSeek-V4.1-Flash 的高吞吐低延迟推理,官方希望帮助更多企业和机构部署 DeepSeek 模型并从中获利。

同一件事,精选收录的是《DeepSeek 全面开源内部推理框架 DeepInfer》

正文 · 原文

We are releasing DeepInfer, deepseek-recipe, and other vital components for serving DeepSeek models in the hope that more companies and organizations around the world will deploy DeepSeek models and profit from doing so.

引用DeepSeek@deepseek_ai
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4
在 X 查看被引用的帖子

来源:Tianyi Cui · x.com