跳到正文
MiniMax (official)· @MiniMax_AI · X·· 2 小时前AI 评分49
AI 导读

从推理到 RL,第一天就绪。🐰 感谢 SGLang 背后的团队,以及 Miles @sgl_project 与 @NVIDIAAI 和 @AMD,对 MiniMax M3.1 Flash 的支持。合作愉快!

正文 · 原文

From inference to RL, ready from day one. 🐰

Thanks to the teams behind SGLang, and Miles @sgl_project alongside @NVIDIAAI and @AMD, for supporting MiniMax M3.1 Flash. Great building together!

引用SGLang@sgl_project
Space Bunny is here! 🐰 MiniMax M3.1 Flash hits >1K tok/s, bs1 decode with SGLang, production-ready from Day 0. This integration is a joint effort by @MiniMax_AI, @NVIDIAAI, @AMD, and @radixark, and you can also run RL with Miles! -Broad hardware support: NVIDIA Blackwell and Hopper (GB300/B300/B200/H200), plus AMD Instinct MI350X and MI355X. -Agentic serving at scale: ~100K total tok/s per GPU on the AgentX coding-agent trace with 96 concurrent sessions. -Speculative decoding: Supports MiniMax's DSpark draft and a DFlash2 draft trained by @radixark; supports HiCache and multimodal input. -Ultra-low-latency inference: MegaKernels deliver 2.15× faster single-request decode.
在 X 查看被引用的帖子

来源:MiniMax (official) · x.com