Ant Ling· @AntLingAGI · X·· 4 小时前AI 评分50
AI 导读
蚂蚁百灵发推感谢 SGLang 为 Ling-3.1-flash 提供 day-zero 支持,帮助开发者更高效地部署该模型。SGLang 介绍其为 560B 参数 MoE 混合推理模型、25B 激活、1M 上下文,经 MXFP4 与 block-FP8 量化后权重从约 534GB 降至约 292GB,可在 4 张 Hopper GPU 上运行,并称其在 GDPVal-AA、FrontierSWE、Terminal-Bench 4.0 等 agent、办公与编码任务上表现良好。
正文
Thanks @sgl_project for day-zero support and for helping developers serve Ling-3.1-flash more efficiently! ⚡
SGLang has Day-0 support for Ling-3.1-flash from @AntLingAGI! A 560B MoE hybrid reasoning model, 25B active, 1M context, built for real work: it turns a rough brief into a page, mobile UI, or interactive prototype. ✅ MXFP4 + block-FP8 quantization cuts weights from ~534GB to ~292GB, fitting on 4 Hopper GPUs ✅ Strong on real-world agent, office, and coding tasks, including GDPVal-AA, FrontierSWE, and Terminal-Bench 4.0. Get started with SGLang:在 X 查看被引用的帖子
来源:Ant Ling · x.com