跳到正文
StepFun· @StepFun_ai · X·· 2026-07-25AI 评分35
AI 导读

阶跃星辰与vLLM团队、蚂蚁集团、FastAFD联合发布vLLM AFD Plugin,这是一个vllm-project下的实验性插件,为MoE推理引入Attention-FFN解耦(AFD)。AFD将注意力与专家/FFN路径作为独立服务运行,支持两者独立扩缩,且无需fork即可在NVIDIA GPU和昇腾NPU上使用。

正文 · 原文

Proud to be part of this collaboration! 🎉 Huge thanks to the vLLM team, Ant Group, and FastAFD. Excited to bring AFD to the open-source community.

引用vLLM@vllm_project
🎉 Congrats to the teams behind vLLM AFD Plugin (Ascend & vLLM, @StepFun_ai, @AntGroup, FastAFD): a new experimental plugin under vllm-project that brings Attention-FFN Disaggregation to MoE serving. Attention and the expert/FFN path are two very different workloads that normally share one topology. AFD runs them as separate services, so you can scale attention and experts independently. Same vLLM serving surface, no fork. @NVIDIA GPU and Ascend NPU.
在 X 查看被引用的帖子

来源:StepFun · x.com