StepFun· @StepFun_ai · X·· 4 小时前AI 评分62
AI 导读
阶跃星辰宣布 Step 5 Preview 支持多种部署方式，可通过 vLLM 或 SGLang 提供 OpenAI 兼容 API，也可用 Transformers 离线推理，并适配多种芯片平台和推理框架。
正文
Run it your way:
- Serve an OpenAI-compatible API with vLLM or SGLang
- Run offline inference with Transformers
- Adapted for multiple chip platforms and inference frameworks
Day-0 support from @NVIDIAAI:
try it on https://build.nvidia.com/stepfun-ai/step-5-preview,
fine-tune with NeMo AutoModel https://github.com/NVIDIA-NeMo/Automodel/blob/main/docs/model-coverage/llm/stepfun-ai/step-5-preview.mdx,
deploy with model-free NIM https://catalog.ngc.nvidia.com/orgs/nim/nvidia/containers/vllm-model-free-nim-experimental,
and run on Blackwell.
Also available on Day 0 with @FireworksAI_HQ, @togethercompute, @modal, @DeepInfra and @FeatherlessAI.
来源：StepFun · x.com