AI at Meta· @AIatMeta · X·· 2 小时前AI 评分54
AI 导读
Meta 官方介绍,Muse Spark Open 经优化可在两台 Apple M5 Ultra Mac Studio 上以最新 MLX 框架运行,以提升先进模型的可及性。模型也支持 SGLang、vLLM、TensorRT-LLM、Hugging Face Transformers、llama.cpp 和 Unsloth 等推理引擎,并对 AMD、Apple、Intel 和 NVIDIA 硬件做了优化。开发者还可用 PyTorch(含 TorchTitan)进行微调定制。
正文
To help make advanced models more accessible, Muse Spark Open is optimized to run on two Apple M5 Ultra Mac Studios with the latest MLX framework.
It also runs on leading inference engines like SGLang, vLLM, TensorRT-LLM, Hugging Face Transformers, llama.cpp, and Unsloth with optimizations for AMD, Apple, Intel, and NVIDIA silicon.
Developers can further customize the model with PyTorch, including TorchTitan for fine-tuning.
来源:AI at Meta · x.com