Meta 在 Hugging Face 开源 816B 参数模型 Muse Spark Open 权重,面向编码和智能体任务,与闭源 Muse Spark 1.3 共享同一基座,仅额外做了抵御滥用的安全后训练,逆转其 4 月起的闭源权重策略。
同一件事,精选收录的是《Meta 发布开源权重模型 Muse Spark Open,816B 参数、1M 上下文》
Meta released the weights of Muse Spark Open, on Huggingface, an 816B-parameter model built for coding and agentic work.
The open version shares the same base model as Muse Spark 1.3, with additional safety post-training to resist misuse as a standalone model without system guardrails, reversing Meta’s first proprietary, closed-weight frontier model strategy from April.
Each of its 62 layers holds 256 expert networks and routes every token through 8, so deployment needs the memory of an 816B-parameter model but runs at the speed of a 42B model.
That storage bill explains the Apple tie-up, because the M5 Ultra pushes 1.2 TB/s of unified memory and a Mac Studio can carry up to 512GB.
A 3-bit quant tested on a 512GB M3 Ultra took about 344 GB and ran at about 21 tok/s generation on a short prompt.
Muse Spark Open -- weights releasing today -- runs great on new Mac Studios thanks to work with @johnternus and Apple.在 X 查看被引用的帖子
来源:Rohan Paul · x.com