微软 MAI 宣布 MAI-Base-2 预训练完成，MAI-Base-3 训练周期已在筹备中。MAI-Base-2 在留出评测上超越所有受测开放权重模型，预训练 FLOPs 效率比最强开放基座模型 DeepSeek-V4-Pro-Base 高 4-12 倍，节省的算力被用于训练更大模型。微软称已在 MAI 内部建成 3T 参数级别的 SOTA 预训练基座模型，后训练结果即将公布。
MICROSOFT 🔥: MAI-Base-2 pre-training has been completed; MAI-Base-3 training cycle is already being prepared as well.
"MAI-Base-2 outperforms every open-weight model we tested on our held-out evaluations. It is 4-12x more pre-training FLOPs-efficient than the strongest open base model, DeepSeek-V4-Pro-Base (see Figure 3 below), and we have put that saving into training a larger model."
* Figure 1 shows the performance of MAI-Base-2 and other models with at least one trillion total parameters across a range of pre-training evaluations (lower is better).
We now have state-of-the-art pre-trained base models in the 3T-parameter weight class, built entirely in-house at MAI. Post-training results coming soon -- stay tuned! Lots of details in our technical blog post. https://microsoft.ai/news/frontier-pre-training-at-microsoft-ai/在 X 查看被引用的帖子
来源：🚨 AI News | TestingCatalog · x.com