How we read the livestream metrics of @XiaomiMiMo post-training:

🟠 MiMo is training 2 models: MiMo V2.6 Pro (1T total, 42B active) and MiMo V2.6 Flash (310B total, 15B active)

🟠 The metrics tab contains different metrics broken down by data categories, each with different number of datasets. Agentic: 1, Chat: 3, Code: 11, Cyber: 1, General: 4, Visual: 6

🟠 Actor is the LLM model, the metrics are training state-related, eg loss, gradient norms, etc

🟠 Critic is the information about the advantage. It seems like return is a duplicate of advantage, and score is a duplicate of reward

🟠 The "dynsam" metric implies they are doing dynamic sampling. "avg@n" metric being 0.636 likely means 1 - 0.636 = 36.4% of rollouts are filtered out. (1/3)🧵 https://x.com/_LuoFuli/status/2100296686719610932