跳到正文
OpenBMB· @OpenBMB · X·· 2 小时前AI 评分35
AI 导读

很高兴看到这些真实场景的对比!💙 感谢你把 MiniCPM5 纳入测试。小模型能走到今天这一步,真令人兴奋!🚀

正文 · 原文

Love seeing these real-world comparisons! 💙 Thanks for including MiniCPM5 in your tests. Exciting to see how far small models have come! 🚀

引用GooGZ AI@PaulGug
Small models are going through a real growth spurt right now. On my personal-agent tests (PA Core, reasoning on, RTX 3080), three models at 2B and under now land within 21 points of each other, and rubbing shoulders with older 4B/9B weights. Newest on the bench: Spark X2.6 1.7B from @SparkLLM - PA total: 172.3/300 - Tool calls: 30/30 in every run - Context recall: 9.3 at 8K, 8.7 at 16K, best of the three! - Schedule and draft (PA2): 98 and 100 in two runs, one 54 pulled the mean to 84 - Daily organization (PA1): 35.7, the weak spot Under 2B, three different strengths. @liquidai LFM3 plans, @SparkLLM Spark reads, @OpenBMB MiniCPM5 is the balanced one. Leave thinking on. With it off, Spark is a much weaker model on these tasks.
在 X 查看被引用的帖子

来源:OpenBMB · x.com