跳到正文
OpenBMB· @OpenBMB · X·· 2 小时前AI 评分38
AI 导读

面壁智能 MiniCPM-V 4.7(1B 与 35B-A3B)通过与 Nativ 合作,在 Mac 上实现 Day 0 全端侧推理支持,可处理图像与视频理解,数据完全留在本地。

正文

🚀 MiniCPM-V 4.7 is now running on Apple Silicon!
Thanks to our partnership with the @Nativ_AI, MiniCPM-V 4.7 (1B & 35B-A3B) now has Day 0 support for fully on-device inference on Mac.

With Nativ, you can run:
🧠 MiniCPM-V 4.7-35B-A3B — 35B capability with efficient inference
⚡ MiniCPM-V 4.7-1B — lightweight vision model for edge devices
📷 Image + video understanding
🔒 Fully local — your data stays on your device

Tested on Apple Silicon with Nativ v0.4.x:
1B: 24K+ prefill tokens/s, 315 tok/s decode
35B-A3B: 4K+ prefill tokens/s, 90 tok/s decode
Bringing powerful multimodal models closer to everyday devices. 🍎
Huge thanks to the Nativ team for making this possible!
🔗 Nativ: https://github.com/Blaizzy/nativ

来源:OpenBMB · x.com