#端侧

MiniCPM-V 4.7 is now open source on ModelScope: a 35B-A3B MoE multimodal model built to run on-device without compromising performance. Apache 2.0. 🤖 https://modelscope.ai/collections/OpenBMB/MiniCPM-V-47 📱 First open-source MoE with smooth, lossless on-device inference, running at 13+ tokens/s on iPhone 17 Pro Max. 🔥 New Pareto frontier: in Instruct mode, it reaches a higher overall score in less inference time than Qwen3.6 35B-A3B. ⚡ Mixed 4x/16x visual token compression lets developers balance visual detail and inference cost per task. 🛠️ Two sizes (35B-A3B and 1B) with FP8, GPTQ, AWQ, BNB, and GGUF variants. Works with SGLang, vLLM, llama.cpp, Ollama, SWIFT, and LLaMA-Factory. 💻 Runs on iOS, Android, and HarmonyOS, with day-0 support for Rockchip, Houmo, Intel, AMD, and Arm.

🚀 Tiny model, big test: MiniCPM-V 4.7 1B, hands-on 📱 A one billion parameter vision model that fits on a phone 🔹 Installed the GGUF with llama.cpp and Ollama 🔹 Read an analog clock from a photo 🔹 Turned that clock photo into working HTML code 🔹 Solved a quadratic from a school math sheet 🔹 Handwriting translation across dozens of languages 🔹 Funny scene test: spotting body language and backstory 🔥 Honest results, wins and fails, in the full video below 👇 https://youtu.be/40FXBcRz4_k?si=UGnvZNh0AN5f4aDL @OpenBMB

🎬 35B MoE multimodal AI. On your phone. With just 3GB of memory. 🤯 This is MiniCPM-V 4.7 in action: reading real-world signs, planning around constraints, parsing complex documents, and reasoning over visual data. Powered by LES (Lookahead Expert Scheduling), the 35B-A3B model brings efficient MoE inference to mobile devices, while the lightweight 1B variant delivers capable multimodal understanding on resource-constrained hardware. 🛠️ With Self-Replay Fine-Tuning (SRFT), developers can customize models for new tasks while maintaining general performance. From iOS to Android, MiniCPM-V 4.7 makes powerful multimodal AI more practical to run locally. Try it 👇 🔗 http://github.com/OpenBMB/MiniCPM-V 🤗 http://huggingface.co/collections/openbmb/minicpm-v-47 Self-Replay Fine-Tuning: http://openbmb.cn/en/blog/self-replay-fine-tuning

Let's start the week with MiniCPM V4.7 from @OpenBMB 🔥 ✨ 35B-A3B: On-device MoE - 35B/ 3B active ⚡️ - 13+ tok/s on iPhone 17 Pro Max with ~3GB RAM - Outperforms Qwen3.6 35B-A3B in overall score AND inference time ✨1B: Ultra-lightweight VLM - Outperforms Qwen3.5 0.8B in BOTH performance & efficiency ✨ Both support: - Image, multi-image & video understanding - Efficient 4×/16× visual token compression - iOS, Android & HarmonyOS - Apache 2.0

Qualcomm CEO reveals AI companies want phones running 100-billion-parameter models continuously by 2028--and confirms some are building phones Cristiano Amon: “I have to be careful not to disclose names, but some AI companies—some of the companies at the forefront of AI—are telling Qualcomm, ‘By 2028, I need to make sure that I have the ability to run at least a 100-billion-parameter model in a phone, and I need to have this thing running kind of all the time.’” Alex Heath: “So you’re saying there are AI companies that are talking about—” Cristiano Amon: “Well, AI companies are starting to do phones.”