面壁智能 MiniCPM-V 4.6 演示工业仪表读取,模型需同时理解指针角度、刻度范围、单位、数字显示、液位比例等视觉信号,输出结构化 JSON(pressure_bar, temp_c, flow_lpm, level_pct)。测试使用合成控制面板,评分标准为 pass(满量程5%内)、drift(10%内)、miss。数字显示和液位较易,模拟指针更困难。该方案通过摄像头+视觉模型低成本改造传统仪表,无需更换硬件,在工厂、数据中心等场景有巨大应用潜力。
Really impressive “gauge reader” demo by @aijoey MiniCPM-V 4.6 👀
What makes this interesting is that it goes far beyond OCR:
The model needs to understand multiple visual signals at once, including pointer angles, scale ranges, units, value mapping, digital displays, and liquid level proportions, often within the same scene.💥
This demonstrates strong visual reasoning ability, not just text reading 🧠
Even more importantly, the real-world setup matters here. Many factories, data centers, labs, and energy systems still rely on traditional gauges and legacy panels.👍In the industrial automation field, this will have huge application scenarios. Relying on MiniCPM‑V 4.6’s structured output and powerful multimodal capabilities, many traditional instruments without sensors can be retrofitted at low cost using this solution.
🔥Instead of replacing hardware or installing new sensors, this demo shows a practical path where cameras and vision models turn existing equipment into readable, recordable, and alarm-ready data sources.
Big thanks to Joey for this great demo 🤝
been testing MiniCPM-V 4.6 locally on my DGX Spark this demo is an industrial gauge reader i generated a synthetic control panel with a pressure gauge, temperature gauge, flow display, and tank level bar. because the panel is synthetic, i know the exact ground truth at every frame. MiniCPM gets a frame and has to return structured JSON: pressure_bar temp_c flow_lpm level_pct then i score each reading live: pass = within 5% of full scale drift = within 10% miss = outside that the scenario i was targeting is industrial visual ops. lots of real systems still have gauges, panels, status screens, meters, and legacy interfaces. i wanted to see if a small open source vision model could read that kind of interface and return values another system could actually use. what i saw in practice: digital displays and tank level were easier. analog gauges were harder, especially between tick marks or while moving. but the important part is that the output is measurable. it is not just a captioning demo. MiniCPM-V 4.6 had to read pixels, follow a schema, and produce structured data i could check against ground truth.在 X 查看被引用的帖子
来源:OpenBMB · x.com