跳到正文
OpenBMB· @OpenBMB · X·· 5 小时前AI 评分41
AI 导读

太惊人了!🤯 MiniCPM-V 4.7 在 Jetson AGX Orin 上本地运行视觉和机器人规划,令人兴奋。出色的优化工作,迫不及待想看到你的引擎!🚀💙

正文 · 原文

This is incredible! 🤯 MiniCPM-V 4.7 running vision and robot planning locally on a Jetson AGX Orin is exciting. Amazing optimization work, and can't wait to see your engine! 🚀💙

引用Cruz@ViC305

🤖 𝗝𝗘𝗧𝗦𝗢𝗡 𝗢𝗥𝗜𝗡 𝗔𝗚𝗫 𝗢𝗪𝗡𝗘𝗥𝗦 𝗥𝗘𝗝𝗢𝗜𝗖𝗘! 𝗜 𝗴𝗼𝘁 𝗠𝗶𝗻𝗶𝗖𝗣𝗠-𝗩 𝟰.𝟳 𝟯𝟱𝗕-𝗔𝟯𝗕 𝘁𝗼 𝗿𝘂𝗻 𝗮𝘁 𝟭𝟳𝟵 𝘁𝗼𝗸/𝘀 𝗱𝗲𝗰𝗼𝗱𝗲 𝗮𝗻𝗱 𝟭,𝟲𝟰𝟭 𝘁𝗼𝗸/𝘀 𝗽𝗿𝗲𝗳𝗶𝗹𝗹 𝗼𝗻 𝗮 𝟲𝟰𝗚𝗕 𝗝𝗲𝘁𝘀𝗼𝗻 𝗔𝗚𝗫 𝗢𝗿𝗶𝗻! 𝗪𝗜𝗧𝗛 𝗩𝗜𝗦𝗜𝗢𝗡!! 🤯

One run, three jobs:

Prefill: 1,641.6 tok/s on a 3.8K token prompt in 2.31s at 50W

Image analysis: a 1672x941 park camera frame through the 8-bit vision tower. 883ms to first token, 82.7 tok/s. It got the dog, the bench, the backpack, the bike, the tulips.

Robot wheel-control plan: 179 tok/s at 45W, with 91.8% of dSparK draft tokens accepted. Asked it to drive 2m at 0.8m/s, pause for a crosswalk, turn 90 left, drive 1.5m to the dock. The JSON durations and turn rate it spit out actually check out!!

Jetson boards were built for robots, and now one can see a scene and plan the moves locally at robot-friendly wattage. Big step in the right direction for robotics 🚀

My SAGE EXL3 3.74bpw quant on the stealth engine I'm building with @mr_r0b0t. Decode is greedy with speculative decoding, so open-ended chat lands lower at about 108 tok/s. Engine to be released soon 👀

Congrats @OpenBMB. @NVIDIAAI @NVIDIARobotics this one's for the Orin crowd 🫡

huggingface.co/vcruz305/MiniC…

在 X 查看被引用的帖子

来源:OpenBMB · x.com