On-device personal agent, running locally on a MacBook Air M2 (16GB). @PaulGugAI put MiniCPM5-2B behind Hermes Agent — 96k context, 20–24 tok/s, and solid tool calling for everyday tasks. Not a giant SaaS replacement. Just a fast local model that punches above its weight and runs on almost anything. This is the edge setup we wanted. ⚡🙌
This is my MacBook Air M2 (16GB) with Hermes Agent powered by MiniCPM5-2B. 96k context, and a very respectable output of 20-24 tok/s. This is totally usable, an...