This is exactly the kind of small-model use case we love. No massive GPU, no cloud API, just a 2B model turning an old PC into a useful personal news desk.
Small models don't need to do everything. They just need to do one useful thing reliably. ☕
I wanted to see how useful a small local model could be on my older computer, so I gave @OpenBMB’s MiniCPM5-2B a simple job. The machine: an Intel i5-9400F with...