跳到正文
OpenBMB· @OpenBMB · X·· 2 小时前AI 评分48
AI 导读

很高兴看到 MiniCPM 在 moochy chat 中获得支持!💙 完全本地化的 AI 直接在浏览器中运行,令人兴奋。做得好!🚀

正文 · 原文

Love seeing MiniCPM supported in moochy chat! 💙 Fully local AI right in the browser is exciting. Great work! 🚀

引用sanixdk@sanixdarker

As a continuation to this project, I'm currently working on something fun on top of it.

Introducing moochy chat: a local AI chat that runs entirely in your browser tab(CPU or GPU), meaning you don't need internet connection to use it after model gets downloaded in the browser tab.

got4 is < 54Kb of Web Assembly.
The page first load is 135Kb.

For some models you can go up to 150 tokens per seconds.
No subscription, No API key, 100% free.
For now, faster than WebLLM(@mlc_ai_ ), wllama(@ngxson ) and Transformers.js(@xenovacom) on benchmarks.

Models shipped right now are : @OpenBMB (MiniCPM), @Alibaba_Qwen, @MistralAI, @AIatMeta (Llama), @deepseek_ai, @huggingface (SmolLM)

#LocalLLM #WebGPU #BuildInPublic

在 X 查看被引用的帖子

来源:OpenBMB · x.com