跳到正文
今天10月24日周六3 条
10月22日周四
  1. meng shao72

    Nathan Lambert 在哈佛 CS 2881R 客座讲座整理了开源模型现状全景幻灯片,判断开源模型落后闭源前沿约 3 到 5 个月且差距在缩小。他指出性能、下载量、论文引用三方面中国开源全面领先,美国开源又落后中国 3 到 4 个月;把蒸馏当成核心问题是高估,美国真正持久的优势是算力,前五实验室总算力约为中国前五家的 16 倍,禁止开源只会损害经济活动。

    引用Nathan Lambert@natolambert

    Finally got to put together a complete deck on the state of open models. What they are, licenses, how competitive they are, signs people are using them, distillation's impact, and how we balance the risks and benefits of openness! Will record a video lecture of these soon, and hopefully re-do them a few times a year.

  2. Thomas Wolf53

    Thomas Wolf 称自己对 AGI 的标准仍是 AI 拿诺贝尔奖,但称赞 Recursive_SI 的 Flint 敢于把通常建议保持高精度的 lm_head 量化到 4 bit,结果距 bf16 仅 0.7 个百分点且以开放权重发布在 Hugging Face hub。引用内容介绍 Flint 为快速本地编码模型,MacBook Pro 上 125+ tokens/sec、RTX Spark 上 150+ tokens/sec,从零构建用时不到 4 个月,开放权重现已在 Hugging Face 提供。

    引用Richard Socher@RichardSocher

    Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine. • Best-in-class fast local coding • Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark • Built from scratch in under 4 months Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.

10月21日周三
10月20日周二
10月19日周一
  1. Thomas Wolf48

    Hugging Face Hub 上被二次开发最多的模型不是 Llama 也不是 Qwen。 而是来自德国实验室 Black Forest Labs 的 FLUX.1-dev:4.3 万个衍生模型。 欧洲在 Hub 上训练了约 8% 的开源模型算力,但人们在其之上构建的东西中约 18% 是欧洲的。 自建还是投降?自建,并且开源地建。本周 GTC Berlin 见

    引用Arthur Mensch@arthurmensch

    Should Europe leave frontier AI to the Americans and the Chinese? The idea has gained ground in Europe. It is a fundamental mistake. Build or surrender: for now, the choice is still ours. Full article below. https://x.com/i/article/2110989616249450496

  2. Thomas Wolf40

    下周柏林 GTC 的主要议题之一。 今天我粗略估算的一个数据点:Hub 上约 10 亿美元的开源模型训练算力中,欧洲实验室贡献了约 8%。其中大部分来自 Mistral。 在开源模型上,“自建”这个选项显然仍然摆在桌面上,而且比人们想象的更便宜。

    引用Arthur Mensch@arthurmensch

    Should Europe leave frontier AI to the Americans and the Chinese? The idea has gained ground in Europe. It is a fundamental mistake. Build or surrender: for now, the choice is still ours. Full article below. https://x.com/i/article/2110989616249450496

  3. Thomas Wolf56

    Hugging Face 联创 Thomas Wolf 用 napkin math 估算,Meta、NVIDIA、阿里、DeepSeek、Moonshot、Mistral 等约 35 家机构已在 Hugging Face Hub 免费共享价值近 $1B 的训练算力(按当前 GPU 租用价折算),而 2023 年底这一数字还不到 $40M。估算基于 72 个模型家族的官方算力数字加推断,未计入约 90 万个社区微调,并附可探索数据页面。

    引用Thomas Wolf@Thom_Wolf

    Fun and crazy napkin math: Meta, NVIDIA, Alibaba, DeepSeek, Moonshot, Mistral and ~30 other labs have shared close to $1B worth of training compute on the Hugging Face Hub Free to download End of 2023 it was under $40M Wikipedia was written in volunteer hours. This AI age commons is written in GPU-hours and data (it's a floor btw: about half comes from official compute numbers rest is educated guess and it still miss the ~900k community fine-tunes) Space with data to explore: https://thomwolf-hub-dollars.static.hf.space

10月17日周六
10月16日周五
  1. Nathan Lambert67

    Nathan Lambert 转评 @alexandr_wang 发布的 muse spark open,称其为迄今最强的美国开放权重模型:816B 总参数、42B 激活、1M token 上下文、原生多模态,面向编码和长程任务等智能体工作。他认为若实际表现与跑分相符,该模型采用率将暴涨,是美国首个具备接近前沿智能体能力的开放权重模型,并提到此前 GLM 5.2 与 Kimi K3 代表了中国模型的那次跃升。

    引用Alexandr Wang@alexandr_wang

    1/ muse spark open is the most capable US open-weight model to date. 816B total params, 42B active. 1M-token context. natively multimodal. built for coding and agentic work like long-horizon tasks, hard software engineering, multi-step reasoning. america! 🇺🇲

10月15日周四
  1. Nathan Lambert54

    Nathan Lambert 发推预告自己参加 a16z 播客(与 Lisha Li 对谈),讨论开源模型如何影响 RSI 动态、开源模型的价值由谁捕获、agent swarm 的驾驭问题,以及他创办 Trillium Labs 的原因。引用块补充了部分观点:他认为中国实验室人才不缺但算力不足,蒸馏的优势约为几个月,前沿进展很大程度依赖购买数据和 RL 环境,Trillium 将开源这些环境并展示团队如何用 AI 构建 AI。

    引用a16z@a16z

    Nathan Lambert, former post-training co-lead at the Allen Institute for AI, now launching Trillium, a nonprofit open AI lab, joins a16z's Lisha Li to discuss whether open models can really keep up with the frontier. When he tells researchers in China that an average OpenAI researcher reportedly has five thousand H100s to work with, "their jaw just falls to the floor." In his view, Chinese labs have the talent but are mostly short on compute. He also thinks the distillation story is overblown. Based on the research, he puts its edge at a few months, and says "there's a bit of cope" in thinking only American labs can build good models. A lot of frontier progress outside math and code comes down to labs buying 1) data and 2) RL environments. It's a multibillion-dollar market, and some of it is sloppy enough to teach models to reward hack. That's a big part of why Trillium exists. Nathan wants to give away the environments other people would sell, and show exactly how his team uses AI to build AI, including where the models still get stuck. His bet is that the more people can see how this works, the better prepared everyone is for what's coming. 0:55 Can open models keep up with the frontier? 2:05 What it takes to reach the frontier 3:55 Open weights and the fast-follower playbook 8:25 Chinese labs: equal talent, less compute 9:55 Why distillation is harder than it looks 14:55 Is distillation theft or competition? 16:20 The lab flywheel vs owning your weights 21:45 Can general models beat every specialist? 26:30 AI at 1% of today's cost in 4 years 27:15 The RL env boom and reward hacking 31:30 What Trillium will build in the open 35:30 Breaking into AI in the age of AI slop 38:05 Open-sourcing how AI builds AI 44:25 Why Nathan isn't pre-training 49:45 Agent swarms and why lab secrets leak 54:25 Fast takeoff vs risks already here YouTube: https://youtu.be/BKuK0M6oDTI @natolambert @trillium_labs @lishali88

10月14日周三
  1. Nathan Lambert40

    我们方法论中一个已被修复的缺口——此前未纳入本地模型(GGUF、AWQ、ONNX 等)——曾导致数据呈现下滑。早前这些模型远更难追踪,接近舍入误差。如今它们正在激增。我们已更新流水线来追踪这些模型!

    引用Nathan Lambert@natolambert

    We've been monitoring a decline in HuggingFace downloads across the top open LLMs we track for interconnects. It looks like there was a slight change in counting of downloads, as we saw a ~30% download rate drop for many top models, but this is continuing over time. What else do people think it may be?

10月13日周二
  1. Thomas Wolf29

    开放且最先进的决策模型——就这么一说

    引用Victor M@victormustar

    Decision 3.0 hype is real! it is the top performer in my little apple-harvesting test. It can actually play: read the scene, pick its own moves and collect apples without a pathfinding controller. Input: a screenshot of its surroundings, game stats and a short memory of its last four moves. It chooses up/down/left/right each turn. This run: 7 apples in 38 moves, zero damage 🔥

  2. clem 🤗37

    如果你是研究者,请考虑公开分享你的 RL 环境!你为某个实验构建的东西,可能帮助整个领域向前推进。 我知道在美国前沿实验室共享正处在黑暗时期,但我相信这能对领域和世界产生巨大影响!

    引用Naveen@NaveenKumar__T

    This is how open source should work. A closed lab publishes research, and within days the community turns it into training environments anyone can use. Early and rough, as Clem says, but the direction is lovely. #OpenSource #AI

10月12日周一
  1. IT之家·人工智能36

    英特尔 CEO 陈立武:DeepSeek、Kimi、GLM 等中国前沿 AI 模型普及速度非常快

    英特尔 CEO 陈立武表示,DeepSeek、Kimi 和 GLM 等中国前沿 AI 模型的 Token 成本较低,普及速度非常快,性能已经足够好。他坚定支持开源,认为这是提高效率的最优路径,并称市场将决定不同模型的应用场景。他还表示量子计算可能在未来三到五年内走向主流。

  2. 数字生命卡兹克67

    数字生命卡兹克撰文分析AI驱动逆向工程热潮:开发者Brandon Thomas因不满Adobe订阅规则,用Claude Opus 5.5以Rust逆向重写了Photoshop、Illustrator等7款软件的开源替代品PhotoCraft、VectorCraft等,不到10天单PS项目获4.6万Star。

    推荐理由:文章以ArtCraft开源Adobe逆向项目为切口,分析AI如何大幅降低逆向工程成本,并追问原创软件在复制时代的护城河问题。

  3. 公众号:数字生命卡兹克66

    AI逆向一切:Brandon Thomas用Claude Opus 5.5重写Adobe七款软件开源,REA项目逼近10万Star

    开发者Brandon Thomas因不满Adobe订阅违约金,用Claude Opus 5.5以Rust逆向重写了Photoshop等7款Adobe软件并开源,其中PS项目不到10天获4.6万Star。

    推荐理由:作者从Brandon Thomas用Claude Opus 5.5逆向重写Adobe全家桶和REA项目爆火出发,解释净室设计与反编译两条逆向路线,并讨论软件护城河消解后的原创困境。

10月11日周日
10月9日周五
10月8日周四
  1. IT之家·人工智能40

    阿里巴巴蔡崇信:开源是欧洲发展 AI 的最佳选择

    阿里巴巴集团董事会主席蔡崇信在意大利都灵 Wave by Vento 大会上表示,欧洲要摆脱对中美技术的依赖,最佳选择是开源 AI,并呼吁欧洲建设自己的算力基础设施,在本土训练和运行模型。他认为欧洲应利用专有工业数据训练模型形成优势,并看好当地专注 AI 芯片数据中心的新型云服务商。

10月7日周三
  1. Simon Willison 博客44

    Simon Willison 评 EmbeddingGemma 2:Apache 2.0 许可对嵌入模型至关重要

    Simon Willison 评论 EmbeddingGemma 2 采用 Apache 2.0 许可,认为嵌入模型不应使用闭源托管方案。他指出嵌入模型通常需计算并存储数千乃至数百万条向量,一旦厂商停供,用户需为重新计算存量向量付费;2024 年 4 月 OpenAI 曾提出承担用户用新模型重新嵌入内容的费用,但他认为不能指望所有供应商都如此。

  2. clem 🤗63

    Mistral 发布 Mistral Large 4(Le Chonk),1T 参数、原生多模态、49B 激活,称其为美欧最佳开源权重模型,API 已可用,开放权重 10 月底发布。Hugging Face CEO Clément Delangue 转发并指出,在权重尚未开放之前不能自称最佳开源权重模型,并附上 Hugging Face 页面链接。

    引用Mistral AI@MistralAI

    认识一下 Mistral Large 4,又名 Le Chonk。 • 1T 参数,原生多模态。49B 激活。 在综合基准测试中,它是来自美国或欧洲的最佳开放权重模型。 • 在关键工作负载上达到最先进水平,包括网络防御、制造业和金融,并且在视觉定位方面超越了闭源前沿模型。 • 端到端在欧洲打造,并可通过我们自己的 Mistral Cloud 基础设施从欧洲部署。 • 今天即可通过 API 向所有人开放。正与网络安全合作伙伴私下合作。 开放权重版本将于十月底发布。