跳到正文
7月24日周五
  1. Rohan Paul40

    Limestone Digital团队用2名工程师在3.5个月内重建了FedEx供应商的交付编排平台,而原估计需7-8个月。他们首周未写代码,而是构建了覆盖模块、依赖、数据流和领域术语的全仓库知识图谱(markdown文件),AI智能体据此生成代码,最终约90%的代码由模型编写,122个合并PR均经人工审查。AI计算成本约每名开发者每月200美元,该团队被客户CTO评为公司内“表现最佳的团队”。

    引用Mark Ajzenstadt@mardehaym

    A delivery orchestration platform that supplies FedEx, estimated 7 to 8 months to rebuild their core system. We delivered in 3.5 months with 2 engineers and 122 merged pull requests in the first 90 days. I want to walk through how, because "we used AI and it was faster" doesn't help anyone. Their codebase had real users, real logistics operations, and real consequences if something broke. This is brownfield, not a weekend prototype demo. Week one, we didn't write code. We scanned the entire repo and built a knowledge graph: markdown files documenting every module, dependency, data flow, and domain term. Our agents read that graph before touching anything. Teams skip this constantly. They point an agent at a repo, hand it a ticket, and get code that compiles but misunderstands the architecture. I've seen it across 100+ engagements. When someone says "AI doesn't work on our codebase," they almost always skipped context acquisition. Every ticket ran a six-step loop: define, spec, plan, implement, test, document. The agent handles about 90% of code generation. A senior engineer reviews every PR, and nothing merges unless they can verify it, explain it, and debug it without the agent. We call that the V.U.E. gate. The 50% time reduction came from three things: upfront context eliminated false starts, the agent handled mechanical coding so engineers focused on design and review, and tight spec-to-PR discipline kept scope from drifting. AI compute: about $200 per developer per month. Their CTO called our pod the "top performing team" inside the company. Both engineers got discretionary bonuses, twice. That's what our Velocity Framework was built for.

7月23日周四
  1. 🚨 AI News | TestingCatalog38

    AI/ML API 将 Qwen 3.8 Max 预览版与其他顶级模型对比,测试一次性构建三个 Three.js 3D 场景(战船、特洛伊木马、希腊头盔)。结果显示,Qwen 3.8 Max 完成任务速度显著快于其他模型,且输出质量无明显损失。若定价接近阿里此前旗舰模型,该模型将提供极佳的速度/质量比,适合大规模运行 AI 智能体。

    引用AI/ML API@aimlapi

    We've tested the Qwen 3.8 Max preview and it absolutely rocks! Each scene is built in one shot, a single Three.js file with nothing else added: • Odysseus' war galley riding the waves • Trojan horse • Greek war helmet Qwen managed to execute the task faster than the other models, while output quality is relatively the same across all of them. If the pricing stays close to Alibaba's previous flagships, we'll get one of the best speed/quality ratios on the market — perfect for running agents at scale. Soon live on AI/ML API.

  2. Rohan Paul41

    第三方机构 Agora Media Lab 实测了 OpenAI 未公布的 GPT-Live 端到端延迟。结果显示,其最大提升来自响应一致性:延迟标准差从 489ms 降至 104ms,而中位数响应仅改善 205ms。更低的延迟标准差意味着每次回复的启动时间更可预测,而非偶尔让用户长时间等待。

    引用Agora@AgoraIO

    @OpenAI didn’t publish GPT-Live's end-to-end latency. So Agora Media Lab measured it on an iPhone – with repeatable speech, dual-track waveform recordings, and controlled network impairment. https://www.agora.io/en/blog/openai-didnt-publish-gpt-lives-latency-so-we-measured-it/ #RealTimeAI #VoiceAI

  3. Rohan Paul36

    Meta的Muse Spark 1.1在生成自运行3D街机游戏任务中,以31.3K token、0.026美元的成本击败Gemini 3.6(28.8K token、0.073美元),成本仅为后者三分之一。Muse Spark 1.1完美生成了台球、冰球和桌上足球三款游戏,细节丰富;而Gemini 3.6的冰球出现故障,桌上足球则卡顿成静态画面。

    引用atomic.chat@atomic_chat_hq

    Meta's Muse Spark 1.1 beat Gemini 3.6 at making 3D arcade games for 3x cheaper! We gave two models the same task: build three 3D tabletop games that play themselves Prompts: - An 8-ball pool break scattering the rack - An air hockey rally that ends in a goal - A foosball table where the rods play the ball Outputs: Muse Spark 1.1: 31.3K tokens, $0.026 Gemini 3.6: 28.8K tokens, $0.073 Muse Spark played all three tables clean with far more detail than Gemini, which barely rendered its backgrounds. Its air hockey glitched and its foosball lagged into a buggy still picture. Muse Spark 1.1 ran the full set perfectly for 3x less

7月22日周三
  1. Nathan Lambert50

    Nathan Lambert 宣布其新书《Reinforcement Learning from Human Feedback》正式完成。该书配套提供超过 10 小时的完整课程、幻灯片、训练章节的功能代码及示例模型补全库,并附有免费在线网页版。纸质版订单将在 1-2 周内从 Manning 发货,亚马逊稍晚一周左右。

    引用Nathan Lambert@natolambert

    My book, Reinforcement Learning from Human Feedback is done! This is the book I wish I had when learning to fine-tune, align, & now post-train models since ChatGPT. The resource has been built by me finding time to study and document the fundamentals on nights and weekends since 2024. Transferring as much of the intuitions of building Olmo as I possibly can in the book format. The book is launching with an over 10 hour, full course with slidedecks, functional code for the training chapters, an example model completions library, and of course the free online web version. Physical orders from Manning will ship in 1-2 weeks, and Amazon a week or so after. Thanks for your support!

  2. Tencent Hy37

    腾讯混元Hy3在Agent Arena开源权重模型中排名第五(总榜第25),并在前端代码竞技场位列开源第二(总榜第16)。Hy3在工具使用方面表现突出,能从CLI/bash错误中良好恢复(+2.6%,第25名),但可操控性是其最大短板(-7.1%,第30名)。Agent Arena基于数百万真实世界长周期智能体任务评估模型。

    引用Arena.ai@arena

    Hy3 by Tencent is #5 in Agent Arena for open-weight models (#25 overall)! It also ranks as the #2 open model in the Frontend Code Arena (#16 overall)! In Agent Arena: Hy3 lands at #25 overall (net -2.2%). Hy3 has strengths in tool-use (recovering well from CLI/bash errors, +2.6% and #25), its biggest weakness is steerability as it struggles to course-correct when users push back, coming in at -7.1% (#30). Agent Arena measures models on millions of real-world, long-horizon agentic tasks. Models get web search, filesystem, and terminal tools to complete complex workflows: writing code, creating slide decks, researching the web, building apps, and analyzing documents. We use causal tracing methodology to measure a model's net improvement, which indicates how much it improves outcomes relative to the average model. Below we break down how Hy3 scored across 5 key signals, drawn from tasks submitted by a global community of users. Here’s an overview on the signals: User-satisfaction proxies - Confirmed Success: an explicit "yes that worked" feedback from the user - Praise vs. Complaint: implicit sentiment in users reactions - Steerability: can the model course-correct when you push back? Tool-use proxies - Bash Recovery: how it recovers from CLI errors (primary signal for tool use) - Tool Hallucination: does it call tools that don't exist Congrats to the @TencentHunyuan team on this release!

  3. Rohan Paul43

    Kimi K3 在 AA-Briefcase 基准上取得 Elo 1543,仅次于 Claude Fable 5(1574),较前代 K2.6(816)提升 727 分。该模型每任务平均成本 $10.57,约为 K2.6 的 10 倍,平均耗时 56.4 分钟,主要因任务平均需 83 轮交互和大量输出 token。

    引用Artificial Analysis@ArtificialAnlys

    Kimi K3 is second only to Fable 5 on AA-Briefcase, our agentic knowledge work benchmark, but costs more than Opus 4.8 to run while averaging nearly an hour per task Last week @Kimi_Moonshot released Kimi K3, a 2.8T parameter model that scores 57 on the Artificial Analysis Intelligence Index, comparable to models such as Opus 4.8 and GPT-5.5. On AA-Briefcase, Kimi K3 scores an Elo of 1543, a +727 improvement over Kimi K2.6 and the second highest score recorded, behind only Claude Fable 5 (1574) AA-Briefcase is our new proprietary benchmark for agentic knowledge work, testing models on a fully private dataset of realistic tasks across thousands of complex input files. Tasks require deliverables such as spreadsheets, presentations, and UI mock-ups, with performance combined into a single AA-Briefcase Elo based on correctness, analytical quality, and presentation quality Key results for Kimi K3 on AA-Briefcase: ➤ Second only to Fable 5: Kimi K3 achieves an AA-Briefcase Elo of 1543, the second-highest score overall, ahead of GPT-5.6 Sol (max, 1501), Claude Sonnet 5 (max, 1388), and Claude Opus 4.8 (max, 1347). This is a +727 improvement over the previous-generation Kimi K2.6 (816) and puts Kimi K3 only behind Fable 5 ➤ Strong objective and analytical performance, with comparatively weaker presentation: Kimi K3 achieves a rubric pass rate of 51%, second only to Claude Fable 5 (56%) and ahead of Claude Sonnet 5 (max, 42.3%) and GPT-5.6 Sol (max, 41.8%). It also records an analytical quality Elo of 1754, comparable to Claude Fable 5 (1744). Presentation quality is comparatively weaker, with a Presentation Elo of 1471, below GPT-5.6 Sol (max, 1660) and Claude Opus 4.8 (max, 1492) ➤ ~10x increase in Cost per Task: Kimi K3 averages a cost of $10.57 per task, a ~10x increase from Kimi K2.6, placing it among the most expensive models to run on AA-Briefcase. This is driven by model token pricing, increased output tokens and relatively high turn use, averaging 83 turns per task, versus 67 for Claude Fable 5 and 50 for GPT-5.6 Sol (max). Kimi K3 is priced at $3/$15 per 1M input/output tokens, with a 90% discount for cached tokens ➤ Averages nearly an hour per task: Kimi K3 has an average Time per AA-Briefcase Task of 56.4 minutes. This is driven by a high number of turns, high output token use, and lower speeds using the first-party Kimi API

  4. Ethan Mollick16

    Gemini 3.6 Flash 通过了同样的着色器测试……

    引用Ethan Mollick@emollick

    Kimi K3 on my shader test: "create a visually interesting shader that can run in twigl-dot-app make it like an infinite city of neo-gothic towers partially drowned in a stormy ocean with large waves." "Make it better" Very good model, not Sol Max or Fable, but great open weights

  5. Rohan Paul40

    Laguna S 2.1(118B 参数)在游戏编程任务中达到与 753B 的 GLM-5.2 同等的质量,参数量仅为后者的 1/6。在构建三款自玩街机游戏时,Laguna S 2.1 仅用 10.3K tokens 完成,而 GLM-5.2 需要 26.4K tokens。Laguna S 2.1 是三者中唯一能在 128GB MacBook 上本地运行的模型。

    引用atomic.chat@atomic_chat_hq

    Laguna S 2.1 performs at GLM-5.2 level on building popular games with 6x fewer params! We gave three local models the same task: build three popular arcade games that play themselves. Each game is one self-contained HTML file with a bot that plays it. Prompts: – Geometry Dash – Doodle Jump – Air Hockey Outputs: Laguna S 2.1: 10.3K tokens GLM-5.2: 26.4K tokens Hy3: 10.4K tokens Laguna held its quality against a 753B model. We think Laguna's Geometry Dash looked the best of the three, the cube clears every spike and block. GLM won Air Hockey. Its table looked the most detailed of all. Hy3 was the only model that added shooting to its Doodle Jump. But Laguna is the only model in our benchmark that runs on a MacBook with 128GB!

  6. Elon Musk31

    Elon Musk 宣布 Grok 新增“Grok Build”功能,用户可通过语音像与人对话一样完成任务,并支持 CLI 工具(http://X.ai/cli)。用户 @XFreeze 实测称 Grok 语音转文字(STT)速度快、准确率高,长段技术提示词也能实时转录,可直接发送给 Grok 4.5 或复制到其他工具,优于 Anthropic 的 STT 体验。

    引用X Freeze@XFreeze

    I’ve gotten so used to Grok’s speech-to-text that typing now feels like hell Quick tip: Even when you’re using another agentic coding harness, try Grok STT through Grok Build Anthropic’s speech-to-text is still pretty basic actually in my experience. With longer technical prompts, it can quickly go off the rails and completely distort what you were trying to say Just press Ctrl + Space, start speaking, and let Grok transcribe the entire thought in real-time You can then copy it into another tool or press Enter and send it directly to Grok 4.5 right there in Grok Build It’s fast, highly accurate and paired with one of the most capable and efficient frontier models available Long, detailed rambling is often exactly what an AI agent needs to understand what you actually want

7月21日周二