GLM-5.3 团队分享用 GLM-5.3 优化自身推理基础设施,GLM-5.3-Flash 吞吐提升至 3 倍

Rohan Paul · @rohanpaul_ai · X·2026-09-18 00:30·39分钟前
AI 导读

智谱(Zai)分享 GLM-5.3 帮助构建并优化 GLM-5.3-Flash 推理基础设施的过程,系统从首次成功运行到生产就绪用时不到两周,端到端吞吐相对初始基线提升至 3 倍。

Rohan Paul@rohanpaul_ai
64AI 编辑部评分,满分 100

GLM-5.3 团队分享用 GLM-5.3 优化自身推理基础设施,GLM-5.3-Flash 吞吐提升至 3 倍

2026-09-18 00:30· 39分钟前
AI 导读

智谱(Zai)分享 GLM-5.3 帮助构建并优化 GLM-5.3-Flash 推理基础设施的过程,系统从首次成功运行到生产就绪用时不到两周,端到端吞吐相对初始基线提升至 3 倍。

A brilliant post from the GLM-5.3 team on RSI (recursive self-improvement).

GLM-5.3 was already used to optimize the infrastructure that runs GLM itself, including production kernel and concurrency fixes. It helped triple GLM-5.3-Flash throughput on 100,000+ accelerators.

Their early self-improvement loop: the model improves its serving system, that system runs the model, and the engineering knowledge accumulates for the next optimization cycle.

Engineers still set objectives and boundaries, while the agent handled analysis, hypotheses, code changes, and experiments.

In one test, Prefill plus KV Transfer lagged Prefill alone by over 20%, and the agent traced the slowdown to the Python GIL, and releasing that lock cut the gap below 1%

Another kernel change reached a 1.71x speedup over the prior version by eliminating repeated FP32 normalization and gating work.

Z.aiWe’re sharing how GLM-5.3 helped build and optimize the inference infrastructure serving GLM-5.3-Flash. The system went from its first successful run to product...