Yann LeCun· @ylecun · X·· 2025-08-24
AI 导读
Meta 一间会议室以 Yann LeCun 等人 1989 年的经典论文《Optimal Brain Damage》命名。该方法是最早的神经网络剪枝技术之一，通过计算损失函数的二阶导数，剔除对输出影响较小的权重，从而实现网络压缩。
正文 · 原文
My previous meeting room at Meta was named after the title of this paper.
One of the first pruning methods for neural nets came in 1989: Optimal Brain Damage by @ylecun et al. “We … derive a class of prac- tical and nearly optimal schemes for adapting the size of a neural network.” They pruned weights with low 2nd-derivative of the loss. https://t.co/WzIDQExX87在 X 查看被引用的帖子
来源：Yann LeCun · x.com