跳到正文
原文
Rohan Paul· @rohanpaul_ai · X·· 2 小时前AI 评分58
AI 导读

Meta 等机构发布 Context Language Models(CLMs)论文,让语言模型把上下文当作文件、原生自主管理上下文,无需外部 harness。

正文

Meta dropped a great paper.

AI agents perform better and cost less when they manage their own context, so stop hard-coding the rules for what they keep.

Right now, most AI agents follow rules you write to decide what to forget when their context fills up, like "summarize everything when it's full."
This paper shows you can delete those rules and let the model clean up its own context, and it does a better job with less compute, even with today's models and no training

Since the model understands the task, it can judge what still matters, keep exactly that, and throw out the rest.

On a deep-research benchmark, it scored 11.4% higher than Codex-style summarization while using 21.5% less compute.

For long-running agents, let a strong model manage its own context before writing more cleanup rules.

引用Rulin Shao@RulinShao
‼️The Bitter Lesson for context management: Giving LMs unrestricted control over their context beats human-designed SOTA! Introducing 🩵Context Language Models (CLMs)🩵 - Natively manage their own context - Treat context as a file - Learn policies in CLM weights, no harness
在 X 查看被引用的帖子

来源:Rohan Paul · x.com