Francois Chollet 提出疑问:AI 能力的"锯齿状前沿"是否主要来自数学和代码——这两者可通过 RLVR 无限推进,而其他领域因仍受限于人类生成数据而开始进入平台期。他指出,非可验证领域的模型表现虽持续提升,但远慢于数学和代码。这一提升究竟来自 RLVR 驱动的高 G,还是仅源于仍在海量注入的新人类数据,答案将决定很多事。
What if the jagged frontier is mainly math + code (which you can push arbitrarily far with RLVR), and everything else starts to plateau because it is still bottlenecked by human generated data?
Model performance in non-verifiable areas has kept improving steadily, albeit much slower than for math and code. But is that steady improvement a side effect of a higher G (itself driven by RLVR), or only a function of the amount of new human data getting injected into training (which is still continually happening on a massive scale)?
A lot of things depend on the answer to this question
来源:François Chollet · x.com