因果基础模型(Causal Foundation Models)实用导论

HuggingFace Daily Papers(社区热门论文)·2026-09-02 08:00·6天前
AI 导读

因果基础模型(CFMs)将基础模型范式引入因果推断,通过预训练神经网络在新数据集上利用上下文学习直接估计平均处理效应等因果量,无需更新模型。本文为该新兴领域提供实用导论,先梳理因果推断与机器学习必要背景,再讨论CFMs,并附示例代码与Jupyter notebooks。

HuggingFace Daily Papers(社区热门论文)
39AI 编辑部评分,满分 100

因果基础模型(Causal Foundation Models)实用导论

2026-09-02 08:00· 6天前
AI 导读

因果基础模型(CFMs)将基础模型范式引入因果推断,通过预训练神经网络在新数据集上利用上下文学习直接估计平均处理效应等因果量,无需更新模型。本文为该新兴领域提供实用导论,先梳理因果推断与机器学习必要背景,再讨论CFMs,并附示例代码与Jupyter notebooks。

Causal inference is the practice of estimating the effect of a treatment or intervention from data. It traditionally requires a bespoke pipeline for every new problem: first proposing a causal mechanism, selecting a compatible estimator, and finally training it. Meanwhile, across diverse settings and modalities, much of machine learning has shifted to the paradigm of foundation models: networks pretrained once at scale and applied to new tasks without fine-tuning. Causal foundation models (CFMs) bring this paradigm to causal inference. CFMs are pretrained neural networks that estimate causal quantities, such as the average treatment effect, on entirely new datasets using in-context learning without requiring model updates. This work provides a practical introduction to this emerging area. We summarize the necessary background in causal inference and machine learning before discussing CFMs. Throughout, we include example code and Jupyter notebooks.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org