计算机科学
人工智能
机器学习
稳健性(进化)
Boosting(机器学习)
一般化
经验风险最小化
缩小
领域(数学分析)
差异(会计)
稳健优化
无监督学习
对抗制
数据挖掘
标记数据
概率分布
域适应
班级(哲学)
监督学习
数据建模
条件概率分布
适应(眼睛)
对比度(视觉)
训练集
合成数据
泛化误差
作者
Zhenyu Wang,Peter Bühlmann,Zijian Guo
出处
期刊:Annals of Statistics
[Institute of Mathematical Statistics]
日期:2026-04-01
卷期号:54 (2): 570-596
被引量:29
摘要
Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of the source domains. To address such potential distributional shifts, we develop an unsupervised domain adaptation approach that leverages labeled data from multiple source domains and unlabeled data from the target domain. We introduce a distributionally robust model that optimizes an adversarial reward based on explained variance across a class of target distributions, ensuring generalization to the target domain. We show that the proposed robust model is a weighted average of conditional outcome models from the source domains. This formulation allows us to compute the robust model through the aggregation of source models, which can be estimated using various machine learning algorithms of the user’s choice such as random forests, boosting and neural networks. Additionally, we introduce a bias-correction step to obtain a more accurate aggregation weight, which is effective for various machine learning algorithms. Our framework can be interpreted as a distributionally robust federated learning approach that satisfies privacy constraints while providing insights into the importance of each source for prediction on the target domain. The performance of our method is evaluated on both simulated and real data.
科研通智能强力驱动
Strongly Powered by AbleSci AI