潜变量
一般化
领域(数学分析)
潜变量模型
内容(测量理论)
计算机科学
变量(数学)
人工智能
数学
数学分析
作者
Erdun Gao,Howard D. Bondell,Shaoli Huang,Mingming Gong
出处
期刊:Machine Learning
[Springer Science+Business Media]
日期:2025-02-17
卷期号:114 (4)
被引量:2
标识
DOI:10.1007/s10994-024-06717-6
摘要
Abstract The purpose of domain generalization is to develop models that exhibit a higher degree of generality, meaning they perform better when evaluated on data coming from previously unseen distributions. Models obtained via traditional methods often cannot distinguish between label-specific and domain-related features in the latent space. To confront this difficulty, we propose formulating a novel data generation process using a latent variable model and postulating a partition of the latent space into content and style parts while allowing for statistical dependency to exist between them. In this model, the distribution of content factors associated with observations belonging to the same class depends on only the label corresponding to that class. In contrast, the distribution of style factors has an additional dependency on the domain variable. We derive constraints that suffice to recover the collection of content factors block-wise and the collection of style factors component-wise while guaranteeing the isolation of content factors. This allows us to produce a stable predictor solely relying on the latent content factors. Building upon these theoretical insights, we propose a practical and efficient algorithm for determining the latent variables under the variational auto-encoder framework. Our simulations with dependent latent variables produce results consistent with our theory, and real-world experiments show that our method outperforms the competitors.
科研通智能强力驱动
Strongly Powered by AbleSci AI