联合学习
计算机科学
模式(遗传算法)
代表(政治)
人工智能
方案(数学)
特征学习
机器学习
数学
政治学
政治
数学分析
法学
作者
Yupei Zhang,Yunan Xu,Shuangshuang Wei,Yifei Wang,Yuxin Li,Xuequn Shang
标识
DOI:10.1016/j.patcog.2023.109507
摘要
This paper focuses on the problem of personalized federated learning (FL) with the schema of contrastive learning (CL), which is to implement collaborative pattern classification by many clients. The traditional FL frameworks mostly facilitate the global model for the server and the local models for the clients to be similar, often ignoring the data heterogeneity of the clients. Aiming at achieving better performance in clients, this study introduces a personalized federated contrastive learning model, dubbed PerFCL, by proposing a new approach to doubly contrastive representation learning (DCL). Concretely, PerFCL borrows the DCL scheme, where one CL loss compares the shared parts of local models with the global model and the other CL loss compares the personalized parts of local models with the global model. To encourage the difference between the two parts, we created a double optimization problem composed of maximizing the comparison agreement for the former and minimizing the comparison agreement for the latter. We evaluated the proposed model on three publicly available data sets for federated image classification. Experiment results show that PerFCL benefits from the proposed DCL strategy and performs better than the state-of-the-art federated-learning models.
科研通智能强力驱动
Strongly Powered by AbleSci AI