Robust self-supervised learning for source-free domain adaptation

Abstract Source-Free Domain Adaptation (SFDA) is from Unsupervised Domain Adaptation (UDA) and do apply to the special situation in reality that the source domain data is not accessible. In this subject, self-supervised learning is widely used in previous works. However, inaccurate pseudo labels are hardly avoidable which degenerates the adapted target model. In this work, we propose an effective method, named RS2L (Robust Self-Supervised Learning), to reduce the negative impact by inaccurate pseudo-labels. Two strategies are adapted. The first is called structure-preserved pseudo-labelling strategy which generates much better pseudo labels by stored predictions of $k$-closest neighbors. Another is self supervised learning with mask. We using threshold masks to select samples for different operations, i.e., self-supervised learning and structure-preserved learning. For different masks, the threshold values are different. So it is not excluded that some samples participate in both two operations. Experiments on three benchmark datasets show that our method achieves the state-of-the-art results.