人工智能
计算机科学
目标检测
计算机视觉
对象(语法)
对偶(语法数字)
模式识别(心理学)
噪音(视频)
特征(语言学)
特征提取
异常检测
作者
Chen-Long Duan,Yong Li,Xiu-Shen Wei,Lin Zhao
出处
期刊:
[Neural Information Processing Systems Foundation]
日期:2024-01-01
卷期号:: 40230-40253
被引量:7
摘要
Pre-training plays a vital role in various vision tasks, such as object recognition and detection. Commonly used pre-training methods, which typically rely on randomized approaches like uniform or Gaussian distributions to initialize model parameters, often fall short when confronted with long-tailed distributions, especially in detection tasks. This is largely due to extreme data imbalance and the issue of simplicity bias. In this paper, we introduce a novel pre-training framework for object detection, called Dynamic Rebalancing Contrastive Learning with Dual Reconstruction (2DRCL). Our method builds on a Holistic-Local Contrastive Learning mechanism, which aligns pre-training with object detection by capturing both global contextual semantics and detailed local patterns. To tackle the imbalance inherent in long-tailed data, we design a dynamic rebalancing strategy that adjusts the sampling of underrepresented instances throughout the pre-training process, ensuring better representation of tail classes. Moreover, Dual Reconstruction addresses simplicity bias by enforcing a reconstruction task aligned with the self-consistency principle, specifically benefiting underrepresented tail classes. Experiments on COCO and LVIS v1.0 datasets demonstrate the effectiveness of our method, particularly in improving the mAP/AP scores for tail classes.
科研通智能强力驱动
Strongly Powered by AbleSci AI