计算机科学
特征(语言学)
目标检测
人工智能
卷积(计算机科学)
词汇
语义学(计算机科学)
语义特征
对象(语法)
计算机视觉
匹配(统计)
特征提取
模式识别(心理学)
级联
探测器
图像(数学)
管道(软件)
接头(建筑物)
依赖关系(UML)
像素
语义匹配
语义鸿沟
卷积神经网络
注意力网络
模式匹配
图像分割
路径(计算)
管道运输
方向(向量空间)
特征检测(计算机视觉)
图像检索
上下文图像分类
数据挖掘
特征匹配
图像处理
可视化
作者
Zhenyu Fang,Yulong Wu,Jinchang Ren,Jiangbin Zheng,Yijun Yan,Lixiang Zhang
标识
DOI:10.1109/tmm.2025.3632649
摘要
Although text information has aided existing models to achieve promising results in open vocabulary object detection (OVD), the lack of semantic information has led to the difficulty in small objects detection (SOD). Moreover, such semantic gap also causes failure when matching texts and image features, resulting in false negative instances being detected. To address these issues, we propose a Cascade Open Vocabulary Detector (Cas-OVD), which builds upon existing multi-stage detection pipelines but specializes in text-vision alignment for small objects. In particular, we adapt a multi-refined region proposal network, guided by a non-sampled anchor strategy, to reduce the missing and false detections of small objects. Meanwhile, a deformable convolution network based feature conversion module is proposed to enhance the semantic information of small objects even the potential ones with low confidence. Unlike existing methods that rely on coarse-grained image-based features for image-text matching, Cas-OVD refines these features through a cascade alignment process, allowing each stage to build on the results of the previous one. This can progressively enhance the feature correlation between the image regions and the textual descriptions through successive error correction. On the joint BDD100K-SODA-D dataset, Cas-OVD achieved 17.95% AP$_{\mathrm{all}}$and 14.6% AP$_{\mathrm{s}}$, outperforming RegionCLIP by 3.5% AP$_{\mathrm{all}}$and 3.0% AP$_{\mathrm{s}}$, respectively. On the OV_COCO dataset, Cas-OVD has the 32.71% AP$_{\mathrm{all}}$and 17.26% AP$_{\mathrm{s}}$, surpassing the RegionCLIP by 6.6% AP$_{\mathrm{all}}$and 6.1% AP$_{\mathrm{s}}$, respectively.
科研通智能强力驱动
Strongly Powered by AbleSci AI