计算机科学
人工智能
先验概率
性格(数学)
推论
嵌入
图像(数学)
可读性
计算机视觉
遮罩(插图)
模式识别(心理学)
光学字符识别
图像编辑
鉴定(生物学)
匹配(统计)
深度学习
特征提取
自然语言处理
图像处理
幻觉
投影(关系代数)
作者
Runmin Wang,Shengrong Yuan,Shan Ye,Xingdong Song,Han Xu,Shengyou Qian,Changxin Gao,Nong Sang
标识
DOI:10.1109/tcsvt.2026.3667545
摘要
Understanding the structure of characters is crucial for recovering clear and readable high-resolution scene text images in Scene Text Image Super-Resolution (STISR). Recently, many existing STISR methods inject the character structure information implicit in the recognition priors into the super-resolution network to guide the super-resolution process, thereby facilitating the generation of more legible text images. However, the recognition priors obtained from low resolution are inaccurate, which means that directly embedding these priors into the network easily misleads the super-resolution process. To address this problem, we draw inspiration from Masked Image Modeling (MIM) and propose the Mask Structure Inference Network (MSINet), which can generate scene text images with accurate character structures without directly embedding recognition priors. To make STISR compatible with MIM, we also propose a Mask-and-Inference Paradigm (MIP), which consists of a mask image pre-training stage for character structure learning and a fine-tuning stage for character structure inference. In addition, a novel mask strategy named Text Confidence Mask (TCM) is proposed to avoid recovery errors by masking legible character regions. With MIP and TCM, MSINet impressively improves the clarity and readability of the degraded scene text images. Specifically, MSINet-B outperforms recent state-of-the-art methods by about +3.7% on the TextZoom and average +3.6% on six manually degraded scene text recognition datasets in recognition accuracy. The code will be released at https://github.com/Yuanssr/MSINet.
科研通智能强力驱动
Strongly Powered by AbleSci AI