MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priors

怪物 功率(物理) 艺术 计算机科学 文学类 物理 量子力学
作者
Junda Cheng,Longliang Liu,Gangwei Xu,Xianqi Wang,Zhaoxing Zhang,Yong Deng,Jinliang Zang,Yu-Rui Chen,Zhipeng Cai,Xin Yang,Shi, Yangyang,Tang, Jinhui,Yang, Xin
出处
期刊:Cornell University - arXiv 被引量:1
标识
DOI:10.48550/arxiv.2501.08643
摘要

We introduce MonSter++, a geometric foundation model for multi-view depth estimation, unifying rectified stereo matching and unrectified multi-view stereo. Both tasks fundamentally recover metric depth from correspondence search and consequently face the same dilemma: struggling to handle ill-posed regions with limited matching cues. To address this, we propose MonSter++, a novel method that integrates monocular depth priors into multi-view depth estimation, effectively combining the complementary strengths of single-view and multi-view cues. MonSter++ fuses monocular depth and multi-view depth into a dual-branched architecture. Confidence-based guidance adaptively selects reliable multi-view cues to correct scale ambiguity in monocular depth. The refined monocular predictions, in turn, effectively guide multi-view estimation in ill-posed regions. This iterative mutual enhancement enables MonSter++ to evolve coarse object-level monocular priors into fine-grained, pixel-level geometry, fully unlocking the potential of multi-view depth estimation. MonSter++ achieves new state-of-the-art on both stereo matching and multi-view stereo. By effectively incorporating monocular priors through our cascaded search and multi-scale depth fusion strategy, our real-time variant RT-MonSter++ also outperforms previous real-time methods by a large margin. As shown in Fig.1, MonSter++ achieves significant improvements over previous methods across eight benchmarks from three tasks -- stereo matching, real-time stereo matching, and multi-view stereo, demonstrating the strong generality of our framework. Besides high accuracy, MonSter++ also demonstrates superior zero-shot generalization capability. We will release both the large and the real-time models to facilitate their use by the open-source community.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
cc关注了科研通微信公众号
刚刚
昵称发布了新的文献求助10
刚刚
fc457发布了新的文献求助10
2秒前
2秒前
2秒前
3秒前
王SQ完成签到,获得积分10
3秒前
4秒前
领导范儿应助sangnina采纳,获得10
4秒前
斯文的水卉完成签到,获得积分10
4秒前
G梦坠完成签到,获得积分10
5秒前
张睿发布了新的文献求助10
7秒前
7秒前
2024发布了新的文献求助10
7秒前
7秒前
英吉利25发布了新的文献求助10
8秒前
bkagyin应助尚买办采纳,获得10
9秒前
9秒前
LLL完成签到 ,获得积分10
9秒前
zzz完成签到,获得积分10
9秒前
小顾完成签到 ,获得积分10
10秒前
10秒前
科研通AI6.4应助陈雯采纳,获得10
12秒前
12秒前
洛尚发布了新的文献求助10
12秒前
上官若男应助张睿采纳,获得10
12秒前
12秒前
竹醉先生完成签到,获得积分10
13秒前
13秒前
13秒前
zzzzzz完成签到 ,获得积分10
14秒前
独弦清音发布了新的文献求助10
18秒前
18秒前
洛尚完成签到,获得积分10
18秒前
19秒前
沉默乐安完成签到,获得积分10
20秒前
fc457完成签到,获得积分10
20秒前
20秒前
宋博文发布了新的文献求助10
21秒前
万能图书馆应助QDF采纳,获得10
22秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
The Cambridge History of China: Volume 4, Sui and T'ang China, 589–906 AD, Part Two 1500
Cowries - A Guide to the Gastropod Family Cypraeidae 1200
Quality by Design - An Indispensable Approach to Accelerate Biopharmaceutical Product Development 800
Pulse width control of a 3-phase inverter with non sinusoidal phase voltages 777
Signals, Systems, and Signal Processing 610
Research Methods for Applied Linguistics: A Practical Guide 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 物理 内科学 复合材料 催化作用 物理化学 光电子学 电极 细胞生物学 基因 无机化学
热门帖子
关注 科研通微信公众号,转发送积分 6400831
求助须知:如何正确求助?哪些是违规求助? 8217684
关于积分的说明 17415189
捐赠科研通 5453848
什么是DOI,文献DOI怎么找? 2882316
邀请新用户注册赠送积分活动 1858945
关于科研通互助平台的介绍 1700638