MonoLoT: Self-Supervised Monocular Depth Estimation in Low-Texture Scenes for Automatic Robotic Endoscopy

人工智能 计算机科学 计算机视觉 单眼 纹理(宇宙学) 图像(数学)
作者
Qi He,Guang Feng,Sophia Bano,Danail Stoyanov,Siyang Zuo
出处
期刊:IEEE Journal of Biomedical and Health Informatics [Institute of Electrical and Electronics Engineers]
卷期号:: 1-14
标识
DOI:10.1109/jbhi.2024.3423791
摘要

The self-supervised monocular depth estimation framework is well-suited for medical images that lack ground-truth depth, such as those from digestive endoscopes, facilitating navigation and 3D reconstruction in the gastrointestinal tract. However, this framework faces several limitations, including poor performance in low-texture environments, limited generalisation to real-world datasets, and unclear applicability in downstream tasks like visual servoing. To tackle these challenges, we propose MonoLoT, a self-supervised monocular depth estimation framework featuring two key innovations: point matching loss and batch image shuffle. Extensive ablation studies on two publicly available datasets, namely C3VD and SimCol, have shown that methods enabled by MonoLoT achieve substantial improvements, with accuracies of 0.944 on C3VD and 0.959 on SimCol, surpassing both depth-supervised and self-supervised baselines on C3VD. Qualitative evaluations on real-world endoscopic data underscore the generalisation capabilities of our methods, outperforming both depth-supervised and self-supervised baselines. To demonstrate the feasibility of using monocular depth estimation for visual servoing, we have successfully integrated our method into a proof-of-concept robotic platform, enabling real-time automatic intervention and control in digestive endoscopy. In summary, our method represents a significant advancement in monocular depth estimation for digestive endoscopy, overcoming key challenges and opening promising avenues for medical applications.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
元皓完成签到 ,获得积分10
2秒前
润泉完成签到,获得积分10
2秒前
夕沫完成签到,获得积分10
3秒前
mmm完成签到,获得积分10
3秒前
Atropine发布了新的文献求助10
3秒前
planto完成签到,获得积分10
4秒前
老老熊发布了新的文献求助10
4秒前
欧阳小枫完成签到 ,获得积分10
5秒前
桐桐应助WenMi采纳,获得10
6秒前
潮小坤完成签到,获得积分10
6秒前
mmm发布了新的文献求助10
7秒前
本草石之寒温完成签到 ,获得积分10
7秒前
脑洞疼应助SAY采纳,获得10
8秒前
9秒前
10秒前
自信的凡双应助夕沫采纳,获得10
11秒前
萧东辰完成签到,获得积分10
13秒前
大大大大宝凌完成签到,获得积分10
13秒前
负责灵萱完成签到 ,获得积分0
14秒前
StuXuhao发布了新的文献求助10
14秒前
可以的完成签到,获得积分0
14秒前
大肥猫完成签到,获得积分10
14秒前
烟花应助Atropine采纳,获得10
15秒前
16秒前
16秒前
18秒前
唠叨的莺完成签到,获得积分10
18秒前
务实完成签到 ,获得积分10
18秒前
18秒前
20秒前
20秒前
缥缈从霜完成签到,获得积分10
20秒前
21秒前
酷波er应助spz采纳,获得10
21秒前
丘比特应助Atropine采纳,获得10
22秒前
rain发布了新的文献求助30
22秒前
23秒前
三伏天发布了新的文献求助10
24秒前
小猛发布了新的文献求助10
25秒前
小太阳完成签到,获得积分10
25秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Les Mantodea de Guyane Insecta, Polyneoptera 2000
Emmy Noether's Wonderful Theorem 1200
Leading Academic-Practice Partnerships in Nursing and Healthcare: A Paradigm for Change 800
基于非线性光纤环形镜的全保偏锁模激光器研究-上海科技大学 800
Signals, Systems, and Signal Processing 610
Research Methods for Business: A Skill Building Approach, 9th Edition 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 物理 内科学 复合材料 催化作用 物理化学 光电子学 电极 细胞生物学 基因 无机化学
热门帖子
关注 科研通微信公众号,转发送积分 6410901
求助须知:如何正确求助?哪些是违规求助? 8230109
关于积分的说明 17464641
捐赠科研通 5463818
什么是DOI,文献DOI怎么找? 2887011
邀请新用户注册赠送积分活动 1863456
关于科研通互助平台的介绍 1702537