Anatomy-Aware Sketch-Guided Latent Diffusion Model for Orbital Tumor Multi-Parametric MRI Missing Modalities Synthesis

模态(人机交互) 特征(语言学) 一致性(知识库) 先验概率 磁共振成像 计算机科学 降噪 人工智能 生成模型 医学影像学 缺少数据 磁共振弥散成像 编码(集合论) 模式 计算机视觉 实时核磁共振成像 噪音(视频) 模式识别(心理学) 源代码 投影(关系代数) 迭代重建 基本事实 图像(数学) 机器学习 图像质量 深度学习
作者
Langtao Zhou,XIAOXIA QU,Tianyu Fu,Jiaoyang Wu,Hong Song,Jingfan Fan,Danni Ai,Deqiang Xiao,Junfang Xian,Jian Yang
出处
期刊:IEEE Transactions on Medical Imaging [Institute of Electrical and Electronics Engineers]
卷期号:45 (5): 2140-2155 被引量:1
标识
DOI:10.1109/tmi.2025.3648852
摘要

Synthesizing missing modalities in multi-parametric MRI (mpMRI) is vital for accurate tumor diagnosis, yet remains challenging due to incomplete acquisitions and modality heterogeneity. Diffusion models have shown strong generative capability, but conventional approaches typically operate in the image domain with high memory costs and often rely solely on noise-space supervision, which limits anatomical fidelity. Latent diffusion models (LDMs) improve efficiency by performing denoising in latent space, but standard LDMs lack explicit structural priors and struggle to integrate multiple modalities effectively. To address these limitations, we propose the anatomy-aware sketch-guided latent diffusion model (ASLDM), a novel LDM-based framework designed for flexible and structure-preserving MRI synthesis. ASLDM incorporates an anatomy-aware feature fusion module, which encodes tumor region masks and edge-based anatomical sketches via cross-attention to guide the denoising process with explicit structure priors. A modality synergistic reconstruction strategy enables the joint modeling of available and missing modalities, enhancing cross-modal consistency and supporting arbitrary missing scenarios. Additionally, we introduce image-level losses for pixel-space supervision using L1 and SSIM losses, overcoming the limitations of pure noise-based loss training and improving the anatomical accuracy of synthesized outputs. Extensive experiments on a five-modality orbital tumor mpMRI private dataset and a four-modality public BraTS2024 dataset demonstrate that ASLDM outperforms state-of-the-art methods in both synthesis quality and structural consistency, showing strong potential for clinically reliable multi-modal MRI completion. Our code is publicly available at: https://github.com/zltshadow/ASLDM.git.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
kk完成签到,获得积分20
刚刚
1秒前
Keira发布了新的文献求助10
2秒前
阿七完成签到,获得积分10
3秒前
Kao应助langlang采纳,获得10
3秒前
爱学习完成签到,获得积分10
3秒前
4秒前
yujqsc发布了新的文献求助10
4秒前
Nexus应助gougoubao采纳,获得50
4秒前
lalalucky1发布了新的文献求助10
5秒前
5秒前
开展考个会计证关注了科研通微信公众号
5秒前
lllkkk完成签到,获得积分10
6秒前
PIKACHU发布了新的文献求助10
6秒前
pjjpk01完成签到,获得积分10
6秒前
小林完成签到,获得积分20
7秒前
dfw发布了新的文献求助10
7秒前
精明的水杯完成签到,获得积分10
7秒前
8秒前
11秒前
123完成签到,获得积分10
12秒前
12秒前
小迷糊发布了新的文献求助10
12秒前
12秒前
13秒前
13秒前
PIKACHU完成签到,获得积分10
15秒前
16秒前
四月发布了新的文献求助10
17秒前
丢丢小皮蛋完成签到,获得积分10
17秒前
limecho完成签到,获得积分10
17秒前
科目三应助blueice采纳,获得10
18秒前
19秒前
Tenacity完成签到,获得积分10
20秒前
中微子完成签到,获得积分10
21秒前
21秒前
NexusExplorer应助Yuu采纳,获得10
22秒前
CipherSage应助Yuu采纳,获得10
22秒前
希望天下0贩的0应助Yuu采纳,获得10
22秒前
天天快乐应助Yuu采纳,获得10
22秒前
高分求助中
Principles of Economics, 11th Edition 10000
University Physics with Modern Physics, 16th edition 10000
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Molecular Mechanisms of Photosynthesis, 4th Edition 1000
Organic Reactions, Volume 116 1000
Current concepts in cutaneous toxicity : proceedings of the Fourth Conference on Cutaneous Toxicity, Washington, D.C., May 9-11, 1979 1000
The recovery-stress questionnaires : user manual 800
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7259412
求助须知:如何正确求助?哪些是违规求助? 8881405
关于积分的说明 18765911
捐赠科研通 6939599
什么是DOI,文献DOI怎么找? 3201610
关于科研通互助平台的介绍 2375437
邀请新用户注册赠送积分活动 2177351