模态(人机交互)
特征(语言学)
一致性(知识库)
先验概率
磁共振成像
计算机科学
降噪
人工智能
生成模型
医学影像学
缺少数据
磁共振弥散成像
编码(集合论)
模式
计算机视觉
实时核磁共振成像
噪音(视频)
模式识别(心理学)
源代码
投影(关系代数)
迭代重建
基本事实
图像(数学)
机器学习
图像质量
深度学习
作者
Langtao Zhou,XIAOXIA QU,Tianyu Fu,Jiaoyang Wu,Hong Song,Jingfan Fan,Danni Ai,Deqiang Xiao,Junfang Xian,Jian Yang
标识
DOI:10.1109/tmi.2025.3648852
摘要
Synthesizing missing modalities in multi-parametric MRI (mpMRI) is vital for accurate tumor diagnosis, yet remains challenging due to incomplete acquisitions and modality heterogeneity. Diffusion models have shown strong generative capability, but conventional approaches typically operate in the image domain with high memory costs and often rely solely on noise-space supervision, which limits anatomical fidelity. Latent diffusion models (LDMs) improve efficiency by performing denoising in latent space, but standard LDMs lack explicit structural priors and struggle to integrate multiple modalities effectively. To address these limitations, we propose the anatomy-aware sketch-guided latent diffusion model (ASLDM), a novel LDM-based framework designed for flexible and structure-preserving MRI synthesis. ASLDM incorporates an anatomy-aware feature fusion module, which encodes tumor region masks and edge-based anatomical sketches via cross-attention to guide the denoising process with explicit structure priors. A modality synergistic reconstruction strategy enables the joint modeling of available and missing modalities, enhancing cross-modal consistency and supporting arbitrary missing scenarios. Additionally, we introduce image-level losses for pixel-space supervision using L1 and SSIM losses, overcoming the limitations of pure noise-based loss training and improving the anatomical accuracy of synthesized outputs. Extensive experiments on a five-modality orbital tumor mpMRI private dataset and a four-modality public BraTS2024 dataset demonstrate that ASLDM outperforms state-of-the-art methods in both synthesis quality and structural consistency, showing strong potential for clinically reliable multi-modal MRI completion. Our code is publicly available at: https://github.com/zltshadow/ASLDM.git.
科研通智能强力驱动
Strongly Powered by AbleSci AI