ProtoMTG: Prototypical Multi-Task Learning for the Generation of Multiple Stained Immunohistochemical Images

可解释性 计算机科学 人工智能 免疫组织化学 多路复用 计算机视觉 染色 水准点(测量) 模式识别(心理学) H&E染色 视频阵列图形 下调和上调 编码(集合论) 代表(政治) 像素 病理
作者
Junjie Zhou,A. S. Krylov,Jianpeng Sheng,Qi Zhu,Wei Shao,Daoqiang Zhang
出处
期刊:IEEE Transactions on Medical Imaging [Institute of Electrical and Electronics Engineers]
卷期号:45 (3): 1127-1139
标识
DOI:10.1109/tmi.2025.3618446
摘要

Multiplex immunohistochemistry (mIHC) images have the potential to assess the complex tumor microenvironment by simultaneously detecting multiple markers within a single tissue section, however, the acquisition of mIHC images in clinical labs is both time-consuming and costly. Hence, applying machine learning-based virtual staining techniques for rapid generation of different mIHC markers has become a considerable alternative. The existing bio-image based virtual staining models generate the distributions of different markers independently, which have limited interpretability and overlook the fact that the exploration of potential interrelationships among these markers can help determine the localization of each individual marker. To address the above issues, we propose an explainable prototypical multi-task generation framework (i.e., ProtoMTG) to simultaneously generate multiple mIHC markers. Specifically, ProtoMTG involves a multi-task prototype layer that can capture the relationship among different virtual staining tasks by learning the shared and task-specific prototypes. Then, in the proto-attention layer, both task-specific and shared prototypes will be re-weighted and combined to instruct the generation of different mIHC markers. In ProtoMTG, we also design the novel prototypical activation and diversity losses to learn better prototype representation for the virtual staining task. To evaluate the performance of our method, we develop three benchmark mIHC datasets on different organs (i.e., colon, liver and stomach). The experimental results indicate that our method can not only outperform the existing image generation models, but also have good explainable ability for the virtual staining of mIHC markers. The code and dataset are available at: https://jj-zhou-code.github.io/ProtoMTG-website/.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
科研通AI2S的应助被胡萝卜卜采纳,获得10
刚刚
佳佳发布了新的文献求助10
刚刚
zhangzhang完成签到,获得积分10
刚刚
1秒前
1秒前
1秒前
幸运花花完成签到,获得积分10
1秒前
今后的应助被CHENHF采纳,获得10
2秒前
2秒前
Aurelia完成签到 ,获得积分20
2秒前
我是老大的应助被肥龙宝宝采纳,获得10
3秒前
G_Dragon完成签到 ,获得积分10
4秒前
pan完成签到 ,获得积分10
4秒前
星野发布了新的文献求助10
4秒前
4秒前
sanyazth完成签到,获得积分10
5秒前
悦耳的城发布了新的文献求助10
6秒前
6秒前
慕青的应助被Waitcy采纳,获得10
7秒前
默尧完成签到,获得积分10
7秒前
7秒前
7秒前
zjxnq完成签到 ,获得积分10
8秒前
fhg发布了新的文献求助10
8秒前
Xxin完成签到,获得积分10
9秒前
科目三的应助被晒个月亮采纳,获得10
9秒前
情怀的应助被changdingN采纳,获得10
9秒前
9秒前
安静的易绿完成签到,获得积分20
9秒前
Jigsaw发布了新的文献求助10
9秒前
耍酷的梦秋完成签到,获得积分10
9秒前
wan关注了科研通微信公众号
10秒前
Akim的应助被佳佳采纳,获得10
10秒前
11秒前
Duuu发布了新的文献求助10
11秒前
温柔的忆之完成签到,获得积分10
12秒前
共享精神的应助被科研通管家采纳,获得10
13秒前
无花果的应助被科研通管家采纳,获得10
13秒前
所所的应助被科研通管家采纳,获得10
13秒前
隐形曼青的应助被科研通管家采纳,获得10
13秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Handbook of Sport Coaching Research 1000
Orthognathic Surgery - 2 Volume Set 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8194239
求助须知:如何正确求助?哪些是违规求助? 9580103
关于积分的说明 21869458
捐赠科研通 7793840
什么是DOI,文献DOI怎么找? 3437562
关于科研通互助平台的介绍 2560983
邀请新用户注册赠送积分活动 2484332