瓶颈
计算机科学
蒸馏
人工智能
机器学习
噪音(视频)
分辨率(逻辑)
领域(数学)
合成数据
深度学习
信号(编程语言)
模式识别(心理学)
人工神经网络
数据挖掘
口译(哲学)
监督学习
信噪比(成像)
网络模型
自然语言处理
作者
Yun‐Peng Shi,Liang Wang,Fan Min
标识
DOI:10.1111/1365-2478.70129
摘要
ABSTRACT Enhancing seismic data resolution is a crucial step for geological interpretation and imaging. Deep learning‐driven resolution enhancement primarily depends on sophisticated network architectures and extensive datasets. A lightweight seismic super‐resolution model based on contrastive learning and knowledge distillation is proposed. Knowledge distillation is implemented by training a compact student network to mimic a powerful teacher model, thereby reducing reliance on extensive datasets and complex architectures. Contrastive learning is leveraged to align the bottleneck features encoded from the teacher network with the ones from the student network across different noisy inputs. The student network's total loss comprises a supervised loss with ground‐truth labels, a distillation loss with the teacher's pseudo‐labels and a feature‐matching loss derived from the bottleneck features of both networks. The comparative experiments were conducted on four field datasets and 3200 pairs of slices extracted from 800 pairs of synthetic three‐dimensional seismic cubes. Experimental results demonstrate that the proposed model achieves similar to or better performance than the comparison models for noise suppression and weak signal recovery, even with only parameters and training data compared to the reference model.
科研通智能强力驱动
Strongly Powered by AbleSci AI