相互信息
特征选择
熵(时间箭头)
计算机科学
模式识别(心理学)
人工智能
数据挖掘
噪音(视频)
样本熵
噪声测量
降噪
物理
量子力学
图像(数学)
作者
Chan Xu,Silu Chen,Xiangjie Kong,Chi Zhang,Guilin Yang,Zaojun Fang
标识
DOI:10.1109/tii.2025.3534417
摘要
Feature selection is challenging in high-dimensional and small-sample data, particularly in industrial informatics with diverse noise sources. The information entropy of feature noise is included in mutual information of a label and noise-corrupted features, which can be removed to increase classification accuracy. In this article, we propose a robust feature selection method by eliminating feature noise in the relevance measure. Feature noise is modeled as a zero-mean censored normal distribution, so its entropy is determined by solving the variance equation based on the maximum entropy principle. Then, a noisy channel for feature transmission is proposed to extract class-relevant noise component. Furthermore, a noise-free mutual information metric is developed by removing noise entropy within mutual information. Eventually, a novel criterion is proposed by maximizing relevance based on noise-free mutual information while minimizing redundancy. Experimental results confirm the effectiveness of our approach on datasets from various industrial sectors.
科研通智能强力驱动
Strongly Powered by AbleSci AI