自编码
计算机科学
人工神经网络
预处理器
人工智能
机器学习
计算复杂性理论
鉴定(生物学)
推论
数据预处理
数据挖掘
质量(理念)
实现(概率)
还原(数学)
模式识别(心理学)
算法
数学
认识论
统计
哲学
生物
植物
几何学
作者
Lareb Zar Khan,Joao Pedro,Nelson Costa,Piero Castoldi,Antonio Napoli,Nicola Sambo
出处
期刊:Journal of Optical Communications and Networking
[The Optical Society]
日期:2022-12-23
卷期号:15 (1): 57-57
摘要
Despite the increased exploration of machine learning (ML) techniques for the realization of autonomous optical networks, less attention has been paid to data quality, which is critical for ML performance. Failure management in optical networks using ML is constrained by the fact that some failures may occur more frequently than others, resulting in highly imbalanced datasets for the training of ML models. To address this limitation, a variational-autoencoder-based data augmentation technique is investigated in this paper, which can be used during data preprocessing to improve data quality. The synthetic data generated by the variational autoencoder are utilized to reduce imbalance in an experimental dataset used for training of neural networks (NNs) for failure management in optical networks. First, it is shown that, with a modified training dataset, the training time of NNs can be reduced. Reductions of up to 37.1% and 60.6% are achieved for failure detection and cause identification, respectively. Second, it is shown that improvement in the quality of the training dataset can reduce the computational complexity of NNs during the inference phase. As determined analytically, almost 68% reduction in computational complexity is achieved for the NN used for failure cause identification. Finally, data augmentation is shown to achieve improvement in classification accuracy. This work demonstrates improvement of up to 7.32%.
科研通智能强力驱动
Strongly Powered by AbleSci AI