计算机科学
机器学习
人工智能
入侵检测系统
正确性
数据收集
故障排除
管道(软件)
数据挖掘
数据预处理
水准点(测量)
数据科学
统计
程序设计语言
数学
操作系统
地理
大地测量学
作者
Gints Engelen,Vera Rimmer,Wouter Joosen
出处
期刊:
[Institute of Electrical and Electronics Engineers]
日期:2021-05-01
卷期号:: 7-12
被引量:432
标识
DOI:10.1109/spw53761.2021.00009
摘要
Numerous studies have demonstrated the effectiveness of machine learning techniques in application to network intrusion detection. And yet, the adoption of machine learning for securing large-scale network environments remains challenging. The community acknowledges that network security presents unique challenges for machine learning, and the lack of training data representative of modern traffic remains one of the most intractable issues. New attempts are continuously made to develop high quality benchmark datasets and proper data collection methodologies. The CICIDS2017 dataset is one of the recent results, created to meet the demanding criterion of representativeness for network intrusion detection. In this paper we revisit CICIDS2017 and its data collection pipeline and analyze correctness, validity and overall utility of the dataset for the learning task. During this in-depth analysis, we uncover a series of problems with traffic generation, flow construction, feature extraction and labelling that severely affect the aforementioned properties. We investigate the causes of these shortcomings and address most of them by applying an improved data processing methodology. As a result, more than 20 percent of original traffic traces are reconstructed or relabelled. Machine learning benchmarks on the final dataset demonstrate significant improvements. Our study exemplifies how data collection issues may have enormous impact on model evaluation and provides recommendations for their anticipation and prevention.
科研通智能强力驱动
Strongly Powered by AbleSci AI