TalentSketch: LSTM-based Sketch for Adaptive and High-Precision Network Measurement

With the massive and rapid growth of network traffic, sketching techniques are widely used to estimate a variety of network flow-level metrics, e.g., flow size, top-k flows, and the number of flows. However, how to cope with the constantly changing network environment and achieve high accuracy with limited switch resources is still a challenging problem. Existing studies do not well address the issues of identifying and correcting the inaccurately estimated flows. Therefore, we propose TalentSketch, an adaptive and high-precision hybrid measurement framework based on LSTM. TalentSketch uses LSTM to learn the sketch features with the captured traffic information. It could identify the inaccurately estimated flows with an error-prone flow model and correct them with a well-trained regression model. We conduct extensive experiments to verify the performance of TalentSketch. Experimental results show that, without increasing switch resource overhead, TalentSketch improves the measurement accuracy of different kinds of sketches by 12%∼23%. More importantly, it can track network fluctuations and provide feedback on the overall accuracy of a sketch in real-time.