Adversarial Data Augmentation and Transfer Net for Scrap Metal Identification Using Laser-Induced Breakdown Spectroscopy Measurement of Standard Reference Materials

In this study, we propose a transfer learning-based classification model for identifying scrap metal using an augmented training dataset consisting of laser-induced breakdown spectroscopy (LIBS) measurement of standard reference material (SRMs) samples, considering varying experimental setups and environmental conditions. LIBS provides unique spectra for identifying unknown samples without complicated sample preparation. Thus, LIBS systems combined with machine learning methods have been actively studied for industrial applications such as scrap metal recycling. However, in machine learning models, a training set of the used samples may not cover the diversity of the scrap metal encountered in field measurements. Moreover, differences in experimental configuration, where laboratory standards and real samples are analyzed in situ, may lead to a wider gap in the distribution of training and test sets, dramatically reducing the performance of the LIBS-based fast classification system for real samples. To address these challenges, we propose a two-step Aug2Tran model. First, we augment the SRM dataset by synthesizing spectra of unobserved types through attenuation of dominant peaks corresponding to sample composition and generating spectra depending on the target sample using a generative adversarial network. Second, we used the augmented SRM dataset to build a robust real-time classification model with a convolutional neural network, which is further customized for the target scrap metal with limited measurements through transfer learning. For evaluation, SRMs of five representative metal types, including aluminum, copper, iron, stainless steel, and brass, are measured with a typical setup to form the SRM dataset. For testing, scrap metal from actual industrial fields is experimented with three different configurations, resulting in eight different test datasets. The experimental results show that the proposed scheme produces an average classification accuracy of 98.25% for the three experimental conditions, as high as the results of the conventional scheme with three separately trained and executed models. Additionally, the proposed model improves the classification accuracy of arbitrarily shaped static or moving samples with various surface contaminations and compositions, and even for differing ranges of charted intensities and wavelengths. Therefore, the proposed Aug2Tran model can be used as a systematic model for scrap metal classification with generalizability and ease of implementation.