Forecasting price in a new hybrid neural network model with machine learning

A key aspect of asset investment and risk management is the study of forecasting stock prices. We investigate the machine learning stock price prediction in a new hybrid neural network model and put forth a forecasting method based on machine learning, composite data preprocessing method and the proposed new neural network model. To address the challenge of predicting stock prices in the face of market complexity and noise, we use the complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) algorithm and the Savitzky–Golay (SG) filter to de-noise and enhance the data, and employ a neural network with three convolutional layers and a long short-term memory (LSTM) layer that enables it to capture complex temporal patterns in the data. We propose a new hybrid neural network prediction model (CEEMDAN-S-C-LSTM) and adopt a machine learning approach to compare it with the benchmark model using CSI 300 index data. The empirical results validate the effectiveness of the frequency decomposition algorithm and the convolutional layer, and demonstrate that our proposed model outperforms the benchmark model. Compared to the best benchmark model, the CEEMDAN-S-C-LSTM model proposed in this study demonstrates a significant improvement in performance. Specifically, it shows a 45.33% reduction in mean absolute error (MAE), 43.44% reduction in root mean square error (RMSE), 45.01% reduction in mean absolute percentage error (MAPE), and 3.90% improvement in coefficient of determination (R2). The study also explores the effect of different numbers of convolution layers and SG filters on the hybrid model. Our research expands on the use of neural networks and machine learning, offering a novel technical approach to making investment decisions and managing risks in financial systems.