Ghost imaging (GI) in harsh environments is well recognized to be challenging, e.g., through abruptly changing complex scattering in dynamic media. Physically induced dynamic and nonlinear scaling factors make the collected single-pixel light intensities distorted, leading to a failure of ghost reconstruction. In this Letter, a new method, to the best of our knowledge, i.e., convolution-based polynomial estimation, is proposed to correct the realizations in GI through abruptly changing complex scattering in dynamic media. The method is developed to eliminate the severe mismatch between a series of illumination patterns and the realizations. Numerical simulations and optical experiments are conducted to show the high robustness and superiority of the proposed method, and high-resolution ghost reconstruction can always be achieved. It is illustrated that the influence of abruptly changing complex scattering in dynamic media is effectively suppressed in GI. The proposed method can offer a solution for GI to retrieve object information in harsh environments.