Adaptive control of transonic buffet and buffeting flow with deep reinforcement learning

The optimal control of flow and fluid–structure interaction (FSI) systems often requires an accurate model of the controlled system. However, for strongly nonlinear systems, acquiring an accurate dynamic model is a significant challenge. In this study, we employ the deep reinforcement learning (DRL) method, which does not rely on an accurate model of the controlled system, to address the control of transonic buffet (unstable flow) and transonic buffeting (structural vibration). DRL uses a deep neural network to describe the control law and optimizes it based on data obtained from interaction between control law and flow or FSI system. This study analyzes the mechanism of transonic buffet and transonic buffeting to guide the design of control system. Aiming at the control of transonic buffet, which is an unstable flow system, the control law optimized by DRL can quickly suppress fluctuating load of buffet by taking the lift coefficient as feedback signal. For the frequency lock-in phenomenon in transonic buffeting flow, which is an unstable FSI system, we add the moment coefficient and pitching displacement to feedback signal to observe pitching vibration mode. The control law optimized by DRL can also effectively eliminate or reduce pitching vibration displacement of airfoil and buffet load. The simulation results in this study show that DRL can adapt to the control of two different dynamic modes: typical forced response and FSI instability under transonic buffet, so it has a wide application prospect in the design of control laws for complex flow or FSI systems.