Frequency Coordination Control Strategy for Large-Scale Wind Power Transmission Systems Based on Hybrid DC Transmission Technology with Deep Q Network Assistance

Wind power is currently the most mature representative of sustainable energy generation technology, which has been developed and utilized on a large scale worldwide. The random and fluctuating nature of wind power output poses a threat to the secure and stable operation of the system. Consequently, the transmission of wind power has garnered considerable attention as a crucial factor in mitigating the challenges associated with wind power integration. In this paper, an artificial-intelligence-aided frequency coordination control strategy applicable to wind power transmission systems based on hybrid DC transmission technology is proposed. The line commutated converter (LCC) station at the sending end implements the strategy of auxiliary frequency control (AFC) and automatic generation control (AGC) to cooperate with each other in order to assist the system frequency regulation. The AFC controller is designed based on the variable forgetting factor recursive least squares (VFF-RLS) algorithm for system identification. First, the VFF-RLS algorithm is used to identify the open-loop transfer function of the system. Then, the AFC controller is designed based on the root locus method to achieve precise control of the system frequency. The DC line power modulation quantity is introduced in the AGC to automatically track the active power fluctuation and frequency deviation of the system. The AGC utilizes the classical proportional-integral (PI) control. By selecting the integrated time absolute error (ITAE) performance index to construct the reward function, and using a deep Q-network (DQN) for controller parameter optimization, it achieves improved regulation performance for the AGC. The voltage source converter (VSC) station at the receiving end implements an adaptive DC voltage droop control (ADC)strategy. Finally, the effectiveness and robustness of the proposed frequency control strategy are verified through simulation experiments.