The strong stochastic disturbance caused by large-scale distributed energy access to power grids affects the se-curity,stability and economic operations of the power grid.A novel multiple-step greedy policy based on the consensus Q-learning (MSGP-CQ) strategy is proposed in this paper,which is an automatic generation control (AGC) for distributed energy incorporating multiple-step greedy attribute and multiple-level allocation strategy.The convergence speed and learning efficiency in the MSGP algorithm are accelerated through the predictive multiple-step iteration updating in the proposed strategy,and the CQ algorithm is adopted with collaborative consensus and self-learning characteristics to enhance the adaptability of the power allocation strategy under the strong stochastic disturbances and obtain the total power commands in the power grid and the dynamic optimal allocations of the unit power.The simulations of the improved IEEE two-area load-frequency control (LFC)power system and the interconnected system model of intelligent distribution network (IDN) groups incorporating a large amount of distributed energy show that the proposed strategy can achieve the optimal coordinated control and power allocation in the power grid.The algorithm MSGP-CQ has stronger robustness and faster dynamic optimization speed and can reduce generation costs.Meanwhile it can also solve the strong stochastic distur-bance caused by large-scale distributed energy access to the grid compared with some existing intelligent algorithms.

Lei Xi;Le Zhang;Yanchun Xu;Shouxiang Wang;Chao Yang

College of Electrical Engineering and New Energy,and the Yichang Key Laboratory of Defense and Control of Cyber-Physical Systems,China Three Gorges University,Yichang 443002,China;College of Electrical Engineering and New Energy,China Three Gorges University,Yichang 443002,China;Key Laboratory of Smart Grid of Ministry of Education,Tianjin University,Tianjin 300072,China

中国电机工程学会电力与能源系统学报（英文版）

[1]Lei Xi;Le Zhang;Yanchun Xu;Shouxiang Wang;Chao Yang-.Automatic Generation Control Based on Multiple-step Greedy Attribute and Multiple-level Allocation Strategy)[J].中国电机工程学会电力与能源系统学报（英文版）,2022(01):281-292

MSGP

Automatic,Generation,Control,Based,Multiple,step,Greedy,Attribute,level,Allocation,Strategy,stochastic,caused,by,large,scale,distributed,energy,access,power,grids,affects,curity,stability,economic,operations,novel,multiple,greedy,policy,consensus,learning,CQ,strategy,proposed,this,paper,which,automatic,generation,control,AGC,incorporating,attribute,convergence,speed,efficiency,accelerated,through,predictive,iteration,updating,adopted,collaborative,self,characteristics,enhance,adaptability,under,disturbances,obtain,total,commands,dynamic,optimal,allocations,unit,simulations,improved,IEEE,area,load,frequency,LFC,system,interconnected,model,intelligent,distribution,network,IDN,groups,amount,show,that,can,achieve,coordinated,stronger,robustness,faster,optimization,reduce,costs,Meanwhile,also,solve,compared,some,existing,algorithms

0.49279