典型文献
Minimax Q-learning design for H∞ control of linear discrete-time systems
文献摘要：
The H∞ control method is an effective approach for attenuating the effect of disturbances on practical systems, but it is difficult to obtain the H∞ controller due to the nonlinear Hamilton–Jacobi–Isaacs equation, even for linear systems. This study deals with the design of an H∞ controller for linear discrete-time systems. To solve the related game algebraic Riccati equation (GARE), a novel model-free minimax Q-learning method is developed, on the basis of an offline policy iteration algorithm, which is shown to be Newton's method for solving the GARE. The proposed minimax Q-learning method, which employs off-policy reinforcement learning, learns the optimal control policies for the controller and the disturbance online, using only the state samples generated by the implemented behavior policies. Different from existing Q-learning methods, a novel gradient-based policy improvement scheme is proposed. We prove that the minimax Q-learning method converges to the saddle solution under initially admissible control policies and an appropriate positive learning rate, provided that certain persistence of excitation (PE) conditions are satisfied. In addition, the PE conditions can be easily met by choosing appropriate behavior policies containing certain excitation noises, without causing any excitation noise bias. In the simulation study, we apply the proposed minimax Q-learning method to design an H∞ load-frequency controller for an electrical power system generator that suffers from load disturbance, and the simulation results indicate that the obtained H∞ load-frequency controller has good disturbance rejection performance.
文献关键词：
中图分类号：
作者姓名：
Xinxing LI;Lele XI;Wenzhong ZHA;Zhihong PENG
作者机构：
Information Science Academy,China Electronics Technology Group Corporation,Beijing 100086,China;School of Automation,Beijing Institute of Technology,Beijing 100081,China;Peng Cheng Laboratory,Shenzhen 518052,China
文献出处：
引用格式：
[1]Xinxing LI;Lele XI;Wenzhong ZHA;Zhihong PENG-.Minimax Q-learning design for H∞ control of linear discrete-time systems)[J].信息与电子工程前沿（英文）,2022(03):438-451
A类：
B类：
Minimax,learning,design,discrete,systems,effective,approach,attenuating,disturbances,practical,but,difficult,controller,due,nonlinear,Hamilton,Jacobi,Isaacs,equation,even,This,study,deals,To,solve,related,game,algebraic,Riccati,GARE,novel,model,free,minimax,developed,basis,offline,policy,iteration,algorithm,which,shown,Newton,solving,proposed,employs,reinforcement,learns,optimal,policies,only,state,samples,generated,by,implemented,behavior,Different,from,existing,methods,gradient,improvement,scheme,We,that,converges,saddle,solution,under,initially,admissible,appropriate,positive,provided,certain,persistence,excitation,PE,conditions,are,satisfied,In,addition,can,easily,choosing,containing,noises,without,causing,any,bias,simulation,apply,load,frequency,electrical,power,generator,suffers,results,indicate,obtained,has,good,rejection,performance
AB值：
0.516053
相似文献
机标中图分类号，由域田数据科技根据网络公开资料自动分析生成，仅供学习研究参考。
