典型文献
Towards autonomous and optimal excavation of shield machine:a deep reinforcement learning-based approach
文献摘要：
Autonomous excavation operation is a major trend in the development of a new generation of intelligent tunnel boring machines (TBMs). However, existing technologies are limited to supervised machine learning and static optimization, which cannot outperform human operation and deal with ever changing geological conditions and the long-term performance measure. The aim of this study is to resolve the problem of dynamic optimization of the shield excavation performance, as well as to achieve autonomous optimal excavation. In this study, a novel autonomous optimal excavation approach that integrates deep reinforcement learning and optimal control is proposed for shield machines. Based on a first-principles analysis of the machine-ground interaction dynamics of the excavation process, a deep neural network model is developed using construction field data consisting of 1.1 million samples. The multi-system coupling mechanism is revealed by establishing an overall system model. Based on the overall system analysis, the autonomous optimal excavation problem is decomposed into a multi-objective dynamic optimization problem and an optimal control problem. Subsequently, a dimensionless multi-objective comprehensive excavation performance measure is proposed. A deep reinforcement learning method is used to solve for the optimal action sequence trajectory, and optimal closed-loop feedback controllers are designed to achieve accurate execution. The performance of the proposed approach is compared to that of human operation by using the construction field data. The simulation results show that the proposed approach not only has the potential to replace human operation but also can significantly improve the comprehensive excavation performance.
文献关键词：
中图分类号：
作者姓名：
Ya-kun ZHANG;Guo-fang GONG;Hua-yong YANG;Yu-xi CHEN;Geng-lin CHEN
作者机构：
State Key Laboratory of Fluid Power and Mechatronic Systems,Zhejiang University,Hangzhou 310027,China;School of Electrical and Power Engineering,China University of Mining and Technology,Xuzhou 221116,China
文献出处：
引用格式：
[1]Ya-kun ZHANG;Guo-fang GONG;Hua-yong YANG;Yu-xi CHEN;Geng-lin CHEN-.Towards autonomous and optimal excavation of shield machine:a deep reinforcement learning-based approach)[J].浙江大学学报（英文版）（A辑：应用物理和工程）,2022(06):458-478
A类：
TBMs
B类：
Towards,autonomous,optimal,excavation,shield,deep,reinforcement,learning,approach,Autonomous,operation,major,trend,development,new,generation,intelligent,tunnel,boring,machines,However,existing,technologies,limited,supervised,static,optimization,which,cannot,outperform,human,deal,changing,geological,conditions,long,term,performance,measure,aim,this,study,resolve,problem,well,achieve,In,novel,that,integrates,proposed,Based,first,principles,analysis,ground,interaction,dynamics,process,neural,network,model,developed,using,construction,field,data,consisting,million,samples,multi,system,coupling,mechanism,revealed,by,establishing,overall,decomposed,into,objective,Subsequently,dimensionless,comprehensive,method,used,sequence,trajectory,closed,loop,feedback,controllers,designed,accurate,execution,compared,simulation,results,show,only,has,potential,replace,but,also,significantly,improve
AB值：
0.474212
相似文献
机标中图分类号，由域田数据科技根据网络公开资料自动分析生成，仅供学习研究参考。
