典型文献
Meaningful Update and Repair of Markov Decision Processes for Self-Adaptive Systems
文献摘要:
Self-adaptive systems are able to adjust their behaviour in response to environmental condition changes and are widely deployed as Internetwares.Considered as a promising way to handle the ever-growing complexity of software systems,they have seen an increasing level of interest and are covering a variety of applications,e.g.,autonomous car systems and adaptive network systems.Many approaches for the construction of self-adaptive systems have been developed,and probabilistic models,such as Markov decision processes(MDPs),are one of the favoured.However,the majority of them do not deal with the problems of the underlying MDP being obsolete under new environments or unsatisfactory to the given properties.This results in the generated policies from such MDP failing to guide the self-adaptive system to run correctly and meet goals.In this article,we propose a systematic approach to updating an obsolete MDP by exploring new states and transitions and removing obsolete ones,and repairing an unsatisfactory MDP by adjusting its structure in a more meaningful way rather than arbitrarily changing the transition probabilities to values not in line with reality.Experimental results show that the MDPs updated and repaired by our approach are more competent in guiding the self-adaptive systems'correct running compared with the original ones.
文献关键词:
中图分类号:
作者姓名:
Wen-Hua Yang;Min-Xue Pan;Yu Zhou;Zhi-Qiu Huang
作者机构:
College of Computer Science and Technology,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China;State Key Laboratory for Novel Software Technology,Nanjing University,Nanjing 210093,China;Collaborative Innovation Center of Novel Software Technology and Industrialization
文献出处:
引用格式:
[1]Wen-Hua Yang;Min-Xue Pan;Yu Zhou;Zhi-Qiu Huang-.Meaningful Update and Repair of Markov Decision Processes for Self-Adaptive Systems)[J].计算机科学技术学报(英文版),2022(01):106-127
A类:
Internetwares,MDPs,obsolete
B类:
Meaningful,Update,Repair,Markov,Decision,Processes,Self,Adaptive,Systems,adaptive,systems,able,their,behaviour,response,environmental,condition,changes,widely,deployed,Considered,promising,way,handle,growing,complexity,software,they,have,seen,increasing,level,interest,covering,variety,applications,autonomous,car,network,Many,approaches,construction,self,been,developed,probabilistic,models,such,decision,processes,favoured,However,majority,them,do,not,deal,problems,underlying,being,new,environments,unsatisfactory,given,properties,This,results,generated,policies,from,failing,guide,correctly,meet,goals,this,article,propose,systematic,updating,by,exploring,states,transitions,removing,ones,repairing,adjusting,its,structure,more,meaningful,rather,than,arbitrarily,changing,probabilities,values,line,reality,Experimental,show,that,updated,repaired,competent,guiding,running,compared,original
AB值:
0.588524
相似文献
机标中图分类号,由域田数据科技根据网络公开资料自动分析生成,仅供学习研究参考。