Stream processing has emerged as a useful techno-logy for applications which require continuous and low latency computation on infinite streaming data.Since stream proces-sing systems(SPSs)usually require distributed deployment on clusters of servers in face of large-scale of data,it is especially common to meet with failures of processing nodes or communi-cation networks,but should be handled seriously considering service quality.A failed system may produce wrong results or become unavailable,resulting in a decline in user experience or even significant financial loss.Hence,a large amount of fault tolerance approaches have been proposed for SPSs.These appr-oaches often have their own priorities on specific performance concerns,e.g.,runtime overhead and recovery efficiency.Never-theless,there is a lack of a systematic overview and classifica-tion of the state-of-the-art fault tolerance approaches in SPSs,which will become an obstacle for the development of SPSs.Therefore,we investigate the existing achievements and develop a taxonomy of the fault tolerance in SPSs.Further-more,we propose an evaluation framework tailored for fault tolerance,demonstrate the experimental results on two represen-tative open-sourced SPSs and exposit the possible disadvanta-ges in current designs.Finally,we specify future research direc-tions in this domain.

Xiaotong WANG;Chunxi ZHANG;Junhua FANG;Rong ZHANG;Weining QIAN;Aoying ZHOU

School of Data Science and Engineering,East China Normal University,Shanghai 200062,China;Advanced Data Analytics Laboratory of Soochow University,Suzhou 215006,China

计算机科学前沿

[1]Xiaotong WANG;Chunxi ZHANG;Junhua FANG;Rong ZHANG;Weining QIAN;Aoying ZHOU-.A comprehensive study on fault tolerance in stream processing systems)[J].计算机科学前沿,2022(02):75-92

proces,SPSs,appr,oaches,exposit,disadvanta

comprehensive,study,fault,tolerance,processing,systems,Stream,has,emerged,useful,techno,logy,applications,which,require,continuous,low,latency,computation,infinite,streaming,data,Since,usually,distributed,deployment,clusters,servers,face,large,scale,especially,common,meet,failures,nodes,communi,networks,should,handled,seriously,considering,service,quality,failed,may,produce,wrong,results,become,unavailable,resulting,decline,user,experience,even,significant,financial,loss,Hence,amount,approaches,have,been,proposed,These,often,their,own,priorities,specific,performance,concerns,runtime,overhead,recovery,efficiency,Never,theless,there,lack,systematic,overview,classifica,state,art,will,obstacle,development,Therefore,we,investigate,existing,achievements,taxonomy,Further,more,evaluation,framework,tailored,demonstrate,experimental,represen,tative,open,sourced,possible,ges,current,designs,Finally,specify,future,research,direc,this,domain

0.610079