典型文献
Improved Heuristic Job Scheduling Method to Enhance Throughput for Big Data Analytics
文献摘要：
Data-parallel computing platforms,such as Hadoop and Spark,are deployed in computing clusters for big data analytics.There is a general tendency that multiple users share the same computing cluster.The schedule of multiple jobs becomes a serious challenge.Over a long period in the past,the Shortest-Job-First(SJF)method has been considered as the optimal solution to minimize the average job completion time.However,the SJF method leads to a low system throughput in the case where a small number of short jobs consume a large amount of resources.This factor prolongs the average job completion time.We propose an improved heuristic job scheduling method,called the Densest-Job-Set-First(DJSF)method.The DJSF method schedules jobs by maximizing the number of completed jobs per unit time,aiming to decrease the average Job Completion Time(JCT)and improve the system throughput.We perform extensive simulations based on Google cluster data.Compared with the SJF method,the DJSF method decreases the average JCT by 23.19％and enhances the system throughput by 42.19％.Compared with Tetris,the job packing method improves the job completion efficiency by 55.4％,so that the computing platforms complete more jobs in a short time span.
文献关键词：
中图分类号：
作者姓名：
Zhiyao Hu;Dongsheng Li
作者机构：
College of Computer,National University of Defense Technology,Changsha 410073,China
文献出处：
引用格式：
[1]Zhiyao Hu;Dongsheng Li-.Improved Heuristic Job Scheduling Method to Enhance Throughput for Big Data Analytics)[J].清华大学学报自然科学版（英文版）,2022(02):344-357
A类：
SJF,Densest,DJSF,Tetris
B类：
Improved,Heuristic,Job,Scheduling,Method,Enhance,Throughput,Big,Data,Analytics,parallel,computing,platforms,such,Hadoop,Spark,deployed,clusters,big,data,analytics,There,general,tendency,that,multiple,users,share,same,jobs,becomes,serious,challenge,Over,period,past,Shortest,First,method,has,been,considered,optimal,solution,minimize,average,completion,However,leads,low,system,throughput,case,where,small,number,short,consume,large,amount,resources,This,prolongs,We,propose,improved,heuristic,scheduling,called,Set,schedules,by,maximizing,completed,unit,aiming,Completion,Time,JCT,perform,extensive,simulations,Google,Compared,decreases,enhances,packing,improves,efficiency,more,span
AB值：
0.497822
相似文献
机标中图分类号，由域田数据科技根据网络公开资料自动分析生成，仅供学习研究参考。
