360° video has been becoming one of the major media in recent years,providing immersive experience for viewers with more interactions compared with traditional videos.Most of today's implementations rely on bulky Head-Mounted Displays(HMDs)or require touch screen operations for interactive display,which are not only expensive but also inconvenient for viewers.In this paper,we demonstrate that interactive 360° video streaming can be done with hints from gaze movement detected by the front camera of today's mobile devices(e.g.,a smartphone).We design a lightweight real-time gaze point tracking method for this purpose.We integrate it with streaming module and apply a dynamic margin adaption algorithm to minimize the overall energy consumption for battery-constrained mobile devices.Our experiments on state-of-the-art smartphones show the feasibility of our solution and its energy efficiency toward cost-effective real-time 360° video streaming.

School of Computing Science,Simon Fraser University,Burnaby,V5A 1S6,Canada

[1]Linfeng Shen;Yuchi Chen;Jiangchuan Liu-.Gaze-Assisted Viewport Control for 360° Video on Smartphone)[J].计算机科学技术学报（英文版）,2022(04):906-918

Gaze,Viewport,Smartphone,HMDs

Assisted,Control,Video,has,been,becoming,major,media,recent,years,providing,immersive,experience,viewers,more,interactions,compared,traditional,videos,Most,today,implementations,rely,bulky,Head,Mounted,Displays,require,touch,screen,operations,interactive,display,which,not,only,expensive,but,also,inconvenient,In,this,paper,demonstrate,that,streaming,can,done,hints,from,gaze,movement,detected,by,front,camera,mobile,devices,We,design,lightweight,real,point,tracking,method,purpose,integrate,module,apply,dynamic,margin,adaption,algorithm,minimize,overall,energy,consumption,battery,constrained,Our,experiments,state,smartphones,show,feasibility,our,solution,its,efficiency,toward,cost,effective

0.674458