典型文献
Multimodal Emotion Recognition Based on Facial Expression and ECG Signal
文献摘要：
As a key link in human-computer interaction, emotion recognition can enable robots to correctly perceive user emotions and provide dynamic and adjustable services according to the emotional needs of different users, which is the key to improve the cognitive level of robot service. Emotion recognition based on facial expression and electrocar-diogram has numerous industrial applications. First, three-dimensional convolutional neural network deep learning archi-tecture is utilized to extract the spatial and temporal features from facial expression video data and electrocardiogram (ECG) data, and emotion classification is carried out. Then two modalities are fused in the data level and the decision level, respectively, and the emotion recognition results are then given. Finally, the emotion recognition results of sin-gle-modality and multi-modality are compared and analyzed. Through the comparative analysis of the experimental re-sults of single-modality and multi-modality under the two fusion methods, it is concluded that the accuracy rate of multi-modal emotion recognition is greatly improved compared with that of single-modal emotion recognition, and deci-sion-level fusion is easier to operate and more effective than data-level fusion.
文献关键词：
中图分类号：
作者姓名：
NIU Jian-wei;AN Yue-qi;NI Jie;JIANG Chang-hua
作者机构：
School of Mechanical Engineering,University of Science and Technology Beijing,Beijing 100083,China;China Astronaut Research and Training Center Beijing,Beijing 404023,China
文献出处：
引用格式：
[1]NIU Jian-wei;AN Yue-qi;NI Jie;JIANG Chang-hua-.Multimodal Emotion Recognition Based on Facial Expression and ECG Signal)[J].包装工程,2022(04):71-79
A类：
electrocar,diogram
B类：
Multimodal,Emotion,Recognition,Based,Facial,Expression,ECG,Signal,key,link,human,computer,interaction,recognition,can,enable,robots,correctly,perceive,emotions,provide,dynamic,adjustable,services,according,emotional,needs,different,users,which,cognitive,level,facial,expression,has,numerous,industrial,applications,First,three,dimensional,convolutional,neural,network,deep,learning,archi,tecture,utilized,extract,spatial,temporal,features,from,video,data,electrocardiogram,classification,carried,out,Then,modalities,fused,decision,respectively,results,then,given,Finally,modality,multi,compared,analyzed,Through,comparative,analysis,experimental,single,under,fusion,methods,concluded,that,accuracy,greatly,improved,easier,operate,more,effective,than
AB值：
0.52166
相似文献
机标中图分类号，由域田数据科技根据网络公开资料自动分析生成，仅供学习研究参考。
