典型文献
Multi-level fusion with deep neural networks for multimodal sentiment classification
文献摘要:
The task of multimodal sentiment classification aims to associate multimodal information,such as images and texts with appropriate sentiment polarities.There are various levels that can affect human sentiment in visual and textual modalities.However,most existing methods treat various levels of features independently without having effective method for feature fusion.In this paper,we propose a multi-level fusion classification(MFC)model to predict the sentiment polarity based on the fusing features from different levels by exploiting the dependency among them.The proposed architecture leverages convolutional neural networks(CNNs)with multiple layers to extract levels of features in image and text modalities.Considering the dependencies within the low-level and high-level features,a bi-directional(Bi)recurrent neural network(RNN)is adopted to integrate the learned features from different layers in CNNs.In addition,a conflict detection module is incorporated to address the conflict between modalities.Experiments on the Flickr dataset demonstrate that the MFC method achieves comparable performance compared with strong baseline methods.
文献关键词:
中图分类号:
作者姓名:
Zhang Guangwei;Zhao Bing;Li Ruifan
作者机构:
School of Computer Sciences,Beijing University of Posts and Communications,Beijing 100876,China;School of Science,Yanshan University,Qinhuangdao 066004,China;School of Artificial Intelligence,Beijing University of Posts and Communications,Beijing 100876,China
文献出处:
引用格式:
[1]Zhang Guangwei;Zhao Bing;Li Ruifan-.Multi-level fusion with deep neural networks for multimodal sentiment classification)[J].中国邮电高校学报(英文版),2022(03):25-33
A类:
B类:
Multi,fusion,deep,neural,networks,multimodal,sentiment,classification,task,aims,associate,information,such,images,texts,appropriate,polarities,There,various,levels,that,can,affect,human,visual,textual,modalities,However,most,existing,methods,treat,features,independently,without,having,effective,In,this,paper,MFC,model,predict,polarity,fusing,from,different,by,exploiting,dependency,among,them,proposed,architecture,leverages,convolutional,CNNs,multiple,layers,extract,Considering,dependencies,within,low,high,bi,directional,Bi,recurrent,RNN,adopted,integrate,learned,addition,conflict,detection,module,incorporated,address,between,Experiments,Flickr,dataset,demonstrate,achieves,comparable,performance,compared,strong,baseline
AB值:
0.585786
相似文献
机标中图分类号,由域田数据科技根据网络公开资料自动分析生成,仅供学习研究参考。