Skeleton-based action recognition has al-ways been an important research topic in computer vis-ion.Most of the researchers in this field currently pay more attention to actions performed by a single person while there is very little work dedicated to the identifica-tion of interactions between two people.However,the practical application of interaction recognition is actually more critical in our society considering that actions are often performed by multiple people.How to design an ef-fective scheme to learn discriminative spatial and tempor-al representations for skeleton-based interaction recogni-tion is still a challenging problem.Focusing on the char-acteristics of skeleton data for interactions,we first define the moving distance to distinguish the action status of the participants.Then some view-invariant relative features are proposed to fully represent the spatial and temporal relationship of the skeleton sequence.Further,a new cod-ing method is proposed to obtain the novel relative fea-ture representations.Finally,we design a three-stream CNN model to learn deep features for interaction recogni-tion.We evaluate our method on SBU dataset,NTU RGB+D 60 dataset and NTU RGB+D 120 dataset.The experimental results also verify that our method is effect-ive and exhibits great robustness compared with current state-of-the-art methods.

LI Yanshan;GUO Tianyu;LIU Xing;LUO Wenhan;XIE Weixin

ATR National Key Laboratory of Defense Technology,Shenzhen University,Shenzhen 518000,China;Guangdong Key Laboratory of Intelligent Information Processing,Shenzhen University,Shenzhen 518000,China;Tencent,Shenzhen 518000,China

电子学报（英文）

[1]LI Yanshan;GUO Tianyu;LIU Xing;LUO Wenhan;XIE Weixin-.Action Status Based Novel Relative Feature Representations for Interaction Recognition)[J].电子学报（英文）,2022(01):168-180

tempor

Action,Status,Based,Novel,Relative,Feature,Representations,Interaction,Recognition,Skeleton,recognition,has,ways,been,important,topic,computer,vis,Most,researchers,this,field,currently,pay,more,attention,performed,by,single,person,while,there,very,little,work,dedicated,identifica,interactions,between,two,people,However,practical,application,actually,critical,our,society,considering,that,often,multiple,design,fective,scheme,learn,discriminative,spatial,representations,skeleton,still,challenging,problem,Focusing,char,acteristics,first,define,moving,distance,distinguish,status,participants,Then,some,view,invariant,relative,features,proposed,fully,temporal,relationship,sequence,Further,new,cod,obtain,novel,Finally,three,stream,model,deep,We,evaluate,SBU,dataset,NTU,RGB+D,experimental,results,also,verify,effect,exhibits,great,robustness,compared,state,methods

0.576796