In neural speech enhancement,a mismatch exists between the training objective,i.e.,Mean-Square Error(MSE),and perceptual quality evaluation metrics,i.e.,perceptual evaluation of speech quality and short-time objective intelligibility.We propose a novel reinforcement learning algorithm and network architecture,which incorporate a non-differentiable perceptual quality evaluation metric into the objective function using a dynamic filter module.Unlike the traditional dynamic filter implementation that directly generates a convolution kernel,we use a filter generation agent to predict the probability density function of a multivariate Gaussian distribution,from which we sample the convolution kernel.Experimental results show that the proposed reinforcement learning method clearly improves the perceptual quality over other supervised learning methods with the MSE objective function.

Xiang Hao;Chenglin Xu;Lei Xie;Haizhou Li

School of Computer Science,Northwestern Polytechnical University,Xi'an 710000,China;Department of Electrical and Computer Engineering,National University of Singapore,Singapore 710129,Singapore

清华大学学报自然科学版（英文版）

[1]Xiang Hao;Chenglin Xu;Lei Xie;Haizhou Li-.Optimizing the Perceptual Quality of Time-Domain Speech Enhancement with Reinforcement Learning)[J].清华大学学报自然科学版（英文版）,2022(06):939-947

Optimizing,Perceptual,Quality,Time,Domain,Speech,Enhancement,Reinforcement,Learning,In,neural,speech,enhancement,mismatch,exists,between,training,objective,Mean,Square,Error,MSE,perceptual,quality,evaluation,metrics,short,intelligibility,We,novel,reinforcement,learning,algorithm,network,architecture,which,incorporate,differentiable,into,function,using,dynamic,filter,module,Unlike,traditional,implementation,that,directly,generates,convolution,kernel,use,generation,agent,predict,probability,density,multivariate,Gaussian,distribution,from,sample,Experimental,results,show,proposed,clearly,improves,over,other,supervised,methods

0.659301