國家衛生研究院 NHRI:Item 3990099045/11494

NHRI > Institute of Biomedical Engineering and Nanomedicine > Li-Wei Kuo > Conference Papers/Meeting Abstract > Item 3990099045/11494

Please use this identifier to cite or link to this item: http://ir.nhri.org.tw/handle/3990099045/11494

Title:	Integrating perceivers neural-perceptual responses using a deep voting fusion network for automatic vocal emotion decoding
Authors:	Hsieh, WT;Yang, HC;Wu, YT;Tsai, FS;Kuo, LW;Lee, CC
Contributors:	Institute of Biomedical Engineering and Nanomedicine
Abstract:	Understanding neuro-perceptual mechanism of vocal emotion perception continues to be an important research direction not only in advancing scientific knowledge but also in inspiring more robust affective computing technologies. The large variabilities in the manifested fMRI signals among subjects has been shown to be due to the effect of individual difference, i.e., inter-subject variability. However, relatively few works have developed modeling techniques in task of automatic neuro-perceptual decoding to handle such idiosyncrasies. In our work, we propose a novel computation method of deep voting fusion neural network architecture by learning an adjusted weight matrix applied at the fusion layer. The framework achieves an unweighted average recall of 53.10% in a four-class vocal emotion states decoding task, i.e., a relative improvement of 8.9% over a two-stage SVM decision-level fusion. Our framework demonstrates its effectiveness in handling individual differences. Further analysis is conducted to study the properties of the learned adjusted weight matrix as a function of emotion classification accuracy.
Date:	2018-09-10
Relation:	ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2018 Sep 10;2018-April:1015-1019.
Link to:	http://dx.doi.org/10.1109/ICASSP.2018.8462352
Cited Times(WOS):	https://www.webofscience.com/wos/woscc/full-record/WOS:000446384601042
Cited Times(Scopus):	https://www.scopus.com/inward/record.url?partnerID=HzOxMe3b&scp=85054205985
Appears in Collections:	[Li-Wei Kuo] Conference Papers/Meeting Abstract

Files in This Item:

File	Description	Size	Format
SCP85054205985.pdf		561Kb	Adobe PDF	266	View/Open

Loading...