Skip to content

Opening book details…

Can I read Towards Machine Learning-Based Emotion Recognition from Multimodal Data on EtoBox?

Towards Machine Learning-Based Emotion Recognition from Multimodal Data by Md. Faiyaz Shahriar; Md. Safkat Azad Arnab; Munia Sarwat Khan; Safwon Sadif Rahman; Mufti Mahmud; M. Shamim Kaiser is a book available to read on EtoBox.

What is Towards Machine Learning-Based Emotion Recognition from Multimodal Data about?

Understanding human emotion is vital to communicate effectively with others, monitor patients, analyse behaviour, and keep an eye on those who are vulnerable. Emotion recognition is essential to achieve a complete human-machine interoperability experience. Artificial intelligence, mainly machine learning (ML), have been used in recent years to improve the model for recognising emotions from a single type of data. A multimodal system has been proposed that uses text, facial expressions, and speech signals to identify emotions in this work. The MobileNet architecture is used to predict emotion from facial expressions, and different ML classifiers are used to predict emotion from text and speech signals in the proposed model. The Facial Expression Recognition 2013 (FER2013) dataset has been used to recognise emotion from facial expressions, whilst the Interactive Emotional Dyadic Motion Capture (IEMOCAP) dataset was used for both text and speech emotion recognition. The proposed ensemble technique consisting of random forest, extreme gradient boosting, and multi-layer perceptron achieves an accuracy of 70.67%, which is better than the unimodal approaches used.

Author
Md. Faiyaz Shahriar; Md. Safkat Azad Arnab; Munia Sarwat Khan; Safwon Sadif Rahman; Mufti Mahmud; M. Shamim Kaiser
Publisher
Springer Nature Singapore Pte Ltd Fka Springer Science + Business Media Singapore Pte Ltd
Published
2023
Language
EN
ISBN
9789811951909
Subjects
Science, Technology, Engineering

More by Md. Faiyaz Shahriar; Md. Safkat Azad Arnab; Munia Sarwat Khan; Safwon Sadif Rahman; Mufti Mahmud; M. Shamim Kaiser

Browse all works by Md. Faiyaz Shahriar; Md. Safkat Azad Arnab; Munia Sarwat Khan; Safwon Sadif Rahman; Mufti Mahmud; M. Shamim Kaiser

Similar books