The extensive usage of the facial image threshing machine for facial emotion recognition performance

Jung Hwan Kim, Alwin Poulose, Dong Seog Han

Research output: Contribution to journalArticlepeer-review

58 Scopus citations

Abstract

Facial emotion recognition (FER) systems play a significant role in identifying driver emotions. Accurate facial emotion recognition of drivers in autonomous vehicles reduces road rage. However, training even the advanced FER model without proper datasets causes poor performance in real-time testing. FER system performance is heavily affected by the quality of datasets than the quality of the algorithms. To improve FER system performance for autonomous vehicles, we propose a facial image threshing (FIT) machine that uses advanced features of pre-trained facial recognition and training from the Xception algorithm. The FIT machine involved removing irrelevant facial images, collecting facial images, correcting misplacing face data, and merging original datasets on a massive scale, in addition to the data-augmentation technique. The final FER results of the proposed method improved the validation accuracy by 16.95% over the conventional approach with the FER 2013 dataset. The confusion matrix evaluation based on the unseen private dataset shows a 5% improvement over the original approach with the FER 2013 dataset to confirm the real-time testing.

Original languageEnglish
Article number2026
Pages (from-to)1-20
Number of pages20
JournalSensors
Volume21
Issue number6
DOIs
StatePublished - 2 Mar 2021

Keywords

  • Autonomous driving
  • CK+ Dataset
  • Convolution neural network (CNN)
  • Facial emotion recognition (FER)
  • FER 2013 Dataset
  • MTCNN
  • ResNet
  • Xception

Fingerprint

Dive into the research topics of 'The extensive usage of the facial image threshing machine for facial emotion recognition performance'. Together they form a unique fingerprint.

Cite this