Subject-Independent EEG-based Emotion Recognition using Adversarial Learning

Sunhee Hwang, Minsong Ki, Kibeom Hong, Hyeran Byun

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Electroencephalography (EEG) based emotion recognition studies have been conducted in recent years. Most prior researches are based on subject-dependent models since EEG signals have a large variation between individuals. In this paper, we propose a novel EEG-based emotion recognition approach that addresses the challenging issue of the subject-dependency. To solve the problem, we design a multi-task deep neural network, which consists of two objectives. The first one is to classify subject-independent emotional labels, and the second is to make the model cannot distinguish the subject labels. To achieve the latter purpose, we adversarially learn the proposed model, which has three components: 1) Emotion classification module, 2) Subject classification module, 3) Adversarial module. To make the model confuse the subject labels, we apply the randomization function to the subject classification module for adversarial learning. For the experiment, we evaluate the proposed method to classify EEG emotional labels with a leave-one-subject-out scheme on SEED dataset, which has recorded EEG from 15 participants and contains three emotional labels: Positive, negative, and neutral. We compare the proposed method with a single-task deep neural network and multi-task model that classify emotional labels with subject labels. Our experimental results show that the proposed method achieves better results than the others with an average accuracy of 75.31%. Moreover, the standard deviation of our model was 7.33%, which is the lowest with the compared models.

Original languageEnglish
Title of host publication8th International Winter Conference on Brain-Computer Interface, BCI 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728147079
DOIs
Publication statusPublished - 2020 Feb
Event8th International Winter Conference on Brain-Computer Interface, BCI 2020 - Gangwon, Korea, Republic of
Duration: 2020 Feb 262020 Feb 28

Publication series

Name8th International Winter Conference on Brain-Computer Interface, BCI 2020

Conference

Conference8th International Winter Conference on Brain-Computer Interface, BCI 2020
CountryKorea, Republic of
CityGangwon
Period20/2/2620/2/28

All Science Journal Classification (ASJC) codes

  • Behavioral Neuroscience
  • Cognitive Neuroscience
  • Artificial Intelligence
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Subject-Independent EEG-based Emotion Recognition using Adversarial Learning'. Together they form a unique fingerprint.

  • Cite this

    Hwang, S., Ki, M., Hong, K., & Byun, H. (2020). Subject-Independent EEG-based Emotion Recognition using Adversarial Learning. In 8th International Winter Conference on Brain-Computer Interface, BCI 2020 [9061624] (8th International Winter Conference on Brain-Computer Interface, BCI 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BCI48061.2020.9061624