Stress recognition using face images and facial landmarks

Taejae Jeon; Hanbyeol Bae; Yongju Lee; Sungjun Jang; Sangyoun Lee

doi:10.1109/ICEIC49074.2020.9051145

Stress recognition using face images and facial landmarks

Taejae Jeon, Hanbyeol Bae, Yongju Lee, Sungjun Jang, Sangyoun Lee

Department of Electrical and Electronic Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

3 Citations (Scopus)

Abstract

In this paper, we propose a stress recognition algorithm using face images and face landmarks. In the case of stress recognition using a biological signal or thermal image, which is being studied a lot, a device for acquiring the corresponding information is required. In order to remedy this shortcoming, we proposed an algorithm that can recognize stress from images acquired with a general camera. We also designed a deep neural network that receives facial landmarks as input to take advantage of the fact that eye, mouth, and head movements are different from normal situations when a person is stressed. Experimental results show that the proposed algorithm recognizes stress more effectively.

Original language	English
Title of host publication	2020 International Conference on Electronics, Information, and Communication, ICEIC 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781728162898
DOIs	https://doi.org/10.1109/ICEIC49074.2020.9051145
Publication status	Published - 2020 Jan
Event	2020 International Conference on Electronics, Information, and Communication, ICEIC 2020 - Barcelona, Spain Duration: 2020 Jan 19 → 2020 Jan 22

Publication series

Name	2020 International Conference on Electronics, Information, and Communication, ICEIC 2020

Conference

Conference	2020 International Conference on Electronics, Information, and Communication, ICEIC 2020
Country/Territory	Spain
City	Barcelona
Period	20/1/19 → 20/1/22

Bibliographical note

Funding Information:
This work was supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) [2016-0-00562(R0124-16-0002), Emotional Intelligence Technology to Infer Human Emotion and Carry on Dialogue Accordingly]

Funding Information:
ACKNOWLEDGMENT This work was supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) [2016-0-00562(R0124-16-0002), Emotional Intelligence Technology to Infer Human Emotion and Carry on Dialogue Accordingly]

Publisher Copyright:
© 2020 IEEE.

All Science Journal Classification (ASJC) codes

Computer Networks and Communications
Computer Science Applications
Hardware and Architecture
Information Systems and Management
Electrical and Electronic Engineering

Access to Document

10.1109/ICEIC49074.2020.9051145

Cite this

Jeon, T., Bae, H., Lee, Y., Jang, S., & Lee, S. (2020). Stress recognition using face images and facial landmarks. In 2020 International Conference on Electronics, Information, and Communication, ICEIC 2020 [9051145] (2020 International Conference on Electronics, Information, and Communication, ICEIC 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICEIC49074.2020.9051145

@inproceedings{ecc8392c63ec4b9cab927308ad712c5a,

title = "Stress recognition using face images and facial landmarks",

abstract = "In this paper, we propose a stress recognition algorithm using face images and face landmarks. In the case of stress recognition using a biological signal or thermal image, which is being studied a lot, a device for acquiring the corresponding information is required. In order to remedy this shortcoming, we proposed an algorithm that can recognize stress from images acquired with a general camera. We also designed a deep neural network that receives facial landmarks as input to take advantage of the fact that eye, mouth, and head movements are different from normal situations when a person is stressed. Experimental results show that the proposed algorithm recognizes stress more effectively.",

author = "Taejae Jeon and Hanbyeol Bae and Yongju Lee and Sungjun Jang and Sangyoun Lee",

note = "Funding Information: This work was supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) [2016-0-00562(R0124-16-0002), Emotional Intelligence Technology to Infer Human Emotion and Carry on Dialogue Accordingly] Funding Information: ACKNOWLEDGMENT This work was supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) [2016-0-00562(R0124-16-0002), Emotional Intelligence Technology to Infer Human Emotion and Carry on Dialogue Accordingly] Publisher Copyright: {\textcopyright} 2020 IEEE.; 2020 International Conference on Electronics, Information, and Communication, ICEIC 2020 ; Conference date: 19-01-2020 Through 22-01-2020",

year = "2020",

month = jan,

doi = "10.1109/ICEIC49074.2020.9051145",

language = "English",

series = "2020 International Conference on Electronics, Information, and Communication, ICEIC 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2020 International Conference on Electronics, Information, and Communication, ICEIC 2020",

address = "United States",

}

Jeon, T, Bae, H, Lee, Y, Jang, S & Lee, S 2020, Stress recognition using face images and facial landmarks. in 2020 International Conference on Electronics, Information, and Communication, ICEIC 2020., 9051145, 2020 International Conference on Electronics, Information, and Communication, ICEIC 2020, Institute of Electrical and Electronics Engineers Inc., 2020 International Conference on Electronics, Information, and Communication, ICEIC 2020, Barcelona, Spain, 20/1/19. https://doi.org/10.1109/ICEIC49074.2020.9051145

Stress recognition using face images and facial landmarks. / Jeon, Taejae; Bae, Hanbyeol; Lee, Yongju et al.

2020 International Conference on Electronics, Information, and Communication, ICEIC 2020. Institute of Electrical and Electronics Engineers Inc., 2020. 9051145 (2020 International Conference on Electronics, Information, and Communication, ICEIC 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Stress recognition using face images and facial landmarks

AU - Jeon, Taejae

AU - Bae, Hanbyeol

AU - Lee, Yongju

AU - Jang, Sungjun

AU - Lee, Sangyoun

N1 - Funding Information: This work was supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) [2016-0-00562(R0124-16-0002), Emotional Intelligence Technology to Infer Human Emotion and Carry on Dialogue Accordingly] Funding Information: ACKNOWLEDGMENT This work was supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) [2016-0-00562(R0124-16-0002), Emotional Intelligence Technology to Infer Human Emotion and Carry on Dialogue Accordingly] Publisher Copyright: © 2020 IEEE.

PY - 2020/1

Y1 - 2020/1

N2 - In this paper, we propose a stress recognition algorithm using face images and face landmarks. In the case of stress recognition using a biological signal or thermal image, which is being studied a lot, a device for acquiring the corresponding information is required. In order to remedy this shortcoming, we proposed an algorithm that can recognize stress from images acquired with a general camera. We also designed a deep neural network that receives facial landmarks as input to take advantage of the fact that eye, mouth, and head movements are different from normal situations when a person is stressed. Experimental results show that the proposed algorithm recognizes stress more effectively.

AB - In this paper, we propose a stress recognition algorithm using face images and face landmarks. In the case of stress recognition using a biological signal or thermal image, which is being studied a lot, a device for acquiring the corresponding information is required. In order to remedy this shortcoming, we proposed an algorithm that can recognize stress from images acquired with a general camera. We also designed a deep neural network that receives facial landmarks as input to take advantage of the fact that eye, mouth, and head movements are different from normal situations when a person is stressed. Experimental results show that the proposed algorithm recognizes stress more effectively.

UR - http://www.scopus.com/inward/record.url?scp=85083503919&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85083503919&partnerID=8YFLogxK

U2 - 10.1109/ICEIC49074.2020.9051145

DO - 10.1109/ICEIC49074.2020.9051145

M3 - Conference contribution

AN - SCOPUS:85083503919

T3 - 2020 International Conference on Electronics, Information, and Communication, ICEIC 2020

BT - 2020 International Conference on Electronics, Information, and Communication, ICEIC 2020

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2020 International Conference on Electronics, Information, and Communication, ICEIC 2020

Y2 - 19 January 2020 through 22 January 2020

ER -

Jeon T, Bae H, Lee Y, Jang S, Lee S. Stress recognition using face images and facial landmarks. In 2020 International Conference on Electronics, Information, and Communication, ICEIC 2020. Institute of Electrical and Electronics Engineers Inc. 2020. 9051145. (2020 International Conference on Electronics, Information, and Communication, ICEIC 2020). doi: 10.1109/ICEIC49074.2020.9051145

Stress recognition using face images and facial landmarks

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this