Abstract
In this paper, we propose a deep learning-based psychological stress detection algorithm using speech signals. With increasing demands for communication between human and intelligent systems, automatic stress detection is becoming an interesting research topic. Stress can be reliably detected by measuring the level of specific hormones (e.g., cortisol), but this is not a convenient method for the detection of stress in human-machine interactions. The proposed algorithm first extracts mel-filterbank coefficients using preprocessed speech data and then predicts the status of stress output using a binary decision criterion (i.e., stressed or unstressed) using long short-term memory (LSTM) and feed-forward networks. To evaluate the performance of the proposed algorithm, speech, video, and bio-signal data were collected in a well-controlled environment. We utilized only speech signals in the decision process from subjects whose salivary cortisol level varies over 10%. Using the proposed algorithm, we achieved 66.4% accuracy in detecting the stress state from 25 subjects, thereby demonstrating the possibility of utilizing speech signals for automatic stress detection.
Original language | English |
---|---|
Title of host publication | AVSU 2018 - Proceedings of the 2018 Workshop on Audio-Visual Scene Understanding for Immersive Multimedia, Co-located with MM 2018 |
Publisher | Association for Computing Machinery, Inc |
Pages | 11-15 |
Number of pages | 5 |
ISBN (Electronic) | 9781450359771 |
DOIs | |
Publication status | Published - 2018 Oct 26 |
Event | 2018 Workshop on Audio-Visual Scene Understanding for Immersive Multimedia, AVSU 2018, co-located with MM 2018 - Seoul, Korea, Republic of Duration: 2018 Oct 26 → … |
Publication series
Name | AVSU 2018 - Proceedings of the 2018 Workshop on Audio-Visual Scene Understanding for Immersive Multimedia, Co-located with MM 2018 |
---|
Conference
Conference | 2018 Workshop on Audio-Visual Scene Understanding for Immersive Multimedia, AVSU 2018, co-located with MM 2018 |
---|---|
Country | Korea, Republic of |
City | Seoul |
Period | 18/10/26 → … |
Bibliographical note
Funding Information:The work is supported by the National Research Foundation of Korea. under Grant No.: 2016-0-00562 and Korean Flagship Project on AI (http://www.nrf.re.kr). vfill
Publisher Copyright:
© 2018 Association for Computing Machinery.
All Science Journal Classification (ASJC) codes
- Software
- Media Technology
- Computer Graphics and Computer-Aided Design
- Computer Vision and Pattern Recognition