Confidence-based Deep Multimodal Fusion for Activity Recognition

Jun Ho Choi, Jong Seok Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Human activity recognition using multimodal sensors is widely studied in recent days. In this paper, we propose an end-to-end deep learning model for activity recognition, which fuses features of multiple modalities based on their confidence scores that are automatically determined. The confidence scores efficiently regulate the level of contribution of each sensor. We conduct an experiment on the latest activity recognition dataset. The results confirm that our model outperforms existing methods. We submit the proposed model to the Sussex-Huawei Locomotion-Transportation (SHL) recognition challenge [23] with the team name “Yonsei-MCML.”

Original languageEnglish
Title of host publicationUbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers
PublisherAssociation for Computing Machinery, Inc
Pages1548-1556
Number of pages9
ISBN (Electronic)9781450359665
DOIs
Publication statusPublished - 2018 Oct 8
Event2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018 - Singapore, Singapore
Duration: 2018 Oct 82018 Oct 12

Publication series

NameUbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers

Other

Other2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018
CountrySingapore
CitySingapore
Period18/10/818/10/12

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction
  • Information Systems

Fingerprint Dive into the research topics of 'Confidence-based Deep Multimodal Fusion for Activity Recognition'. Together they form a unique fingerprint.

  • Cite this

    Choi, J. H., & Lee, J. S. (2018). Confidence-based Deep Multimodal Fusion for Activity Recognition. In UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers (pp. 1548-1556). (UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers). Association for Computing Machinery, Inc. https://doi.org/10.1145/3267305.3267522