Hand-free Natural User Interface for VR HMD with IR based facial gesture tracking sensor

Jinhyuk Kim, Jaekwang Cha, Hojun Lee, Shiho Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

We proposed a hand-free Natural User Interface (NUI) for VR Head-Mounted-Display (HMD) with infra-red (IR) based sensor tracking facial gestures. We have realized NUI based on the real-time recognition of user intuitions for VR HMD without any additional control devices except for a built-in Gyroscope and IR couplers with readout circuitry integrated in the foam interface of an HMD. We implemented seven control commands affordable for 3D interactions with virtual objects. The experimental data show that the proposed system provides a convenient and efficient 2D/3D user interface for both manipulating objects and controlling commands while wearing a VR HMD.

Original languageEnglish
Title of host publicationProceedings - VRST 2017
Subtitle of host publication23rd ACM Conference on Virtual Reality Software and Technology
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450355483
DOIs
Publication statusPublished - 2017 Nov 8
Event23rd ACM Conference on Virtual Reality Software and Technology, VRST 2017 - Gothenburg, Sweden
Duration: 2017 Nov 82017 Nov 10

Publication series

NameProceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST
VolumePart F131944

Other

Other23rd ACM Conference on Virtual Reality Software and Technology, VRST 2017
CountrySweden
CityGothenburg
Period17/11/817/11/10

All Science Journal Classification (ASJC) codes

  • Software

Fingerprint Dive into the research topics of 'Hand-free Natural User Interface for VR HMD with IR based facial gesture tracking sensor'. Together they form a unique fingerprint.

  • Cite this

    Kim, J., Cha, J., Lee, H., & Kim, S. (2017). Hand-free Natural User Interface for VR HMD with IR based facial gesture tracking sensor. In S. N. Spencer (Ed.), Proceedings - VRST 2017: 23rd ACM Conference on Virtual Reality Software and Technology [a62] (Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST; Vol. Part F131944). Association for Computing Machinery. https://doi.org/10.1145/3139131.3143420