Gesture-based interactive augmented reality content authoring system using HMD

Jinwook Shim, Yoonsik Yang, Nahyung Kang, Jonghoon Seo, Tack Don Han

Research output: Contribution to journalArticlepeer-review

14 Citations (Scopus)


This paper proposes an augmented reality content authoring system that enables ordinary users who do not have programming capabilities to easily apply interactive features to virtual objects on a marker via gestures. The purpose of this system is to simplify augmented reality (AR) technology usage for ordinary users, especially parents and preschool children who are unfamiliar with AR technology. The system provides an immersive AR environment with a head-mounted display and recognizes users’ gestures via an RGB-D camera. Users can freely create the AR content that they will be using without any special programming ability simply by connecting virtual objects stored in a database to the system. Following recognition of the marker via the system’s RGB-D camera worn by the user, he/she can apply various interactive features to the marker-based AR content using simple gestures. Interactive features applied to AR content can enlarge, shrink, rotate, and transfer virtual objects with hand gestures. In addition to this gesture-interactive feature, the proposed system also allows for tangible interaction using markers. The AR content that the user edits is stored in a database, and is retrieved whenever the markers are recognized. The results of comparative experiments conducted indicate that the proposed system is easier to use and has a higher interaction satisfaction level than AR environments such as fixed-monitor and touch-based interaction on mobile screens.

Original languageEnglish
Pages (from-to)57-69
Number of pages13
JournalVirtual Reality
Issue number1
Publication statusPublished - 2016 Mar 1

Bibliographical note

Funding Information:
This work was supported by a National Research Foundation of Korea (NRF) Grant (No. NRF-2015R1A2A1A10055673) funded by the Korea government (MEST).

Publisher Copyright:
© 2016, Springer-Verlag London.

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Gesture-based interactive augmented reality content authoring system using HMD'. Together they form a unique fingerprint.

Cite this