Gesture-based interactive augmented reality content authoring system using HMD

Jinwook Shim, Yoonsik Yang, Nahyung Kang, Jonghoon Seo, Tack-Don Han

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

This paper proposes an augmented reality content authoring system that enables ordinary users who do not have programming capabilities to easily apply interactive features to virtual objects on a marker via gestures. The purpose of this system is to simplify augmented reality (AR) technology usage for ordinary users, especially parents and preschool children who are unfamiliar with AR technology. The system provides an immersive AR environment with a head-mounted display and recognizes users’ gestures via an RGB-D camera. Users can freely create the AR content that they will be using without any special programming ability simply by connecting virtual objects stored in a database to the system. Following recognition of the marker via the system’s RGB-D camera worn by the user, he/she can apply various interactive features to the marker-based AR content using simple gestures. Interactive features applied to AR content can enlarge, shrink, rotate, and transfer virtual objects with hand gestures. In addition to this gesture-interactive feature, the proposed system also allows for tangible interaction using markers. The AR content that the user edits is stored in a database, and is retrieved whenever the markers are recognized. The results of comparative experiments conducted indicate that the proposed system is easier to use and has a higher interaction satisfaction level than AR environments such as fixed-monitor and touch-based interaction on mobile screens.

Original languageEnglish
Pages (from-to)57-69
Number of pages13
JournalVirtual Reality
Volume20
Issue number1
DOIs
Publication statusPublished - 2016 Mar 1

Fingerprint

Helmet mounted displays
Augmented reality
Cameras
Display devices

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Cite this

Shim, Jinwook ; Yang, Yoonsik ; Kang, Nahyung ; Seo, Jonghoon ; Han, Tack-Don. / Gesture-based interactive augmented reality content authoring system using HMD. In: Virtual Reality. 2016 ; Vol. 20, No. 1. pp. 57-69.
@article{3baa209d790546ae9ff96f074fe7c2bc,
title = "Gesture-based interactive augmented reality content authoring system using HMD",
abstract = "This paper proposes an augmented reality content authoring system that enables ordinary users who do not have programming capabilities to easily apply interactive features to virtual objects on a marker via gestures. The purpose of this system is to simplify augmented reality (AR) technology usage for ordinary users, especially parents and preschool children who are unfamiliar with AR technology. The system provides an immersive AR environment with a head-mounted display and recognizes users’ gestures via an RGB-D camera. Users can freely create the AR content that they will be using without any special programming ability simply by connecting virtual objects stored in a database to the system. Following recognition of the marker via the system’s RGB-D camera worn by the user, he/she can apply various interactive features to the marker-based AR content using simple gestures. Interactive features applied to AR content can enlarge, shrink, rotate, and transfer virtual objects with hand gestures. In addition to this gesture-interactive feature, the proposed system also allows for tangible interaction using markers. The AR content that the user edits is stored in a database, and is retrieved whenever the markers are recognized. The results of comparative experiments conducted indicate that the proposed system is easier to use and has a higher interaction satisfaction level than AR environments such as fixed-monitor and touch-based interaction on mobile screens.",
author = "Jinwook Shim and Yoonsik Yang and Nahyung Kang and Jonghoon Seo and Tack-Don Han",
year = "2016",
month = "3",
day = "1",
doi = "10.1007/s10055-016-0282-z",
language = "English",
volume = "20",
pages = "57--69",
journal = "Virtual Reality",
issn = "1359-4338",
publisher = "Springer London",
number = "1",

}

Gesture-based interactive augmented reality content authoring system using HMD. / Shim, Jinwook; Yang, Yoonsik; Kang, Nahyung; Seo, Jonghoon; Han, Tack-Don.

In: Virtual Reality, Vol. 20, No. 1, 01.03.2016, p. 57-69.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Gesture-based interactive augmented reality content authoring system using HMD

AU - Shim, Jinwook

AU - Yang, Yoonsik

AU - Kang, Nahyung

AU - Seo, Jonghoon

AU - Han, Tack-Don

PY - 2016/3/1

Y1 - 2016/3/1

N2 - This paper proposes an augmented reality content authoring system that enables ordinary users who do not have programming capabilities to easily apply interactive features to virtual objects on a marker via gestures. The purpose of this system is to simplify augmented reality (AR) technology usage for ordinary users, especially parents and preschool children who are unfamiliar with AR technology. The system provides an immersive AR environment with a head-mounted display and recognizes users’ gestures via an RGB-D camera. Users can freely create the AR content that they will be using without any special programming ability simply by connecting virtual objects stored in a database to the system. Following recognition of the marker via the system’s RGB-D camera worn by the user, he/she can apply various interactive features to the marker-based AR content using simple gestures. Interactive features applied to AR content can enlarge, shrink, rotate, and transfer virtual objects with hand gestures. In addition to this gesture-interactive feature, the proposed system also allows for tangible interaction using markers. The AR content that the user edits is stored in a database, and is retrieved whenever the markers are recognized. The results of comparative experiments conducted indicate that the proposed system is easier to use and has a higher interaction satisfaction level than AR environments such as fixed-monitor and touch-based interaction on mobile screens.

AB - This paper proposes an augmented reality content authoring system that enables ordinary users who do not have programming capabilities to easily apply interactive features to virtual objects on a marker via gestures. The purpose of this system is to simplify augmented reality (AR) technology usage for ordinary users, especially parents and preschool children who are unfamiliar with AR technology. The system provides an immersive AR environment with a head-mounted display and recognizes users’ gestures via an RGB-D camera. Users can freely create the AR content that they will be using without any special programming ability simply by connecting virtual objects stored in a database to the system. Following recognition of the marker via the system’s RGB-D camera worn by the user, he/she can apply various interactive features to the marker-based AR content using simple gestures. Interactive features applied to AR content can enlarge, shrink, rotate, and transfer virtual objects with hand gestures. In addition to this gesture-interactive feature, the proposed system also allows for tangible interaction using markers. The AR content that the user edits is stored in a database, and is retrieved whenever the markers are recognized. The results of comparative experiments conducted indicate that the proposed system is easier to use and has a higher interaction satisfaction level than AR environments such as fixed-monitor and touch-based interaction on mobile screens.

UR - http://www.scopus.com/inward/record.url?scp=84957851871&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84957851871&partnerID=8YFLogxK

U2 - 10.1007/s10055-016-0282-z

DO - 10.1007/s10055-016-0282-z

M3 - Article

AN - SCOPUS:84957851871

VL - 20

SP - 57

EP - 69

JO - Virtual Reality

JF - Virtual Reality

SN - 1359-4338

IS - 1

ER -