Adaptive mixture-of-experts models for data glove interface with multiple users

Jong Won Yoon, Sung Ihk Yang, Sung Bae Cho

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Hand gestures have great potential to act as a computer interface in the entertainment environment. However, there are two major problems when implementing the hand gesture-based interface for multiple users, the complexity problem and the personalization problem. In order to solve these problems and implement multi-user data glove interface successfully, we propose an adaptive mixture-of-experts model for data-glove based hand gesture recognition models which can solve both the problems. The proposed model consists of the mixture-of-experts used to recognize the gestures of an individual user, and a teacher network trained with the gesture data from multiple users. The mixture-of-experts model is trained with an expectation-maximization (EM) algorithm and an on-line learning rule. The model parameters are adjusted based on the feedback received from the real-time recognition of the teacher network. The model is applied to a musical performance game with the data glove (5DT Inc.) as a practical example. Comparison experiments using several representative classifiers showed both outstanding performance and adaptability of the proposed method. Usability assessment completed by the users while playing the musical performance game revealed the usefulness of the data glove interface system with the proposed method.

Original languageEnglish
Pages (from-to)4898-4907
Number of pages10
JournalExpert Systems with Applications
Volume39
Issue number5
DOIs
Publication statusPublished - 2012 Apr 1

Fingerprint

Gesture recognition
Interfaces (computer)
Classifiers
Feedback
Experiments

All Science Journal Classification (ASJC) codes

  • Engineering(all)
  • Computer Science Applications
  • Artificial Intelligence

Cite this

@article{e76a22f03e0a40be98ab08676df494a7,
title = "Adaptive mixture-of-experts models for data glove interface with multiple users",
abstract = "Hand gestures have great potential to act as a computer interface in the entertainment environment. However, there are two major problems when implementing the hand gesture-based interface for multiple users, the complexity problem and the personalization problem. In order to solve these problems and implement multi-user data glove interface successfully, we propose an adaptive mixture-of-experts model for data-glove based hand gesture recognition models which can solve both the problems. The proposed model consists of the mixture-of-experts used to recognize the gestures of an individual user, and a teacher network trained with the gesture data from multiple users. The mixture-of-experts model is trained with an expectation-maximization (EM) algorithm and an on-line learning rule. The model parameters are adjusted based on the feedback received from the real-time recognition of the teacher network. The model is applied to a musical performance game with the data glove (5DT Inc.) as a practical example. Comparison experiments using several representative classifiers showed both outstanding performance and adaptability of the proposed method. Usability assessment completed by the users while playing the musical performance game revealed the usefulness of the data glove interface system with the proposed method.",
author = "Yoon, {Jong Won} and Yang, {Sung Ihk} and Cho, {Sung Bae}",
year = "2012",
month = "4",
day = "1",
doi = "10.1016/j.eswa.2011.10.030",
language = "English",
volume = "39",
pages = "4898--4907",
journal = "Expert Systems with Applications",
issn = "0957-4174",
publisher = "Elsevier Limited",
number = "5",

}

Adaptive mixture-of-experts models for data glove interface with multiple users. / Yoon, Jong Won; Yang, Sung Ihk; Cho, Sung Bae.

In: Expert Systems with Applications, Vol. 39, No. 5, 01.04.2012, p. 4898-4907.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Adaptive mixture-of-experts models for data glove interface with multiple users

AU - Yoon, Jong Won

AU - Yang, Sung Ihk

AU - Cho, Sung Bae

PY - 2012/4/1

Y1 - 2012/4/1

N2 - Hand gestures have great potential to act as a computer interface in the entertainment environment. However, there are two major problems when implementing the hand gesture-based interface for multiple users, the complexity problem and the personalization problem. In order to solve these problems and implement multi-user data glove interface successfully, we propose an adaptive mixture-of-experts model for data-glove based hand gesture recognition models which can solve both the problems. The proposed model consists of the mixture-of-experts used to recognize the gestures of an individual user, and a teacher network trained with the gesture data from multiple users. The mixture-of-experts model is trained with an expectation-maximization (EM) algorithm and an on-line learning rule. The model parameters are adjusted based on the feedback received from the real-time recognition of the teacher network. The model is applied to a musical performance game with the data glove (5DT Inc.) as a practical example. Comparison experiments using several representative classifiers showed both outstanding performance and adaptability of the proposed method. Usability assessment completed by the users while playing the musical performance game revealed the usefulness of the data glove interface system with the proposed method.

AB - Hand gestures have great potential to act as a computer interface in the entertainment environment. However, there are two major problems when implementing the hand gesture-based interface for multiple users, the complexity problem and the personalization problem. In order to solve these problems and implement multi-user data glove interface successfully, we propose an adaptive mixture-of-experts model for data-glove based hand gesture recognition models which can solve both the problems. The proposed model consists of the mixture-of-experts used to recognize the gestures of an individual user, and a teacher network trained with the gesture data from multiple users. The mixture-of-experts model is trained with an expectation-maximization (EM) algorithm and an on-line learning rule. The model parameters are adjusted based on the feedback received from the real-time recognition of the teacher network. The model is applied to a musical performance game with the data glove (5DT Inc.) as a practical example. Comparison experiments using several representative classifiers showed both outstanding performance and adaptability of the proposed method. Usability assessment completed by the users while playing the musical performance game revealed the usefulness of the data glove interface system with the proposed method.

UR - http://www.scopus.com/inward/record.url?scp=84855870850&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84855870850&partnerID=8YFLogxK

U2 - 10.1016/j.eswa.2011.10.030

DO - 10.1016/j.eswa.2011.10.030

M3 - Article

AN - SCOPUS:84855870850

VL - 39

SP - 4898

EP - 4907

JO - Expert Systems with Applications

JF - Expert Systems with Applications

SN - 0957-4174

IS - 5

ER -