In-air hand gesture signature recognition system based on 3-dimensional imagery

Wee How Khoh, Ying Han Pang, Andrew Beng Jin Teoh

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

A traditional online handwritten signature recognition system requires direct contact to acquisition device and usually will leave a traceable print on the surface. This made a signature possible and vulnerable to certain attempts of tracking and imitated. Looking into this shortfall, this paper proposes a novel approach to recognise an individual based on his/ her in-air hand motion while signing his/her signature. In this study, a low-cost acquisition device – Microsoft Kinect sensor is adopted to capture an image sequence of hand gesture signature. Palm region is first located and segmented through a predictive palm segmentation algorithm, which are then combined to generate a volume data. The volume data is condensed and reduced into a motion representation image by means of Motion History Image (MHI), which produces rich motion and temporal information. Several features are extracted from the MHI for empirical evaluation. Two classical recognition modes – identification and verification, are testified with an in-house database (HGS database). The proposed system achieves 90.4% identification accuracy and 3.22% equal error rate in verification mode. The experimental results substantiated the potential of the proposed system.

Original languageEnglish
Pages (from-to)6913-6937
Number of pages25
JournalMultimedia Tools and Applications
Volume78
Issue number6
DOIs
Publication statusPublished - 2019 Mar 1

All Science Journal Classification (ASJC) codes

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'In-air hand gesture signature recognition system based on 3-dimensional imagery'. Together they form a unique fingerprint.

  • Cite this