Touch+Finger: Extending touch-based user interface capabilities with “idle” finger gestures in the air

Hyunchul Lim, So Hyun Park, Jungmin Chung, Joonhwan Lee, Changhoon Oh, Bongwon Suh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

In this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the remaining fingers, the “idle” fingers, to perform a variety of hand poses or in-air gestures to extend touch-based user interface capabilities. To fully understand the use of these idle fingers, we constructed a design space based on conventional touch gestures (i.e., single- and multi-touch gestures) and interaction period (i.e., before and during touch). Considering the design space, we investigated the possible movement of the idle fingers and developed a total of 20 Touch+Finger gestures. Using ring-like devices to track the motion of the idle fingers in the air, we evaluated the Touch+Finger gestures on both recognition accuracy and ease of use. They were classified with a recognition accuracy of over 99% and received positive and negative comments from 8 participants. We suggested 8 interaction techniques with Touch+Finger gestures that demonstrate extended touch-based user interface capabilities.

Original languageEnglish
Title of host publicationUIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages335-346
Number of pages12
ISBN (Electronic)9781450359481
DOIs
Publication statusPublished - 2018 Oct 11
Event31st Annual ACM Symposium on User Interface Software and Technology, UIST 2018 - Berlin, Germany
Duration: 2018 Oct 142018 Oct 17

Publication series

NameUIST 2018 - Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

Other

Other31st Annual ACM Symposium on User Interface Software and Technology, UIST 2018
Country/TerritoryGermany
CityBerlin
Period18/10/1418/10/17

Bibliographical note

Publisher Copyright:
© 2018 ACM.

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software

Fingerprint

Dive into the research topics of 'Touch+Finger: Extending touch-based user interface capabilities with “idle” finger gestures in the air'. Together they form a unique fingerprint.

Cite this