DodecaPen: Accurate 6DoF tracking of a passive stylus

Po Chen Wu, Robert Wang, Kenrick Kin, Christopher Twigg, Shangchen Han, Ming Hsuan Yang, Shao Yi Chien

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

We propose a system for real-time six degrees of freedom (6DoF) tracking of a passive stylus that achieves submillimeter accuracy, which is suitable for writing or drawing in mixed reality applications. Our system is particularly easy to implement, requiring only a monocular camera, a 3D printed dodecahedron, and hand-glued binary square markers. The accuracy and performance we achieve are due to model-based tracking using a calibrated model and a combination of sparse pose estimation and dense alignment. We demonstrate the system performance in terms of speed and accuracy on a number of synthetic and real datasets, showing that it can be competitive with state-of-the-art multi-camera motion capture systems. We also demonstrate several applications of the technology ranging from 2D and 3D drawing in VR to general object manipulation and board games.

Original languageEnglish
Title of host publicationUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages365-374
Number of pages10
ISBN (Electronic)9781450349819
DOIs
Publication statusPublished - 2017 Oct 20
Event30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Canada
Duration: 2017 Oct 222017 Oct 25

Publication series

NameUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
CountryCanada
CityQuebec City
Period17/10/2217/10/25

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Cite this

Wu, P. C., Wang, R., Kin, K., Twigg, C., Han, S., Yang, M. H., & Chien, S. Y. (2017). DodecaPen: Accurate 6DoF tracking of a passive stylus. In UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (pp. 365-374). (UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery, Inc. https://doi.org/10.1145/3126594.3126664