DodecaPen: Accurate 6DoF tracking of a passive stylus

Po Chen Wu, Robert Wang, Kenrick Kin, Christopher Twigg, Shangchen Han, Ming Hsuan Yang, Shao Yi Chien

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

We propose a system for real-time six degrees of freedom (6DoF) tracking of a passive stylus that achieves submillimeter accuracy, which is suitable for writing or drawing in mixed reality applications. Our system is particularly easy to implement, requiring only a monocular camera, a 3D printed dodecahedron, and hand-glued binary square markers. The accuracy and performance we achieve are due to model-based tracking using a calibrated model and a combination of sparse pose estimation and dense alignment. We demonstrate the system performance in terms of speed and accuracy on a number of synthetic and real datasets, showing that it can be competitive with state-of-the-art multi-camera motion capture systems. We also demonstrate several applications of the technology ranging from 2D and 3D drawing in VR to general object manipulation and board games.

Original languageEnglish
Title of host publicationUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages365-374
Number of pages10
ISBN (Electronic)9781450349819
DOIs
Publication statusPublished - 2017 Oct 20
Event30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Canada
Duration: 2017 Oct 222017 Oct 25

Publication series

NameUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
CountryCanada
CityQuebec City
Period17/10/2217/10/25

Fingerprint

Cameras

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Cite this

Wu, P. C., Wang, R., Kin, K., Twigg, C., Han, S., Yang, M. H., & Chien, S. Y. (2017). DodecaPen: Accurate 6DoF tracking of a passive stylus. In UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (pp. 365-374). (UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery, Inc. https://doi.org/10.1145/3126594.3126664
Wu, Po Chen ; Wang, Robert ; Kin, Kenrick ; Twigg, Christopher ; Han, Shangchen ; Yang, Ming Hsuan ; Chien, Shao Yi. / DodecaPen : Accurate 6DoF tracking of a passive stylus. UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2017. pp. 365-374 (UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology).
@inproceedings{21781c19fc2f4c70b44109d5a053857b,
title = "DodecaPen: Accurate 6DoF tracking of a passive stylus",
abstract = "We propose a system for real-time six degrees of freedom (6DoF) tracking of a passive stylus that achieves submillimeter accuracy, which is suitable for writing or drawing in mixed reality applications. Our system is particularly easy to implement, requiring only a monocular camera, a 3D printed dodecahedron, and hand-glued binary square markers. The accuracy and performance we achieve are due to model-based tracking using a calibrated model and a combination of sparse pose estimation and dense alignment. We demonstrate the system performance in terms of speed and accuracy on a number of synthetic and real datasets, showing that it can be competitive with state-of-the-art multi-camera motion capture systems. We also demonstrate several applications of the technology ranging from 2D and 3D drawing in VR to general object manipulation and board games.",
author = "Wu, {Po Chen} and Robert Wang and Kenrick Kin and Christopher Twigg and Shangchen Han and Yang, {Ming Hsuan} and Chien, {Shao Yi}",
year = "2017",
month = "10",
day = "20",
doi = "10.1145/3126594.3126664",
language = "English",
series = "UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology",
publisher = "Association for Computing Machinery, Inc",
pages = "365--374",
booktitle = "UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology",

}

Wu, PC, Wang, R, Kin, K, Twigg, C, Han, S, Yang, MH & Chien, SY 2017, DodecaPen: Accurate 6DoF tracking of a passive stylus. in UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, Association for Computing Machinery, Inc, pp. 365-374, 30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017, Quebec City, Canada, 17/10/22. https://doi.org/10.1145/3126594.3126664

DodecaPen : Accurate 6DoF tracking of a passive stylus. / Wu, Po Chen; Wang, Robert; Kin, Kenrick; Twigg, Christopher; Han, Shangchen; Yang, Ming Hsuan; Chien, Shao Yi.

UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2017. p. 365-374 (UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - DodecaPen

T2 - Accurate 6DoF tracking of a passive stylus

AU - Wu, Po Chen

AU - Wang, Robert

AU - Kin, Kenrick

AU - Twigg, Christopher

AU - Han, Shangchen

AU - Yang, Ming Hsuan

AU - Chien, Shao Yi

PY - 2017/10/20

Y1 - 2017/10/20

N2 - We propose a system for real-time six degrees of freedom (6DoF) tracking of a passive stylus that achieves submillimeter accuracy, which is suitable for writing or drawing in mixed reality applications. Our system is particularly easy to implement, requiring only a monocular camera, a 3D printed dodecahedron, and hand-glued binary square markers. The accuracy and performance we achieve are due to model-based tracking using a calibrated model and a combination of sparse pose estimation and dense alignment. We demonstrate the system performance in terms of speed and accuracy on a number of synthetic and real datasets, showing that it can be competitive with state-of-the-art multi-camera motion capture systems. We also demonstrate several applications of the technology ranging from 2D and 3D drawing in VR to general object manipulation and board games.

AB - We propose a system for real-time six degrees of freedom (6DoF) tracking of a passive stylus that achieves submillimeter accuracy, which is suitable for writing or drawing in mixed reality applications. Our system is particularly easy to implement, requiring only a monocular camera, a 3D printed dodecahedron, and hand-glued binary square markers. The accuracy and performance we achieve are due to model-based tracking using a calibrated model and a combination of sparse pose estimation and dense alignment. We demonstrate the system performance in terms of speed and accuracy on a number of synthetic and real datasets, showing that it can be competitive with state-of-the-art multi-camera motion capture systems. We also demonstrate several applications of the technology ranging from 2D and 3D drawing in VR to general object manipulation and board games.

UR - http://www.scopus.com/inward/record.url?scp=85041525013&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85041525013&partnerID=8YFLogxK

U2 - 10.1145/3126594.3126664

DO - 10.1145/3126594.3126664

M3 - Conference contribution

AN - SCOPUS:85041525013

T3 - UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

SP - 365

EP - 374

BT - UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

PB - Association for Computing Machinery, Inc

ER -

Wu PC, Wang R, Kin K, Twigg C, Han S, Yang MH et al. DodecaPen: Accurate 6DoF tracking of a passive stylus. In UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc. 2017. p. 365-374. (UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology). https://doi.org/10.1145/3126594.3126664