We propose a system for real-time six degrees of freedom (6DoF) tracking of a passive stylus that achieves submillimeter accuracy, which is suitable for writing or drawing in mixed reality applications. Our system is particularly easy to implement, requiring only a monocular camera, a 3D printed dodecahedron, and hand-glued binary square markers. The accuracy and performance we achieve are due to model-based tracking using a calibrated model and a combination of sparse pose estimation and dense alignment. We demonstrate the system performance in terms of speed and accuracy on a number of synthetic and real datasets, showing that it can be competitive with state-of-the-art multi-camera motion capture systems. We also demonstrate several applications of the technology ranging from 2D and 3D drawing in VR to general object manipulation and board games.
|Title of host publication||UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology|
|Publisher||Association for Computing Machinery, Inc|
|Number of pages||10|
|Publication status||Published - 2017 Oct 20|
|Event||30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Canada|
Duration: 2017 Oct 22 → 2017 Oct 25
|Name||UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology|
|Conference||30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017|
|Period||17/10/22 → 17/10/25|
Bibliographical notePublisher Copyright:
© 2017 ACM.
All Science Journal Classification (ASJC) codes
- Computer Graphics and Computer-Aided Design
- Human-Computer Interaction