Adaptive projection augmented reality with object recognition based on deep learning

Yoon Jung Park, Hyocheol Ro, Jung Hyun Byun, Tack Don Han

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This study describes an Adaptive Projection Augmented Reality (AR) system that can provide information in real-time using object recognition. This approach is based on deep-learning through the construction of a 3D space from the real world. Through single system, a projector-camera unit with pan-tilt mechanism, the 360-degree space of user surroundings can be built into a 3-dimensional space and accomplish object and user recognition. a projection AR environment can be generated instantaneously. Information relevant to real-world objects can be provided through real-time interactions between the user and objects. Using spatial interaction, it also allows for achieving intuitive interactions with projection information, user interface (UI), and contents without touch sensors. Several scenarios for the use of this system are described below.

Original languageEnglish
Title of host publicationProceedings of the 24th International Conference on Intelligent User Interfaces, IUI 2019
PublisherAssociation for Computing Machinery
Pages51-52
Number of pages2
ISBN (Electronic)9781450366731
DOIs
Publication statusPublished - 2019 Mar 16
Event24th International Conference on Intelligent User Interfaces, IUI 2019 - Marina del Ray, United States
Duration: 2019 Mar 162019 Mar 20

Publication series

NameInternational Conference on Intelligent User Interfaces, Proceedings IUI

Conference

Conference24th International Conference on Intelligent User Interfaces, IUI 2019
CountryUnited States
CityMarina del Ray
Period19/3/1619/3/20

Fingerprint

Augmented reality
Object recognition
User interfaces
Cameras
Sensors
Deep learning

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction

Cite this

Park, Y. J., Ro, H., Byun, J. H., & Han, T. D. (2019). Adaptive projection augmented reality with object recognition based on deep learning. In Proceedings of the 24th International Conference on Intelligent User Interfaces, IUI 2019 (pp. 51-52). (International Conference on Intelligent User Interfaces, Proceedings IUI). Association for Computing Machinery. https://doi.org/10.1145/3308557.3308678
Park, Yoon Jung ; Ro, Hyocheol ; Byun, Jung Hyun ; Han, Tack Don. / Adaptive projection augmented reality with object recognition based on deep learning. Proceedings of the 24th International Conference on Intelligent User Interfaces, IUI 2019. Association for Computing Machinery, 2019. pp. 51-52 (International Conference on Intelligent User Interfaces, Proceedings IUI).
@inproceedings{5a3700898ccc470e927fed470c75d44e,
title = "Adaptive projection augmented reality with object recognition based on deep learning",
abstract = "This study describes an Adaptive Projection Augmented Reality (AR) system that can provide information in real-time using object recognition. This approach is based on deep-learning through the construction of a 3D space from the real world. Through single system, a projector-camera unit with pan-tilt mechanism, the 360-degree space of user surroundings can be built into a 3-dimensional space and accomplish object and user recognition. a projection AR environment can be generated instantaneously. Information relevant to real-world objects can be provided through real-time interactions between the user and objects. Using spatial interaction, it also allows for achieving intuitive interactions with projection information, user interface (UI), and contents without touch sensors. Several scenarios for the use of this system are described below.",
author = "Park, {Yoon Jung} and Hyocheol Ro and Byun, {Jung Hyun} and Han, {Tack Don}",
year = "2019",
month = "3",
day = "16",
doi = "10.1145/3308557.3308678",
language = "English",
series = "International Conference on Intelligent User Interfaces, Proceedings IUI",
publisher = "Association for Computing Machinery",
pages = "51--52",
booktitle = "Proceedings of the 24th International Conference on Intelligent User Interfaces, IUI 2019",

}

Park, YJ, Ro, H, Byun, JH & Han, TD 2019, Adaptive projection augmented reality with object recognition based on deep learning. in Proceedings of the 24th International Conference on Intelligent User Interfaces, IUI 2019. International Conference on Intelligent User Interfaces, Proceedings IUI, Association for Computing Machinery, pp. 51-52, 24th International Conference on Intelligent User Interfaces, IUI 2019, Marina del Ray, United States, 19/3/16. https://doi.org/10.1145/3308557.3308678

Adaptive projection augmented reality with object recognition based on deep learning. / Park, Yoon Jung; Ro, Hyocheol; Byun, Jung Hyun; Han, Tack Don.

Proceedings of the 24th International Conference on Intelligent User Interfaces, IUI 2019. Association for Computing Machinery, 2019. p. 51-52 (International Conference on Intelligent User Interfaces, Proceedings IUI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Adaptive projection augmented reality with object recognition based on deep learning

AU - Park, Yoon Jung

AU - Ro, Hyocheol

AU - Byun, Jung Hyun

AU - Han, Tack Don

PY - 2019/3/16

Y1 - 2019/3/16

N2 - This study describes an Adaptive Projection Augmented Reality (AR) system that can provide information in real-time using object recognition. This approach is based on deep-learning through the construction of a 3D space from the real world. Through single system, a projector-camera unit with pan-tilt mechanism, the 360-degree space of user surroundings can be built into a 3-dimensional space and accomplish object and user recognition. a projection AR environment can be generated instantaneously. Information relevant to real-world objects can be provided through real-time interactions between the user and objects. Using spatial interaction, it also allows for achieving intuitive interactions with projection information, user interface (UI), and contents without touch sensors. Several scenarios for the use of this system are described below.

AB - This study describes an Adaptive Projection Augmented Reality (AR) system that can provide information in real-time using object recognition. This approach is based on deep-learning through the construction of a 3D space from the real world. Through single system, a projector-camera unit with pan-tilt mechanism, the 360-degree space of user surroundings can be built into a 3-dimensional space and accomplish object and user recognition. a projection AR environment can be generated instantaneously. Information relevant to real-world objects can be provided through real-time interactions between the user and objects. Using spatial interaction, it also allows for achieving intuitive interactions with projection information, user interface (UI), and contents without touch sensors. Several scenarios for the use of this system are described below.

UR - http://www.scopus.com/inward/record.url?scp=85074455168&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074455168&partnerID=8YFLogxK

U2 - 10.1145/3308557.3308678

DO - 10.1145/3308557.3308678

M3 - Conference contribution

AN - SCOPUS:85074455168

T3 - International Conference on Intelligent User Interfaces, Proceedings IUI

SP - 51

EP - 52

BT - Proceedings of the 24th International Conference on Intelligent User Interfaces, IUI 2019

PB - Association for Computing Machinery

ER -

Park YJ, Ro H, Byun JH, Han TD. Adaptive projection augmented reality with object recognition based on deep learning. In Proceedings of the 24th International Conference on Intelligent User Interfaces, IUI 2019. Association for Computing Machinery. 2019. p. 51-52. (International Conference on Intelligent User Interfaces, Proceedings IUI). https://doi.org/10.1145/3308557.3308678