In this paper, we propose a system that transforms the 3D space of the real world into a 3D mesh to provide augmented reality(AR) services. First, the proposed system acquires a 2D RGB image sequence using a monocular camera in order to model the real world in 3D data. and it creates a 3D point cloud with 3D spatial information of the real world using the obtained RGB image sequence. Also, it segments objects that appear in the RGB image sequence into individual objects. Next, the proposed system tracks the segmented multiple objects and connects identification information of the objects respectively. and it uses both the connected information and the 3D point cloud to perform a 3D point labeling in which object information is assigned to each 3D point. Then, it collects 3D points with the same label for each object. Finally, it converts the 3D points collected for each object into 3D mesh. It was confirmed that the system proposed in this paper can generate a 3D mesh with 2D RGB image sequences obtained with a general monocular camera to provide interactive AR services.
|Title of host publication||ICTC 2021 - 12th International Conference on ICT Convergence|
|Subtitle of host publication||Beyond the Pandemic Era with ICT Convergence Innovation|
|Publisher||IEEE Computer Society|
|Number of pages||6|
|Publication status||Published - 2021|
|Event||12th International Conference on Information and Communication Technology Convergence, ICTC 2021 - Jeju Island, Korea, Republic of|
Duration: 2021 Oct 20 → 2021 Oct 22
|Name||International Conference on ICT Convergence|
|Conference||12th International Conference on Information and Communication Technology Convergence, ICTC 2021|
|Country/Territory||Korea, Republic of|
|Period||21/10/20 → 21/10/22|
Bibliographical noteFunding Information:
This work was supported by 2021 Cultural Heritage Smart Preservation & Utilization R&D Program by Cultural Heritage Administration, National Research Institute of Cultural Heritage [2021A02P01-001, A smart H-BIM modeling technology of wooden architecture for the conservation of Historical and Cultural Environment].
© 2021 IEEE.
All Science Journal Classification (ASJC) codes
- Information Systems
- Computer Networks and Communications