Real Space 3D Mesh Transformation Preprocessing System for AR Services

Young Suk Yoon; Sangheon Park; Sangwon Hwang; Sangyoun Lee; Hyunwoo Cho; Chanho Park; Sung Uk Jung

doi:10.1109/ICTC49870.2020.9289462

Real Space 3D Mesh Transformation Preprocessing System for AR Services

Young Suk Yoon, Sangheon Park, Sangwon Hwang, Sangyoun Lee, Hyunwoo Cho, Chanho Park, Sung Uk Jung

Department of Electrical and Electronic Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

We propose a system that preprocesses a real space into a 3D mesh to provide augmented reality service. The proposed system acquires an image sequence using an RGB camera to model a real space. First, we transform the obtained sequence of RGB images into a 3D point cloud with real spatial information. Also, we segment the objects in the RGB image sequence and classify classes of the objects. Next, the proposed system performs a three-dimensional point labeling, which allocates object information for each point by using the three-dimensional point cloud and the segmented information of the object. Then, points in 3D space with the same label are gathered for each object. Finally, 3D meshes are generated only from points having the same identification number among the collected points. In this paper, it was confirmed that the 3D mesh can be created only with not using various types of sensors to obtain 3D information but the RGB image sequence.

Original language	English
Title of host publication	ICTC 2020 - 11th International Conference on ICT Convergence
Subtitle of host publication	Data, Network, and AI in the Age of Untact
Publisher	IEEE Computer Society
Pages	1478-1483
Number of pages	6
ISBN (Electronic)	9781728167589
DOIs	https://doi.org/10.1109/ICTC49870.2020.9289462
Publication status	Published - 2020 Oct 21
Event	11th International Conference on Information and Communication Technology Convergence, ICTC 2020 - Jeju Island, Korea, Republic of Duration: 2020 Oct 21 → 2020 Oct 23

Publication series

Name	International Conference on ICT Convergence
Volume	2020-October
ISSN (Print)	2162-1233
ISSN (Electronic)	2162-1241

Conference

Conference	11th International Conference on Information and Communication Technology Convergence, ICTC 2020
Country/Territory	Korea, Republic of
City	Jeju Island
Period	20/10/21 → 20/10/23

Bibliographical note

Funding Information:
This research was supported by Ministry of Culture, Sports and Tourism (MCST) and Korea Creative Content Agency (KOCCA) in the Culture Technology (CT) Research O Development Program. HR201M0303J2, Development of participational AR platform for large-scale cultural spaceI

Publisher Copyright:
© 2020 IEEE.

All Science Journal Classification (ASJC) codes

Information Systems
Computer Networks and Communications

Access to Document

10.1109/ICTC49870.2020.9289462

Cite this

Yoon, Y. S., Park, S., Hwang, S., Lee, S., Cho, H., Park, C., & Jung, S. U. (2020). Real Space 3D Mesh Transformation Preprocessing System for AR Services. In ICTC 2020 - 11th International Conference on ICT Convergence: Data, Network, and AI in the Age of Untact (pp. 1478-1483). [9289462] (International Conference on ICT Convergence; Vol. 2020-October). IEEE Computer Society. https://doi.org/10.1109/ICTC49870.2020.9289462

@inproceedings{f1e9b009c7e544a89a525db992cdcc7f,

title = "Real Space 3D Mesh Transformation Preprocessing System for AR Services",

abstract = "We propose a system that preprocesses a real space into a 3D mesh to provide augmented reality service. The proposed system acquires an image sequence using an RGB camera to model a real space. First, we transform the obtained sequence of RGB images into a 3D point cloud with real spatial information. Also, we segment the objects in the RGB image sequence and classify classes of the objects. Next, the proposed system performs a three-dimensional point labeling, which allocates object information for each point by using the three-dimensional point cloud and the segmented information of the object. Then, points in 3D space with the same label are gathered for each object. Finally, 3D meshes are generated only from points having the same identification number among the collected points. In this paper, it was confirmed that the 3D mesh can be created only with not using various types of sensors to obtain 3D information but the RGB image sequence.",

author = "Yoon, {Young Suk} and Sangheon Park and Sangwon Hwang and Sangyoun Lee and Hyunwoo Cho and Chanho Park and Jung, {Sung Uk}",

note = "Funding Information: This research was supported by Ministry of Culture, Sports and Tourism (MCST) and Korea Creative Content Agency (KOCCA) in the Culture Technology (CT) Research O Development Program. HR201M0303J2, Development of participational AR platform for large-scale cultural spaceI Publisher Copyright: {\textcopyright} 2020 IEEE.; 11th International Conference on Information and Communication Technology Convergence, ICTC 2020 ; Conference date: 21-10-2020 Through 23-10-2020",

year = "2020",

month = oct,

day = "21",

doi = "10.1109/ICTC49870.2020.9289462",

language = "English",

series = "International Conference on ICT Convergence",

publisher = "IEEE Computer Society",

pages = "1478--1483",

booktitle = "ICTC 2020 - 11th International Conference on ICT Convergence",

address = "United States",

}

Yoon, YS, Park, S, Hwang, S, Lee, S, Cho, H, Park, C & Jung, SU 2020, Real Space 3D Mesh Transformation Preprocessing System for AR Services. in ICTC 2020 - 11th International Conference on ICT Convergence: Data, Network, and AI in the Age of Untact., 9289462, International Conference on ICT Convergence, vol. 2020-October, IEEE Computer Society, pp. 1478-1483, 11th International Conference on Information and Communication Technology Convergence, ICTC 2020, Jeju Island, Korea, Republic of, 20/10/21. https://doi.org/10.1109/ICTC49870.2020.9289462

Real Space 3D Mesh Transformation Preprocessing System for AR Services. / Yoon, Young Suk; Park, Sangheon; Hwang, Sangwon et al.

ICTC 2020 - 11th International Conference on ICT Convergence: Data, Network, and AI in the Age of Untact. IEEE Computer Society, 2020. p. 1478-1483 9289462 (International Conference on ICT Convergence; Vol. 2020-October).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Real Space 3D Mesh Transformation Preprocessing System for AR Services

AU - Yoon, Young Suk

AU - Park, Sangheon

AU - Hwang, Sangwon

AU - Lee, Sangyoun

AU - Cho, Hyunwoo

AU - Park, Chanho

AU - Jung, Sung Uk

N1 - Funding Information: This research was supported by Ministry of Culture, Sports and Tourism (MCST) and Korea Creative Content Agency (KOCCA) in the Culture Technology (CT) Research O Development Program. HR201M0303J2, Development of participational AR platform for large-scale cultural spaceI Publisher Copyright: © 2020 IEEE.

PY - 2020/10/21

Y1 - 2020/10/21

N2 - We propose a system that preprocesses a real space into a 3D mesh to provide augmented reality service. The proposed system acquires an image sequence using an RGB camera to model a real space. First, we transform the obtained sequence of RGB images into a 3D point cloud with real spatial information. Also, we segment the objects in the RGB image sequence and classify classes of the objects. Next, the proposed system performs a three-dimensional point labeling, which allocates object information for each point by using the three-dimensional point cloud and the segmented information of the object. Then, points in 3D space with the same label are gathered for each object. Finally, 3D meshes are generated only from points having the same identification number among the collected points. In this paper, it was confirmed that the 3D mesh can be created only with not using various types of sensors to obtain 3D information but the RGB image sequence.

AB - We propose a system that preprocesses a real space into a 3D mesh to provide augmented reality service. The proposed system acquires an image sequence using an RGB camera to model a real space. First, we transform the obtained sequence of RGB images into a 3D point cloud with real spatial information. Also, we segment the objects in the RGB image sequence and classify classes of the objects. Next, the proposed system performs a three-dimensional point labeling, which allocates object information for each point by using the three-dimensional point cloud and the segmented information of the object. Then, points in 3D space with the same label are gathered for each object. Finally, 3D meshes are generated only from points having the same identification number among the collected points. In this paper, it was confirmed that the 3D mesh can be created only with not using various types of sensors to obtain 3D information but the RGB image sequence.

UR - http://www.scopus.com/inward/record.url?scp=85098955733&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85098955733&partnerID=8YFLogxK

U2 - 10.1109/ICTC49870.2020.9289462

DO - 10.1109/ICTC49870.2020.9289462

M3 - Conference contribution

AN - SCOPUS:85098955733

T3 - International Conference on ICT Convergence

SP - 1478

EP - 1483

BT - ICTC 2020 - 11th International Conference on ICT Convergence

PB - IEEE Computer Society

T2 - 11th International Conference on Information and Communication Technology Convergence, ICTC 2020

Y2 - 21 October 2020 through 23 October 2020

ER -

Real Space 3D Mesh Transformation Preprocessing System for AR Services

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this