Augmented reality system for facility management using image-based indoor localization

Francis Baek, Inhae Ha, Hyoungkwan Kim

Research output: Contribution to journalArticle

Abstract

Image-based localization has provided opportunities for efficient facility management. Combined with augmented reality (AR), automated localization can offer visually assistive information in facility management. However, implementing an AR-based facility management system with image-based localization is difficult. Device-intensive methods or markers were prerequisites for facility information display. Localization accuracy and information readability and accessibility were some of the issues to be resolved for a successful representation of facility information. This paper presents an AR system for facility management using an image-based indoor localization method that estimates the user's indoor position and orientation by comparing the user's perspective to building information modeling (BIM) based on a deep learning computation. A graphics processing unit (GPU)-enabled server is used for the deep learning computation, and the resultant information is wirelessly transferred to the mobile AR device through transmission control protocol/Internet protocol (TCP/IP). Thereafter, spatial mapping visually fits the object of interest (e.g. pipes) onto the AR image using three-dimensional (3D) sensing capability of AR device. Experts evaluated that the proposed system has potential for improved facility management and identified future research direction, such as integrated information presentation and effective reflection of rehabilitation efforts on the drawings.

Original languageEnglish
Pages (from-to)18-26
Number of pages9
JournalAutomation in Construction
Volume99
DOIs
Publication statusPublished - 2019 Mar 1

Fingerprint

Augmented reality
Drawing (graphics)
Transmission control protocol
Internet protocols
Patient rehabilitation
Servers
Display devices
Pipe

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Civil and Structural Engineering
  • Building and Construction

Cite this

@article{7b654ff2b8c24fce8abcba734f2c2cca,
title = "Augmented reality system for facility management using image-based indoor localization",
abstract = "Image-based localization has provided opportunities for efficient facility management. Combined with augmented reality (AR), automated localization can offer visually assistive information in facility management. However, implementing an AR-based facility management system with image-based localization is difficult. Device-intensive methods or markers were prerequisites for facility information display. Localization accuracy and information readability and accessibility were some of the issues to be resolved for a successful representation of facility information. This paper presents an AR system for facility management using an image-based indoor localization method that estimates the user's indoor position and orientation by comparing the user's perspective to building information modeling (BIM) based on a deep learning computation. A graphics processing unit (GPU)-enabled server is used for the deep learning computation, and the resultant information is wirelessly transferred to the mobile AR device through transmission control protocol/Internet protocol (TCP/IP). Thereafter, spatial mapping visually fits the object of interest (e.g. pipes) onto the AR image using three-dimensional (3D) sensing capability of AR device. Experts evaluated that the proposed system has potential for improved facility management and identified future research direction, such as integrated information presentation and effective reflection of rehabilitation efforts on the drawings.",
author = "Francis Baek and Inhae Ha and Hyoungkwan Kim",
year = "2019",
month = "3",
day = "1",
doi = "10.1016/j.autcon.2018.11.034",
language = "English",
volume = "99",
pages = "18--26",
journal = "Automation in Construction",
issn = "0926-5805",
publisher = "Elsevier",

}

Augmented reality system for facility management using image-based indoor localization. / Baek, Francis; Ha, Inhae; Kim, Hyoungkwan.

In: Automation in Construction, Vol. 99, 01.03.2019, p. 18-26.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Augmented reality system for facility management using image-based indoor localization

AU - Baek, Francis

AU - Ha, Inhae

AU - Kim, Hyoungkwan

PY - 2019/3/1

Y1 - 2019/3/1

N2 - Image-based localization has provided opportunities for efficient facility management. Combined with augmented reality (AR), automated localization can offer visually assistive information in facility management. However, implementing an AR-based facility management system with image-based localization is difficult. Device-intensive methods or markers were prerequisites for facility information display. Localization accuracy and information readability and accessibility were some of the issues to be resolved for a successful representation of facility information. This paper presents an AR system for facility management using an image-based indoor localization method that estimates the user's indoor position and orientation by comparing the user's perspective to building information modeling (BIM) based on a deep learning computation. A graphics processing unit (GPU)-enabled server is used for the deep learning computation, and the resultant information is wirelessly transferred to the mobile AR device through transmission control protocol/Internet protocol (TCP/IP). Thereafter, spatial mapping visually fits the object of interest (e.g. pipes) onto the AR image using three-dimensional (3D) sensing capability of AR device. Experts evaluated that the proposed system has potential for improved facility management and identified future research direction, such as integrated information presentation and effective reflection of rehabilitation efforts on the drawings.

AB - Image-based localization has provided opportunities for efficient facility management. Combined with augmented reality (AR), automated localization can offer visually assistive information in facility management. However, implementing an AR-based facility management system with image-based localization is difficult. Device-intensive methods or markers were prerequisites for facility information display. Localization accuracy and information readability and accessibility were some of the issues to be resolved for a successful representation of facility information. This paper presents an AR system for facility management using an image-based indoor localization method that estimates the user's indoor position and orientation by comparing the user's perspective to building information modeling (BIM) based on a deep learning computation. A graphics processing unit (GPU)-enabled server is used for the deep learning computation, and the resultant information is wirelessly transferred to the mobile AR device through transmission control protocol/Internet protocol (TCP/IP). Thereafter, spatial mapping visually fits the object of interest (e.g. pipes) onto the AR image using three-dimensional (3D) sensing capability of AR device. Experts evaluated that the proposed system has potential for improved facility management and identified future research direction, such as integrated information presentation and effective reflection of rehabilitation efforts on the drawings.

UR - http://www.scopus.com/inward/record.url?scp=85057751858&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057751858&partnerID=8YFLogxK

U2 - 10.1016/j.autcon.2018.11.034

DO - 10.1016/j.autcon.2018.11.034

M3 - Article

VL - 99

SP - 18

EP - 26

JO - Automation in Construction

T2 - Automation in Construction

JF - Automation in Construction

SN - 0926-5805

ER -