3D reconstruction of stereo images for interaction between real and virtual worlds

Hansung Kim, Seung Jun Yang, Kwanghoon Sohn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

21 Citations (Scopus)

Abstract

Mixed reality is different from the virtual reality in that users can feel immersed in a space which is composed of not only virtual but also real objects. Thus, it is essential to realize seamless integration and interaction of the virtual and real worlds. We need depth information of the real scene to synthesize the real and virtual objects. We propose a two-stage algorithm to find smooth and precise disparity vector fields with sharp object boundaries in a stereo image pair for depth estimation. Hierarchical region-dividing disparity estimation increases the efficiency and the reliability of the estimation process, and a shape-adaptive window provides high reliability of the fields around the object boundary region. At the second stage, the vector fields are regularized with a energy model which produces smooth fields while preserving their discontinuities resulting from the object boundaries. The vector fields are used to reconstruct 3D surface of the real scene. Simulation results show that the proposed algorithm provides accurate and spatially correlated disparity vector fields in various kinds of images, and synthesized 3D models produce natural space where the virtual objects interact with the real world as if they are in the same world.

Original languageEnglish
Title of host publicationProceedings - 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2003
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages169-176
Number of pages8
ISBN (Electronic)0769520065
DOIs
Publication statusPublished - 2003
Event2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2003 - Tokyo, Japan
Duration: 2003 Oct 72003 Oct 10

Publication series

NameProceedings - 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2003

Other

Other2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2003
CountryJapan
CityTokyo
Period03/10/703/10/10

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Science Applications

Fingerprint Dive into the research topics of '3D reconstruction of stereo images for interaction between real and virtual worlds'. Together they form a unique fingerprint.

  • Cite this

    Kim, H., Yang, S. J., & Sohn, K. (2003). 3D reconstruction of stereo images for interaction between real and virtual worlds. In Proceedings - 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2003 (pp. 169-176). [1240700] (Proceedings - 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2003). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR.2003.1240700