Hybrid approach for accurate depth acquisition with structured light and stereo camera

Sunghwan Choi, Bumsub Ham, Changjae Oh, Hyon Gon Choo, Jinwoong Kim, Kwanghoon Sohn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper, we propose a hybrid approach for accurate depth acquisition by using a structured light-based method with a stereo matching. By projecting additional light patterns onto a scene, a structured light-based method works well on a textureless region where a stereo matching shows poor performance. In contrast, the patterns projected onto a rich textured region obstruct in estimating reliable depth information in the structured light-based method, while a stereo matching excels. We exploit these complementary characteristics by combining the results from both methods that outperform the one from either alone. In our fusion framework, a hybrid stereo matching is introduced, in which the disparity search range for each pixel is limited based on the initial depth map obtained by the structured light-based method. In addition, we introduce a confidence-based fusion method which combines the depth maps, while incorporating the advantages of each method. The experimental results show that the proposed method achieves to estimate accurate depth information, while other methods fail.

Original languageEnglish
Title of host publicationIEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012 - Final Program
DOIs
Publication statusPublished - 2012 Oct 22
Event2012 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012 - Seoul, Korea, Republic of
Duration: 2012 Jun 272012 Jun 29

Publication series

NameIEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB
ISSN (Print)2155-5044
ISSN (Electronic)2155-5052

Other

Other2012 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012
CountryKorea, Republic of
CitySeoul
Period12/6/2712/6/29

Fingerprint

Cameras
Fusion reactions
Pixels
confidence
performance

All Science Journal Classification (ASJC) codes

  • Communication
  • Media Technology
  • Electrical and Electronic Engineering
  • Human-Computer Interaction
  • Computer Science Applications
  • Computer Networks and Communications
  • Computer Graphics and Computer-Aided Design

Cite this

Choi, S., Ham, B., Oh, C., Choo, H. G., Kim, J., & Sohn, K. (2012). Hybrid approach for accurate depth acquisition with structured light and stereo camera. In IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012 - Final Program [6264270] (IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB). https://doi.org/10.1109/BMSB.2012.6264270
Choi, Sunghwan ; Ham, Bumsub ; Oh, Changjae ; Choo, Hyon Gon ; Kim, Jinwoong ; Sohn, Kwanghoon. / Hybrid approach for accurate depth acquisition with structured light and stereo camera. IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012 - Final Program. 2012. (IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB).
@inproceedings{ad64b4b9c482434bba02be2f10266a47,
title = "Hybrid approach for accurate depth acquisition with structured light and stereo camera",
abstract = "In this paper, we propose a hybrid approach for accurate depth acquisition by using a structured light-based method with a stereo matching. By projecting additional light patterns onto a scene, a structured light-based method works well on a textureless region where a stereo matching shows poor performance. In contrast, the patterns projected onto a rich textured region obstruct in estimating reliable depth information in the structured light-based method, while a stereo matching excels. We exploit these complementary characteristics by combining the results from both methods that outperform the one from either alone. In our fusion framework, a hybrid stereo matching is introduced, in which the disparity search range for each pixel is limited based on the initial depth map obtained by the structured light-based method. In addition, we introduce a confidence-based fusion method which combines the depth maps, while incorporating the advantages of each method. The experimental results show that the proposed method achieves to estimate accurate depth information, while other methods fail.",
author = "Sunghwan Choi and Bumsub Ham and Changjae Oh and Choo, {Hyon Gon} and Jinwoong Kim and Kwanghoon Sohn",
year = "2012",
month = "10",
day = "22",
doi = "10.1109/BMSB.2012.6264270",
language = "English",
isbn = "9781467302937",
series = "IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB",
booktitle = "IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012 - Final Program",

}

Choi, S, Ham, B, Oh, C, Choo, HG, Kim, J & Sohn, K 2012, Hybrid approach for accurate depth acquisition with structured light and stereo camera. in IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012 - Final Program., 6264270, IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB, 2012 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012, Seoul, Korea, Republic of, 12/6/27. https://doi.org/10.1109/BMSB.2012.6264270

Hybrid approach for accurate depth acquisition with structured light and stereo camera. / Choi, Sunghwan; Ham, Bumsub; Oh, Changjae; Choo, Hyon Gon; Kim, Jinwoong; Sohn, Kwanghoon.

IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012 - Final Program. 2012. 6264270 (IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Hybrid approach for accurate depth acquisition with structured light and stereo camera

AU - Choi, Sunghwan

AU - Ham, Bumsub

AU - Oh, Changjae

AU - Choo, Hyon Gon

AU - Kim, Jinwoong

AU - Sohn, Kwanghoon

PY - 2012/10/22

Y1 - 2012/10/22

N2 - In this paper, we propose a hybrid approach for accurate depth acquisition by using a structured light-based method with a stereo matching. By projecting additional light patterns onto a scene, a structured light-based method works well on a textureless region where a stereo matching shows poor performance. In contrast, the patterns projected onto a rich textured region obstruct in estimating reliable depth information in the structured light-based method, while a stereo matching excels. We exploit these complementary characteristics by combining the results from both methods that outperform the one from either alone. In our fusion framework, a hybrid stereo matching is introduced, in which the disparity search range for each pixel is limited based on the initial depth map obtained by the structured light-based method. In addition, we introduce a confidence-based fusion method which combines the depth maps, while incorporating the advantages of each method. The experimental results show that the proposed method achieves to estimate accurate depth information, while other methods fail.

AB - In this paper, we propose a hybrid approach for accurate depth acquisition by using a structured light-based method with a stereo matching. By projecting additional light patterns onto a scene, a structured light-based method works well on a textureless region where a stereo matching shows poor performance. In contrast, the patterns projected onto a rich textured region obstruct in estimating reliable depth information in the structured light-based method, while a stereo matching excels. We exploit these complementary characteristics by combining the results from both methods that outperform the one from either alone. In our fusion framework, a hybrid stereo matching is introduced, in which the disparity search range for each pixel is limited based on the initial depth map obtained by the structured light-based method. In addition, we introduce a confidence-based fusion method which combines the depth maps, while incorporating the advantages of each method. The experimental results show that the proposed method achieves to estimate accurate depth information, while other methods fail.

UR - http://www.scopus.com/inward/record.url?scp=84867527149&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84867527149&partnerID=8YFLogxK

U2 - 10.1109/BMSB.2012.6264270

DO - 10.1109/BMSB.2012.6264270

M3 - Conference contribution

AN - SCOPUS:84867527149

SN - 9781467302937

T3 - IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB

BT - IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012 - Final Program

ER -

Choi S, Ham B, Oh C, Choo HG, Kim J, Sohn K. Hybrid approach for accurate depth acquisition with structured light and stereo camera. In IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB 2012 - Final Program. 2012. 6264270. (IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, BMSB). https://doi.org/10.1109/BMSB.2012.6264270