Sparsity based depth estimation and hole-filling algorithm for 2D to 3D video conversion

Jangwon Choi, Yoonsik Choe, Yong Goo Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Depth image-based rendering (DIBR) requires to efficiently fill out holes in rendered image, and this has a great impact on the quality of 3D depth perception. In this paper, we propose a hole-filling method using depth estimation and image inpainting for high quality 3D video. In this algorithm, we first generate rendered image and its associated depth map. Then, we estimate the depths in generated depth map's hole. Using these values, we fill out the hole with depth-aided image inpainting based on the sparsity of hole. This method enables the inpainting to refer similar background texture. The proposed algorithm also fills out the patches of hole based on an edge-preserving priority, so that background edges of the image texture can be reconstructed faithfully. Experimental results show that the proposed algorithm provides better objective and subjective quality than previous works.

Original languageEnglish
Title of host publication2012 International Conference on Signals and Electronic Systems, ICSES 2012 - The Conference Proceedings
DOIs
Publication statusPublished - 2012 Dec 1
Event2012 International Conference on Signals and Electronic Systems, ICSES 2012 - Wroclaw, Poland
Duration: 2012 Sep 182012 Sep 21

Other

Other2012 International Conference on Signals and Electronic Systems, ICSES 2012
CountryPoland
CityWroclaw
Period12/9/1812/9/21

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Electrical and Electronic Engineering

Cite this

Choi, J., Choe, Y., & Kim, Y. G. (2012). Sparsity based depth estimation and hole-filling algorithm for 2D to 3D video conversion. In 2012 International Conference on Signals and Electronic Systems, ICSES 2012 - The Conference Proceedings [6382254] https://doi.org/10.1109/ICSES.2012.6382254