Hole filling with random walks using occlusion constraints in view synthesis

Sunghwan Choi, Bumsub Ham, Kwanghoon Sohn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

In this paper, we propose a hole filling technique which coherently reconstructs the hole region during the view synthesis. The holes can be filled successfully in case that the virtual camera locates between real cameras by using interpolation. However, they cannot be handled in case that the virtual camera locates beyond the field of view of the real camera. We address this problem by jointly using image completion technique and random walks. First, occlusion constraint is imposed in order to guide the filling order. It is observed that the holes occur in a similar pattern because of the geometric characteristic of the camera configuration. This observation named vertical prior in this paper is also used to label each pixel on the fill front with foreground or background. Second, the probabilities estimated by random walks are utilized to find the patch candidates and to select the optimal patch. The experimental results show that the proposed method gives visually pleasing results over both interpolation and conventional image completion method.

Original languageEnglish
Title of host publicationICIP 2011
Subtitle of host publication2011 18th IEEE International Conference on Image Processing
Pages1965-1968
Number of pages4
DOIs
Publication statusPublished - 2011 Dec 1
Event2011 18th IEEE International Conference on Image Processing, ICIP 2011 - Brussels, Belgium
Duration: 2011 Sep 112011 Sep 14

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Other

Other2011 18th IEEE International Conference on Image Processing, ICIP 2011
CountryBelgium
CityBrussels
Period11/9/1111/9/14

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint Dive into the research topics of 'Hole filling with random walks using occlusion constraints in view synthesis'. Together they form a unique fingerprint.

  • Cite this

    Choi, S., Ham, B., & Sohn, K. (2011). Hole filling with random walks using occlusion constraints in view synthesis. In ICIP 2011: 2011 18th IEEE International Conference on Image Processing (pp. 1965-1968). [6115858] (Proceedings - International Conference on Image Processing, ICIP). https://doi.org/10.1109/ICIP.2011.6115858