Hole filling with random walks using occlusion constraints in view synthesis

Sunghwan Choi, Bumsub Ham, Kwanghoon Sohn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

In this paper, we propose a hole filling technique which coherently reconstructs the hole region during the view synthesis. The holes can be filled successfully in case that the virtual camera locates between real cameras by using interpolation. However, they cannot be handled in case that the virtual camera locates beyond the field of view of the real camera. We address this problem by jointly using image completion technique and random walks. First, occlusion constraint is imposed in order to guide the filling order. It is observed that the holes occur in a similar pattern because of the geometric characteristic of the camera configuration. This observation named vertical prior in this paper is also used to label each pixel on the fill front with foreground or background. Second, the probabilities estimated by random walks are utilized to find the patch candidates and to select the optimal patch. The experimental results show that the proposed method gives visually pleasing results over both interpolation and conventional image completion method.

Original languageEnglish
Title of host publicationICIP 2011
Subtitle of host publication2011 18th IEEE International Conference on Image Processing
Pages1965-1968
Number of pages4
DOIs
Publication statusPublished - 2011 Dec 1
Event2011 18th IEEE International Conference on Image Processing, ICIP 2011 - Brussels, Belgium
Duration: 2011 Sep 112011 Sep 14

Other

Other2011 18th IEEE International Conference on Image Processing, ICIP 2011
CountryBelgium
CityBrussels
Period11/9/1111/9/14

Fingerprint

Cameras
Interpolation
Labels
Pixels

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Cite this

Choi, S., Ham, B., & Sohn, K. (2011). Hole filling with random walks using occlusion constraints in view synthesis. In ICIP 2011: 2011 18th IEEE International Conference on Image Processing (pp. 1965-1968). [6115858] https://doi.org/10.1109/ICIP.2011.6115858
Choi, Sunghwan ; Ham, Bumsub ; Sohn, Kwanghoon. / Hole filling with random walks using occlusion constraints in view synthesis. ICIP 2011: 2011 18th IEEE International Conference on Image Processing. 2011. pp. 1965-1968
@inproceedings{b1874eee675f42c0bc26de6149b9b52c,
title = "Hole filling with random walks using occlusion constraints in view synthesis",
abstract = "In this paper, we propose a hole filling technique which coherently reconstructs the hole region during the view synthesis. The holes can be filled successfully in case that the virtual camera locates between real cameras by using interpolation. However, they cannot be handled in case that the virtual camera locates beyond the field of view of the real camera. We address this problem by jointly using image completion technique and random walks. First, occlusion constraint is imposed in order to guide the filling order. It is observed that the holes occur in a similar pattern because of the geometric characteristic of the camera configuration. This observation named vertical prior in this paper is also used to label each pixel on the fill front with foreground or background. Second, the probabilities estimated by random walks are utilized to find the patch candidates and to select the optimal patch. The experimental results show that the proposed method gives visually pleasing results over both interpolation and conventional image completion method.",
author = "Sunghwan Choi and Bumsub Ham and Kwanghoon Sohn",
year = "2011",
month = "12",
day = "1",
doi = "10.1109/ICIP.2011.6115858",
language = "English",
isbn = "9781457713033",
pages = "1965--1968",
booktitle = "ICIP 2011",

}

Choi, S, Ham, B & Sohn, K 2011, Hole filling with random walks using occlusion constraints in view synthesis. in ICIP 2011: 2011 18th IEEE International Conference on Image Processing., 6115858, pp. 1965-1968, 2011 18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, 11/9/11. https://doi.org/10.1109/ICIP.2011.6115858

Hole filling with random walks using occlusion constraints in view synthesis. / Choi, Sunghwan; Ham, Bumsub; Sohn, Kwanghoon.

ICIP 2011: 2011 18th IEEE International Conference on Image Processing. 2011. p. 1965-1968 6115858.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Hole filling with random walks using occlusion constraints in view synthesis

AU - Choi, Sunghwan

AU - Ham, Bumsub

AU - Sohn, Kwanghoon

PY - 2011/12/1

Y1 - 2011/12/1

N2 - In this paper, we propose a hole filling technique which coherently reconstructs the hole region during the view synthesis. The holes can be filled successfully in case that the virtual camera locates between real cameras by using interpolation. However, they cannot be handled in case that the virtual camera locates beyond the field of view of the real camera. We address this problem by jointly using image completion technique and random walks. First, occlusion constraint is imposed in order to guide the filling order. It is observed that the holes occur in a similar pattern because of the geometric characteristic of the camera configuration. This observation named vertical prior in this paper is also used to label each pixel on the fill front with foreground or background. Second, the probabilities estimated by random walks are utilized to find the patch candidates and to select the optimal patch. The experimental results show that the proposed method gives visually pleasing results over both interpolation and conventional image completion method.

AB - In this paper, we propose a hole filling technique which coherently reconstructs the hole region during the view synthesis. The holes can be filled successfully in case that the virtual camera locates between real cameras by using interpolation. However, they cannot be handled in case that the virtual camera locates beyond the field of view of the real camera. We address this problem by jointly using image completion technique and random walks. First, occlusion constraint is imposed in order to guide the filling order. It is observed that the holes occur in a similar pattern because of the geometric characteristic of the camera configuration. This observation named vertical prior in this paper is also used to label each pixel on the fill front with foreground or background. Second, the probabilities estimated by random walks are utilized to find the patch candidates and to select the optimal patch. The experimental results show that the proposed method gives visually pleasing results over both interpolation and conventional image completion method.

UR - http://www.scopus.com/inward/record.url?scp=84863023568&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863023568&partnerID=8YFLogxK

U2 - 10.1109/ICIP.2011.6115858

DO - 10.1109/ICIP.2011.6115858

M3 - Conference contribution

SN - 9781457713033

SP - 1965

EP - 1968

BT - ICIP 2011

ER -

Choi S, Ham B, Sohn K. Hole filling with random walks using occlusion constraints in view synthesis. In ICIP 2011: 2011 18th IEEE International Conference on Image Processing. 2011. p. 1965-1968. 6115858 https://doi.org/10.1109/ICIP.2011.6115858