Space-time hole filling with random walks in view extrapolation for 3D video

Sunghwan Choi, Bumsub Ham, Kwanghoon Sohn

Research output: Contribution to journalArticle

32 Citations (Scopus)

Abstract

In this paper, a space-time hole filling approach is presented to deal with a disocclusion when a view is synthesized for the 3D video. The problem becomes even more complicated when the view is extrapolated from a single view, since the hole is large and has no stereo depth cues. Although many techniques have been developed to address this problem, most of them focus only on view interpolation. We propose a space-time joint filling method for color and depth videos in view extrapolation. For proper texture and depth to be sampled in the following hole filling process, the background of a scene is automatically segmented by the random walker segmentation in conjunction with the hole formation process. Then, the patch candidate selection process is formulated as a labeling problem, which can be solved with random walks. The patch candidates that best describe the hole region are dynamically selected in the space-time domain, and the hole is filled with the optimal patch for ensuring both spatial and temporal coherence. The experimental results show that the proposed method is superior to state-of-the-art methods and provides both spatially and temporally consistent results with significantly reduced flicker artifacts.

Original languageEnglish
Article number6476015
Pages (from-to)2429-2441
Number of pages13
JournalIEEE Transactions on Image Processing
Volume22
Issue number6
DOIs
Publication statusPublished - 2013 May 2

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this