In this paper, we propose the novel 3D reconstruction framework, where the surface of a target object is reconstructed accurately and robustly from multi-view depth maps. A depth map of a moving object tends to have the spatially-varying perspective warps due to motion blur and rolling shutter artifacts. Incorporating those misaligned points from the views into the world coordinate leads to significant artifacts in the reconstructed shape. We address the mismatches by the patch-based depth-to-surface alignment using implicit surface-based distance measurement. The patch-based minimization finds spatial warps on the depth map fast and accurately with the global transformation preserved. The proposed framework efficiently optimizes the local alignments against depth occlusions and local variants thanks to the point to surface distance based on an implicit representation. The proposed method shows significant improvements over the other reconstruction methods, demonstrating efficiency and benefits of our method in the multi-view reconstruction.
|Title of host publication||2021 IEEE International Conference on Image Processing, ICIP 2021 - Proceedings|
|Publisher||IEEE Computer Society|
|Number of pages||5|
|Publication status||Published - 2021|
|Event||2021 IEEE International Conference on Image Processing, ICIP 2021 - Anchorage, United States|
Duration: 2021 Sept 19 → 2021 Sept 22
|Name||Proceedings - International Conference on Image Processing, ICIP|
|Conference||2021 IEEE International Conference on Image Processing, ICIP 2021|
|Period||21/9/19 → 21/9/22|
Bibliographical noteFunding Information:
This work was supported by the National Research Foundation of Korea (NRF) funded by the Korea Government (Ministry of Science and ICT, MSIT) under Grant NRF-2020R1A2C3011697, and the Yonsei University Research Fund of 2021 (2021-22-0001).
© 2021 IEEE.
All Science Journal Classification (ASJC) codes
- Computer Vision and Pattern Recognition
- Signal Processing