Passive photometric stereo from motion

Jongwoo Lim, Jeffrey Ho, Ming Hsuan Yang, David Kriegman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

68 Citations (Scopus)

Abstract

We introduce an iterative algorithm for shape reconstruction from multiple images of a moving (Lambertian) object illuminated by distant (and possibly time varying) lighting. Starting with an initial piecewise linear surface, the algorithm iteratively estimates a new surface based on the previous surface estimate and the photometric information available from the input image sequence. During each iteration, standard photometric stereo techniques are applied to estimate the surface normals up to an unknown generalized bas-relief transform, and a new surface is computed by integrating the estimated normals. The algorithm essentially consists of a sequence of matrix factorizations (of intensity values) followed by minimization using gradient descent (integration of the normals). Conceptually, the algorithm admits a clear geometric interpretation, which is used to provide a qualitative analysis of the algorithm's convergence. Implementation-wise, it is straightforward, being based on several established photometric stereo and structure from motion algorithms. We demonstrate experimentally the effectiveness of our algorithm using several videos of hand-held objects moving in front of a fixed light and camera.

Original languageEnglish
Title of host publicationProceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005
Pages1635-1642
Number of pages8
DOIs
Publication statusPublished - 2005 Dec 1
EventProceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005 - Beijing, China
Duration: 2005 Oct 172005 Oct 20

Publication series

NameProceedings of the IEEE International Conference on Computer Vision
VolumeII

Conference

ConferenceProceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005
CountryChina
CityBeijing
Period05/10/1705/10/20

Fingerprint

Factorization
Lighting
Cameras

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition

Cite this

Lim, J., Ho, J., Yang, M. H., & Kriegman, D. (2005). Passive photometric stereo from motion. In Proceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005 (pp. 1635-1642). [1544913] (Proceedings of the IEEE International Conference on Computer Vision; Vol. II). https://doi.org/10.1109/ICCV.2005.185
Lim, Jongwoo ; Ho, Jeffrey ; Yang, Ming Hsuan ; Kriegman, David. / Passive photometric stereo from motion. Proceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005. 2005. pp. 1635-1642 (Proceedings of the IEEE International Conference on Computer Vision).
@inproceedings{50542f8d4646496d9305f4117e4c2729,
title = "Passive photometric stereo from motion",
abstract = "We introduce an iterative algorithm for shape reconstruction from multiple images of a moving (Lambertian) object illuminated by distant (and possibly time varying) lighting. Starting with an initial piecewise linear surface, the algorithm iteratively estimates a new surface based on the previous surface estimate and the photometric information available from the input image sequence. During each iteration, standard photometric stereo techniques are applied to estimate the surface normals up to an unknown generalized bas-relief transform, and a new surface is computed by integrating the estimated normals. The algorithm essentially consists of a sequence of matrix factorizations (of intensity values) followed by minimization using gradient descent (integration of the normals). Conceptually, the algorithm admits a clear geometric interpretation, which is used to provide a qualitative analysis of the algorithm's convergence. Implementation-wise, it is straightforward, being based on several established photometric stereo and structure from motion algorithms. We demonstrate experimentally the effectiveness of our algorithm using several videos of hand-held objects moving in front of a fixed light and camera.",
author = "Jongwoo Lim and Jeffrey Ho and Yang, {Ming Hsuan} and David Kriegman",
year = "2005",
month = "12",
day = "1",
doi = "10.1109/ICCV.2005.185",
language = "English",
isbn = "076952334X",
series = "Proceedings of the IEEE International Conference on Computer Vision",
pages = "1635--1642",
booktitle = "Proceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005",

}

Lim, J, Ho, J, Yang, MH & Kriegman, D 2005, Passive photometric stereo from motion. in Proceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005., 1544913, Proceedings of the IEEE International Conference on Computer Vision, vol. II, pp. 1635-1642, Proceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005, Beijing, China, 05/10/17. https://doi.org/10.1109/ICCV.2005.185

Passive photometric stereo from motion. / Lim, Jongwoo; Ho, Jeffrey; Yang, Ming Hsuan; Kriegman, David.

Proceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005. 2005. p. 1635-1642 1544913 (Proceedings of the IEEE International Conference on Computer Vision; Vol. II).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Passive photometric stereo from motion

AU - Lim, Jongwoo

AU - Ho, Jeffrey

AU - Yang, Ming Hsuan

AU - Kriegman, David

PY - 2005/12/1

Y1 - 2005/12/1

N2 - We introduce an iterative algorithm for shape reconstruction from multiple images of a moving (Lambertian) object illuminated by distant (and possibly time varying) lighting. Starting with an initial piecewise linear surface, the algorithm iteratively estimates a new surface based on the previous surface estimate and the photometric information available from the input image sequence. During each iteration, standard photometric stereo techniques are applied to estimate the surface normals up to an unknown generalized bas-relief transform, and a new surface is computed by integrating the estimated normals. The algorithm essentially consists of a sequence of matrix factorizations (of intensity values) followed by minimization using gradient descent (integration of the normals). Conceptually, the algorithm admits a clear geometric interpretation, which is used to provide a qualitative analysis of the algorithm's convergence. Implementation-wise, it is straightforward, being based on several established photometric stereo and structure from motion algorithms. We demonstrate experimentally the effectiveness of our algorithm using several videos of hand-held objects moving in front of a fixed light and camera.

AB - We introduce an iterative algorithm for shape reconstruction from multiple images of a moving (Lambertian) object illuminated by distant (and possibly time varying) lighting. Starting with an initial piecewise linear surface, the algorithm iteratively estimates a new surface based on the previous surface estimate and the photometric information available from the input image sequence. During each iteration, standard photometric stereo techniques are applied to estimate the surface normals up to an unknown generalized bas-relief transform, and a new surface is computed by integrating the estimated normals. The algorithm essentially consists of a sequence of matrix factorizations (of intensity values) followed by minimization using gradient descent (integration of the normals). Conceptually, the algorithm admits a clear geometric interpretation, which is used to provide a qualitative analysis of the algorithm's convergence. Implementation-wise, it is straightforward, being based on several established photometric stereo and structure from motion algorithms. We demonstrate experimentally the effectiveness of our algorithm using several videos of hand-held objects moving in front of a fixed light and camera.

UR - http://www.scopus.com/inward/record.url?scp=33745881365&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745881365&partnerID=8YFLogxK

U2 - 10.1109/ICCV.2005.185

DO - 10.1109/ICCV.2005.185

M3 - Conference contribution

AN - SCOPUS:33745881365

SN - 076952334X

SN - 9780769523347

T3 - Proceedings of the IEEE International Conference on Computer Vision

SP - 1635

EP - 1642

BT - Proceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005

ER -

Lim J, Ho J, Yang MH, Kriegman D. Passive photometric stereo from motion. In Proceedings - 10th IEEE International Conference on Computer Vision, ICCV 2005. 2005. p. 1635-1642. 1544913. (Proceedings of the IEEE International Conference on Computer Vision). https://doi.org/10.1109/ICCV.2005.185