Estimating all frequency lighting using a color/depth image

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

This paper presents a novel approach to estimating the lighting using a pair of one color and one depth image. To effectively model all frequency lighting, we introduce a hybrid representation for lighting; the combination of spherical harmonic basis functions and point lights. Upon the existing framework of spherical harmonics based diffuse reflection, we divide the color image into diffuse and non-diffuse reflections. Then, we use the diffuse reflection for estimating the low frequency lighting. For high frequency lighting, we obtain the specular reflections by analyzing the non-diffuse reflection. Knowing specular reflections and scene geometry, we are capable of computing the direction of point lights, inverting the reflected ray with respect to the surface normal. Then, we optimize the intensity of point lights by analysis by synthesis paradigm. By superimposing the low and high frequency lighting, we recover the lighting present in the scene. While existing methods use the low frequency lighting to infer the high frequency lighting, we propose to use the nondiffuse reflection for directly estimating the high frequency lighting. In this way, we make good use of the non-diffuse reflections in scene analysis and understanding. Experimental results show that the proposed approach is an effective solution for the lighting estimation of real world environment.

Original languageEnglish
Title of host publication2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings
Pages565-568
Number of pages4
DOIs
Publication statusPublished - 2012 Dec 1
Event2012 19th IEEE International Conference on Image Processing, ICIP 2012 - Lake Buena Vista, FL, United States
Duration: 2012 Sep 302012 Oct 3

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Other

Other2012 19th IEEE International Conference on Image Processing, ICIP 2012
CountryUnited States
CityLake Buena Vista, FL
Period12/9/3012/10/3

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Information Systems

Fingerprint Dive into the research topics of 'Estimating all frequency lighting using a color/depth image'. Together they form a unique fingerprint.

  • Cite this

    Shim, H. (2012). Estimating all frequency lighting using a color/depth image. In 2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings (pp. 565-568). [6466922] (Proceedings - International Conference on Image Processing, ICIP). https://doi.org/10.1109/ICIP.2012.6466922