Estimating all frequency lighting using a color/depth image

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

This paper presents a novel approach to estimating the lighting using a pair of one color and one depth image. To effectively model all frequency lighting, we introduce a hybrid representation for lighting; the combination of spherical harmonic basis functions and point lights. Upon the existing framework of spherical harmonics based diffuse reflection, we divide the color image into diffuse and non-diffuse reflections. Then, we use the diffuse reflection for estimating the low frequency lighting. For high frequency lighting, we obtain the specular reflections by analyzing the non-diffuse reflection. Knowing specular reflections and scene geometry, we are capable of computing the direction of point lights, inverting the reflected ray with respect to the surface normal. Then, we optimize the intensity of point lights by analysis by synthesis paradigm. By superimposing the low and high frequency lighting, we recover the lighting present in the scene. While existing methods use the low frequency lighting to infer the high frequency lighting, we propose to use the nondiffuse reflection for directly estimating the high frequency lighting. In this way, we make good use of the non-diffuse reflections in scene analysis and understanding. Experimental results show that the proposed approach is an effective solution for the lighting estimation of real world environment.

Original languageEnglish
Title of host publication2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings
Pages565-568
Number of pages4
DOIs
Publication statusPublished - 2012 Dec 1
Event2012 19th IEEE International Conference on Image Processing, ICIP 2012 - Lake Buena Vista, FL, United States
Duration: 2012 Sep 302012 Oct 3

Other

Other2012 19th IEEE International Conference on Image Processing, ICIP 2012
CountryUnited States
CityLake Buena Vista, FL
Period12/9/3012/10/3

Fingerprint

Lighting
Color
Geometry

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Information Systems

Cite this

Shim, H. (2012). Estimating all frequency lighting using a color/depth image. In 2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings (pp. 565-568). [6466922] https://doi.org/10.1109/ICIP.2012.6466922
Shim, Hyunjung. / Estimating all frequency lighting using a color/depth image. 2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings. 2012. pp. 565-568
@inproceedings{5b8a0a198c454fa4ada3f1145f19335d,
title = "Estimating all frequency lighting using a color/depth image",
abstract = "This paper presents a novel approach to estimating the lighting using a pair of one color and one depth image. To effectively model all frequency lighting, we introduce a hybrid representation for lighting; the combination of spherical harmonic basis functions and point lights. Upon the existing framework of spherical harmonics based diffuse reflection, we divide the color image into diffuse and non-diffuse reflections. Then, we use the diffuse reflection for estimating the low frequency lighting. For high frequency lighting, we obtain the specular reflections by analyzing the non-diffuse reflection. Knowing specular reflections and scene geometry, we are capable of computing the direction of point lights, inverting the reflected ray with respect to the surface normal. Then, we optimize the intensity of point lights by analysis by synthesis paradigm. By superimposing the low and high frequency lighting, we recover the lighting present in the scene. While existing methods use the low frequency lighting to infer the high frequency lighting, we propose to use the nondiffuse reflection for directly estimating the high frequency lighting. In this way, we make good use of the non-diffuse reflections in scene analysis and understanding. Experimental results show that the proposed approach is an effective solution for the lighting estimation of real world environment.",
author = "Hyunjung Shim",
year = "2012",
month = "12",
day = "1",
doi = "10.1109/ICIP.2012.6466922",
language = "English",
isbn = "9781467325332",
pages = "565--568",
booktitle = "2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings",

}

Shim, H 2012, Estimating all frequency lighting using a color/depth image. in 2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings., 6466922, pp. 565-568, 2012 19th IEEE International Conference on Image Processing, ICIP 2012, Lake Buena Vista, FL, United States, 12/9/30. https://doi.org/10.1109/ICIP.2012.6466922

Estimating all frequency lighting using a color/depth image. / Shim, Hyunjung.

2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings. 2012. p. 565-568 6466922.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Estimating all frequency lighting using a color/depth image

AU - Shim, Hyunjung

PY - 2012/12/1

Y1 - 2012/12/1

N2 - This paper presents a novel approach to estimating the lighting using a pair of one color and one depth image. To effectively model all frequency lighting, we introduce a hybrid representation for lighting; the combination of spherical harmonic basis functions and point lights. Upon the existing framework of spherical harmonics based diffuse reflection, we divide the color image into diffuse and non-diffuse reflections. Then, we use the diffuse reflection for estimating the low frequency lighting. For high frequency lighting, we obtain the specular reflections by analyzing the non-diffuse reflection. Knowing specular reflections and scene geometry, we are capable of computing the direction of point lights, inverting the reflected ray with respect to the surface normal. Then, we optimize the intensity of point lights by analysis by synthesis paradigm. By superimposing the low and high frequency lighting, we recover the lighting present in the scene. While existing methods use the low frequency lighting to infer the high frequency lighting, we propose to use the nondiffuse reflection for directly estimating the high frequency lighting. In this way, we make good use of the non-diffuse reflections in scene analysis and understanding. Experimental results show that the proposed approach is an effective solution for the lighting estimation of real world environment.

AB - This paper presents a novel approach to estimating the lighting using a pair of one color and one depth image. To effectively model all frequency lighting, we introduce a hybrid representation for lighting; the combination of spherical harmonic basis functions and point lights. Upon the existing framework of spherical harmonics based diffuse reflection, we divide the color image into diffuse and non-diffuse reflections. Then, we use the diffuse reflection for estimating the low frequency lighting. For high frequency lighting, we obtain the specular reflections by analyzing the non-diffuse reflection. Knowing specular reflections and scene geometry, we are capable of computing the direction of point lights, inverting the reflected ray with respect to the surface normal. Then, we optimize the intensity of point lights by analysis by synthesis paradigm. By superimposing the low and high frequency lighting, we recover the lighting present in the scene. While existing methods use the low frequency lighting to infer the high frequency lighting, we propose to use the nondiffuse reflection for directly estimating the high frequency lighting. In this way, we make good use of the non-diffuse reflections in scene analysis and understanding. Experimental results show that the proposed approach is an effective solution for the lighting estimation of real world environment.

UR - http://www.scopus.com/inward/record.url?scp=84875826099&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84875826099&partnerID=8YFLogxK

U2 - 10.1109/ICIP.2012.6466922

DO - 10.1109/ICIP.2012.6466922

M3 - Conference contribution

SN - 9781467325332

SP - 565

EP - 568

BT - 2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings

ER -

Shim H. Estimating all frequency lighting using a color/depth image. In 2012 IEEE International Conference on Image Processing, ICIP 2012 - Proceedings. 2012. p. 565-568. 6466922 https://doi.org/10.1109/ICIP.2012.6466922