Efficient representation of lighting patterns for image-based relighting

Hyunjung Shim, Tsuhan Chen

Research output: Contribution to conferencePaper

4 Citations (Scopus)

Abstract

Image-based relighting (IBL) has become a popular research topic in both computer graphics and signal processing. IBL is the technique that renders images of a scene under different lighting conditions without prior knowledge of the object geometry and surface properties in the scene. Simply put, IBL collects images of the scene under all possible lighting conditions and process these images to render an image of the scene under a new lighting condition. To be practical, IBL strives to reduce the number of images that need to be captured, and most IBL algorithms do so by estimating the surface reflectance function (SRF) of the scene, which represents the response of each pixel in the scene to lighting from various directions. IBL hence becomes the problem of estimating the SRF using a number of lighting patterns to illuminate the scene. To minimize the number of lighting patterns needed, we propose to use a statistical approach, principal component analysis (PCA), and show that the most efficient lighting patterns should be the eigenvectors of the covariance matrix of the SRFs, corresponding to the largest eigenvalues. In addition, we show that discrete cosine transform (DCT)-based lighting patterns perform as well as the optimal PCA-based lighting patterns for typical SRFs, especially for scenes with Lambertian surfaces. Both the PCA-based and the DCT-based methods outperform existing IBL algorithms with fewer lighting patterns.

Original languageEnglish
Pages111-116
Number of pages6
Publication statusPublished - 2004 Dec 1
EventPicture Coding Symposium 2004 - San Francisco, CA, United States
Duration: 2004 Dec 152004 Dec 17

Other

OtherPicture Coding Symposium 2004
CountryUnited States
CitySan Francisco, CA
Period04/12/1504/12/17

Fingerprint

Lighting
Principal component analysis
Discrete cosine transforms
Computer graphics
Covariance matrix
Eigenvalues and eigenfunctions
Surface properties
Signal processing
Pixels
Geometry

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Cite this

Shim, H., & Chen, T. (2004). Efficient representation of lighting patterns for image-based relighting. 111-116. Paper presented at Picture Coding Symposium 2004, San Francisco, CA, United States.
Shim, Hyunjung ; Chen, Tsuhan. / Efficient representation of lighting patterns for image-based relighting. Paper presented at Picture Coding Symposium 2004, San Francisco, CA, United States.6 p.
@conference{0633183e98db4e93870d18867502699a,
title = "Efficient representation of lighting patterns for image-based relighting",
abstract = "Image-based relighting (IBL) has become a popular research topic in both computer graphics and signal processing. IBL is the technique that renders images of a scene under different lighting conditions without prior knowledge of the object geometry and surface properties in the scene. Simply put, IBL collects images of the scene under all possible lighting conditions and process these images to render an image of the scene under a new lighting condition. To be practical, IBL strives to reduce the number of images that need to be captured, and most IBL algorithms do so by estimating the surface reflectance function (SRF) of the scene, which represents the response of each pixel in the scene to lighting from various directions. IBL hence becomes the problem of estimating the SRF using a number of lighting patterns to illuminate the scene. To minimize the number of lighting patterns needed, we propose to use a statistical approach, principal component analysis (PCA), and show that the most efficient lighting patterns should be the eigenvectors of the covariance matrix of the SRFs, corresponding to the largest eigenvalues. In addition, we show that discrete cosine transform (DCT)-based lighting patterns perform as well as the optimal PCA-based lighting patterns for typical SRFs, especially for scenes with Lambertian surfaces. Both the PCA-based and the DCT-based methods outperform existing IBL algorithms with fewer lighting patterns.",
author = "Hyunjung Shim and Tsuhan Chen",
year = "2004",
month = "12",
day = "1",
language = "English",
pages = "111--116",
note = "Picture Coding Symposium 2004 ; Conference date: 15-12-2004 Through 17-12-2004",

}

Shim, H & Chen, T 2004, 'Efficient representation of lighting patterns for image-based relighting' Paper presented at Picture Coding Symposium 2004, San Francisco, CA, United States, 04/12/15 - 04/12/17, pp. 111-116.

Efficient representation of lighting patterns for image-based relighting. / Shim, Hyunjung; Chen, Tsuhan.

2004. 111-116 Paper presented at Picture Coding Symposium 2004, San Francisco, CA, United States.

Research output: Contribution to conferencePaper

TY - CONF

T1 - Efficient representation of lighting patterns for image-based relighting

AU - Shim, Hyunjung

AU - Chen, Tsuhan

PY - 2004/12/1

Y1 - 2004/12/1

N2 - Image-based relighting (IBL) has become a popular research topic in both computer graphics and signal processing. IBL is the technique that renders images of a scene under different lighting conditions without prior knowledge of the object geometry and surface properties in the scene. Simply put, IBL collects images of the scene under all possible lighting conditions and process these images to render an image of the scene under a new lighting condition. To be practical, IBL strives to reduce the number of images that need to be captured, and most IBL algorithms do so by estimating the surface reflectance function (SRF) of the scene, which represents the response of each pixel in the scene to lighting from various directions. IBL hence becomes the problem of estimating the SRF using a number of lighting patterns to illuminate the scene. To minimize the number of lighting patterns needed, we propose to use a statistical approach, principal component analysis (PCA), and show that the most efficient lighting patterns should be the eigenvectors of the covariance matrix of the SRFs, corresponding to the largest eigenvalues. In addition, we show that discrete cosine transform (DCT)-based lighting patterns perform as well as the optimal PCA-based lighting patterns for typical SRFs, especially for scenes with Lambertian surfaces. Both the PCA-based and the DCT-based methods outperform existing IBL algorithms with fewer lighting patterns.

AB - Image-based relighting (IBL) has become a popular research topic in both computer graphics and signal processing. IBL is the technique that renders images of a scene under different lighting conditions without prior knowledge of the object geometry and surface properties in the scene. Simply put, IBL collects images of the scene under all possible lighting conditions and process these images to render an image of the scene under a new lighting condition. To be practical, IBL strives to reduce the number of images that need to be captured, and most IBL algorithms do so by estimating the surface reflectance function (SRF) of the scene, which represents the response of each pixel in the scene to lighting from various directions. IBL hence becomes the problem of estimating the SRF using a number of lighting patterns to illuminate the scene. To minimize the number of lighting patterns needed, we propose to use a statistical approach, principal component analysis (PCA), and show that the most efficient lighting patterns should be the eigenvectors of the covariance matrix of the SRFs, corresponding to the largest eigenvalues. In addition, we show that discrete cosine transform (DCT)-based lighting patterns perform as well as the optimal PCA-based lighting patterns for typical SRFs, especially for scenes with Lambertian surfaces. Both the PCA-based and the DCT-based methods outperform existing IBL algorithms with fewer lighting patterns.

UR - http://www.scopus.com/inward/record.url?scp=18144423175&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=18144423175&partnerID=8YFLogxK

M3 - Paper

SP - 111

EP - 116

ER -

Shim H, Chen T. Efficient representation of lighting patterns for image-based relighting. 2004. Paper presented at Picture Coding Symposium 2004, San Francisco, CA, United States.