Adaptive environment map for relighting

Using cameras and projected light

Hyunjung Shim, Tsuhan Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Scene relighting has found applications in many areas, from movie special effects to building immersive environments. In this paper, we present a framework to render a scene under any prescribed lighting environments. First, we propose a 3D scanner that captures the scene geometry and reflectance simultaneously, by effectively using an uncalibrated camera, and light and shadows projected from a controlled lighting plane onto the scene. Then, a large camera array, composed of 48 cameras forming a planar array, is built to capture a lighting environment as a 4D incident light field. With the scene properties captured by the 3D scanner, and the lighting environment captured by the camera array, we can then relight the scene using a technique we develop, called the adaptive environment map (AEM). AEM, which fully describes the lighting environment including both spatial and directional variations, can render more realistic relighting results than existing techniques in literature, as shown in extensive experiments.

Original languageEnglish
Title of host publication2006 Conference on Computer Vision and Pattern Recognition Workshop
DOIs
Publication statusPublished - 2006 Dec 21
Event2006 Conference on Computer Vision and Pattern Recognition Workshops - New York, NY, United States
Duration: 2006 Jun 172006 Jun 22

Publication series

NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume2006
ISSN (Print)1063-6919

Other

Other2006 Conference on Computer Vision and Pattern Recognition Workshops
CountryUnited States
CityNew York, NY
Period06/6/1706/6/22

Fingerprint

Lighting
Cameras
Special effects
Geometry
Experiments

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition

Cite this

Shim, H., & Chen, T. (2006). Adaptive environment map for relighting: Using cameras and projected light. In 2006 Conference on Computer Vision and Pattern Recognition Workshop [1640439] (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 2006). https://doi.org/10.1109/CVPRW.2006.24
Shim, Hyunjung ; Chen, Tsuhan. / Adaptive environment map for relighting : Using cameras and projected light. 2006 Conference on Computer Vision and Pattern Recognition Workshop. 2006. (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition).
@inproceedings{2b5b1bf375754d328369f64aa1a83a97,
title = "Adaptive environment map for relighting: Using cameras and projected light",
abstract = "Scene relighting has found applications in many areas, from movie special effects to building immersive environments. In this paper, we present a framework to render a scene under any prescribed lighting environments. First, we propose a 3D scanner that captures the scene geometry and reflectance simultaneously, by effectively using an uncalibrated camera, and light and shadows projected from a controlled lighting plane onto the scene. Then, a large camera array, composed of 48 cameras forming a planar array, is built to capture a lighting environment as a 4D incident light field. With the scene properties captured by the 3D scanner, and the lighting environment captured by the camera array, we can then relight the scene using a technique we develop, called the adaptive environment map (AEM). AEM, which fully describes the lighting environment including both spatial and directional variations, can render more realistic relighting results than existing techniques in literature, as shown in extensive experiments.",
author = "Hyunjung Shim and Tsuhan Chen",
year = "2006",
month = "12",
day = "21",
doi = "10.1109/CVPRW.2006.24",
language = "English",
isbn = "0769526462",
series = "Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition",
booktitle = "2006 Conference on Computer Vision and Pattern Recognition Workshop",

}

Shim, H & Chen, T 2006, Adaptive environment map for relighting: Using cameras and projected light. in 2006 Conference on Computer Vision and Pattern Recognition Workshop., 1640439, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshops, New York, NY, United States, 06/6/17. https://doi.org/10.1109/CVPRW.2006.24

Adaptive environment map for relighting : Using cameras and projected light. / Shim, Hyunjung; Chen, Tsuhan.

2006 Conference on Computer Vision and Pattern Recognition Workshop. 2006. 1640439 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 2006).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Adaptive environment map for relighting

T2 - Using cameras and projected light

AU - Shim, Hyunjung

AU - Chen, Tsuhan

PY - 2006/12/21

Y1 - 2006/12/21

N2 - Scene relighting has found applications in many areas, from movie special effects to building immersive environments. In this paper, we present a framework to render a scene under any prescribed lighting environments. First, we propose a 3D scanner that captures the scene geometry and reflectance simultaneously, by effectively using an uncalibrated camera, and light and shadows projected from a controlled lighting plane onto the scene. Then, a large camera array, composed of 48 cameras forming a planar array, is built to capture a lighting environment as a 4D incident light field. With the scene properties captured by the 3D scanner, and the lighting environment captured by the camera array, we can then relight the scene using a technique we develop, called the adaptive environment map (AEM). AEM, which fully describes the lighting environment including both spatial and directional variations, can render more realistic relighting results than existing techniques in literature, as shown in extensive experiments.

AB - Scene relighting has found applications in many areas, from movie special effects to building immersive environments. In this paper, we present a framework to render a scene under any prescribed lighting environments. First, we propose a 3D scanner that captures the scene geometry and reflectance simultaneously, by effectively using an uncalibrated camera, and light and shadows projected from a controlled lighting plane onto the scene. Then, a large camera array, composed of 48 cameras forming a planar array, is built to capture a lighting environment as a 4D incident light field. With the scene properties captured by the 3D scanner, and the lighting environment captured by the camera array, we can then relight the scene using a technique we develop, called the adaptive environment map (AEM). AEM, which fully describes the lighting environment including both spatial and directional variations, can render more realistic relighting results than existing techniques in literature, as shown in extensive experiments.

UR - http://www.scopus.com/inward/record.url?scp=33845545975&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33845545975&partnerID=8YFLogxK

U2 - 10.1109/CVPRW.2006.24

DO - 10.1109/CVPRW.2006.24

M3 - Conference contribution

SN - 0769526462

SN - 9780769526461

T3 - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

BT - 2006 Conference on Computer Vision and Pattern Recognition Workshop

ER -

Shim H, Chen T. Adaptive environment map for relighting: Using cameras and projected light. In 2006 Conference on Computer Vision and Pattern Recognition Workshop. 2006. 1640439. (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition). https://doi.org/10.1109/CVPRW.2006.24