Adaptive environment map for relighting: Using cameras and projected light

Hyunjung Shim, Tsuhan Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Scene relighting has found applications in many areas, from movie special effects to building immersive environments. In this paper, we present a framework to render a scene under any prescribed lighting environments. First, we propose a 3D scanner that captures the scene geometry and reflectance simultaneously, by effectively using an uncalibrated camera, and light and shadows projected from a controlled lighting plane onto the scene. Then, a large camera array, composed of 48 cameras forming a planar array, is built to capture a lighting environment as a 4D incident light field. With the scene properties captured by the 3D scanner, and the lighting environment captured by the camera array, we can then relight the scene using a technique we develop, called the adaptive environment map (AEM). AEM, which fully describes the lighting environment including both spatial and directional variations, can render more realistic relighting results than existing techniques in literature, as shown in extensive experiments.

Original languageEnglish
Title of host publication2006 Conference on Computer Vision and Pattern Recognition Workshop
DOIs
Publication statusPublished - 2006 Dec 21
Event2006 Conference on Computer Vision and Pattern Recognition Workshops - New York, NY, United States
Duration: 2006 Jun 172006 Jun 22

Publication series

NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume2006
ISSN (Print)1063-6919

Other

Other2006 Conference on Computer Vision and Pattern Recognition Workshops
CountryUnited States
CityNew York, NY
Period06/6/1706/6/22

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Adaptive environment map for relighting: Using cameras and projected light'. Together they form a unique fingerprint.

  • Cite this

    Shim, H., & Chen, T. (2006). Adaptive environment map for relighting: Using cameras and projected light. In 2006 Conference on Computer Vision and Pattern Recognition Workshop [1640439] (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 2006). https://doi.org/10.1109/CVPRW.2006.24