Abstract
Scene relighting has found applications in many areas, from movie special effects to building immersive environments. In this paper, we present a framework to render a scene under any prescribed lighting environments. First, we propose a 3D scanner that captures the scene geometry and reflectance simultaneously, by effectively using an uncalibrated camera, and light and shadows projected from a controlled lighting plane onto the scene. Then, a large camera array, composed of 48 cameras forming a planar array, is built to capture a lighting environment as a 4D incident light field. With the scene properties captured by the 3D scanner, and the lighting environment captured by the camera array, we can then relight the scene using a technique we develop, called the adaptive environment map (AEM). AEM, which fully describes the lighting environment including both spatial and directional variations, can render more realistic relighting results than existing techniques in literature, as shown in extensive experiments.
| Original language | English |
|---|---|
| Title of host publication | 2006 Conference on Computer Vision and Pattern Recognition Workshop |
| DOIs | |
| Publication status | Published - 2006 Dec 21 |
| Event | 2006 Conference on Computer Vision and Pattern Recognition Workshops - New York, NY, United States Duration: 2006 Jun 17 → 2006 Jun 22 |
Publication series
| Name | Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition |
|---|---|
| Volume | 2006 |
| ISSN (Print) | 1063-6919 |
Other
| Other | 2006 Conference on Computer Vision and Pattern Recognition Workshops |
|---|---|
| Country | United States |
| City | New York, NY |
| Period | 06/6/17 → 06/6/22 |
Fingerprint
All Science Journal Classification (ASJC) codes
- Software
- Computer Vision and Pattern Recognition
Cite this
}
Adaptive environment map for relighting : Using cameras and projected light. / Shim, Hyunjung; Chen, Tsuhan.
2006 Conference on Computer Vision and Pattern Recognition Workshop. 2006. 1640439 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 2006).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
TY - GEN
T1 - Adaptive environment map for relighting
T2 - Using cameras and projected light
AU - Shim, Hyunjung
AU - Chen, Tsuhan
PY - 2006/12/21
Y1 - 2006/12/21
N2 - Scene relighting has found applications in many areas, from movie special effects to building immersive environments. In this paper, we present a framework to render a scene under any prescribed lighting environments. First, we propose a 3D scanner that captures the scene geometry and reflectance simultaneously, by effectively using an uncalibrated camera, and light and shadows projected from a controlled lighting plane onto the scene. Then, a large camera array, composed of 48 cameras forming a planar array, is built to capture a lighting environment as a 4D incident light field. With the scene properties captured by the 3D scanner, and the lighting environment captured by the camera array, we can then relight the scene using a technique we develop, called the adaptive environment map (AEM). AEM, which fully describes the lighting environment including both spatial and directional variations, can render more realistic relighting results than existing techniques in literature, as shown in extensive experiments.
AB - Scene relighting has found applications in many areas, from movie special effects to building immersive environments. In this paper, we present a framework to render a scene under any prescribed lighting environments. First, we propose a 3D scanner that captures the scene geometry and reflectance simultaneously, by effectively using an uncalibrated camera, and light and shadows projected from a controlled lighting plane onto the scene. Then, a large camera array, composed of 48 cameras forming a planar array, is built to capture a lighting environment as a 4D incident light field. With the scene properties captured by the 3D scanner, and the lighting environment captured by the camera array, we can then relight the scene using a technique we develop, called the adaptive environment map (AEM). AEM, which fully describes the lighting environment including both spatial and directional variations, can render more realistic relighting results than existing techniques in literature, as shown in extensive experiments.
UR - http://www.scopus.com/inward/record.url?scp=33845545975&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=33845545975&partnerID=8YFLogxK
U2 - 10.1109/CVPRW.2006.24
DO - 10.1109/CVPRW.2006.24
M3 - Conference contribution
SN - 0769526462
SN - 9780769526461
T3 - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
BT - 2006 Conference on Computer Vision and Pattern Recognition Workshop
ER -