Time-of-flight sensor and color camera calibration for multi-view acquisition

Hyunjung Shim, Rolf Adelsberger, James Dokyoon Kim, Seon Min Rhee, Taehyun Rhee, Jae Young Sim, Markus Gross, Changyeong Kim

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

This paper presents a multi-view acquisition system using multi-modal sensors, composed of time-of-flight (ToF) range sensors and color cameras. Our system captures the multiple pairs of color images and depth maps at multiple viewing directions. In order to ensure the acceptable accuracy of measurements, we compensate errors in sensor measurement and calibrate multi-modal devices. Upon manifold experiments and extensive analysis, we identify the major sources of systematic error in sensor measurement and construct an error model for compensation. As a result, we provide a practical solution for the real-time error compensation of depth measurement. Moreover, we implement the calibration scheme for multi-modal devices, unifying the spatial coordinate for multi-modal sensors. The main contribution of this work is to present the thorough analysis of systematic error in sensor measurement and therefore provide a reliable methodology for robust error compensation. The proposed system offers a real-time multi-modal sensor calibration method and thereby is applicable for the 3D reconstruction of dynamic scenes.

Original languageEnglish
Pages (from-to)1139-1151
Number of pages13
JournalVisual Computer
Volume28
Issue number12
DOIs
Publication statusPublished - 2012 Dec 1

Fingerprint

Cameras
Calibration
Color
Sensors
Error compensation
Systematic errors
Experiments

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Cite this

Shim, H., Adelsberger, R., Kim, J. D., Rhee, S. M., Rhee, T., Sim, J. Y., ... Kim, C. (2012). Time-of-flight sensor and color camera calibration for multi-view acquisition. Visual Computer, 28(12), 1139-1151. https://doi.org/10.1007/s00371-011-0664-x
Shim, Hyunjung ; Adelsberger, Rolf ; Kim, James Dokyoon ; Rhee, Seon Min ; Rhee, Taehyun ; Sim, Jae Young ; Gross, Markus ; Kim, Changyeong. / Time-of-flight sensor and color camera calibration for multi-view acquisition. In: Visual Computer. 2012 ; Vol. 28, No. 12. pp. 1139-1151.
@article{217194db550648cfa8d99dc57a07daa8,
title = "Time-of-flight sensor and color camera calibration for multi-view acquisition",
abstract = "This paper presents a multi-view acquisition system using multi-modal sensors, composed of time-of-flight (ToF) range sensors and color cameras. Our system captures the multiple pairs of color images and depth maps at multiple viewing directions. In order to ensure the acceptable accuracy of measurements, we compensate errors in sensor measurement and calibrate multi-modal devices. Upon manifold experiments and extensive analysis, we identify the major sources of systematic error in sensor measurement and construct an error model for compensation. As a result, we provide a practical solution for the real-time error compensation of depth measurement. Moreover, we implement the calibration scheme for multi-modal devices, unifying the spatial coordinate for multi-modal sensors. The main contribution of this work is to present the thorough analysis of systematic error in sensor measurement and therefore provide a reliable methodology for robust error compensation. The proposed system offers a real-time multi-modal sensor calibration method and thereby is applicable for the 3D reconstruction of dynamic scenes.",
author = "Hyunjung Shim and Rolf Adelsberger and Kim, {James Dokyoon} and Rhee, {Seon Min} and Taehyun Rhee and Sim, {Jae Young} and Markus Gross and Changyeong Kim",
year = "2012",
month = "12",
day = "1",
doi = "10.1007/s00371-011-0664-x",
language = "English",
volume = "28",
pages = "1139--1151",
journal = "Visual Computer",
issn = "0178-2789",
publisher = "Springer Verlag",
number = "12",

}

Shim, H, Adelsberger, R, Kim, JD, Rhee, SM, Rhee, T, Sim, JY, Gross, M & Kim, C 2012, 'Time-of-flight sensor and color camera calibration for multi-view acquisition', Visual Computer, vol. 28, no. 12, pp. 1139-1151. https://doi.org/10.1007/s00371-011-0664-x

Time-of-flight sensor and color camera calibration for multi-view acquisition. / Shim, Hyunjung; Adelsberger, Rolf; Kim, James Dokyoon; Rhee, Seon Min; Rhee, Taehyun; Sim, Jae Young; Gross, Markus; Kim, Changyeong.

In: Visual Computer, Vol. 28, No. 12, 01.12.2012, p. 1139-1151.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Time-of-flight sensor and color camera calibration for multi-view acquisition

AU - Shim, Hyunjung

AU - Adelsberger, Rolf

AU - Kim, James Dokyoon

AU - Rhee, Seon Min

AU - Rhee, Taehyun

AU - Sim, Jae Young

AU - Gross, Markus

AU - Kim, Changyeong

PY - 2012/12/1

Y1 - 2012/12/1

N2 - This paper presents a multi-view acquisition system using multi-modal sensors, composed of time-of-flight (ToF) range sensors and color cameras. Our system captures the multiple pairs of color images and depth maps at multiple viewing directions. In order to ensure the acceptable accuracy of measurements, we compensate errors in sensor measurement and calibrate multi-modal devices. Upon manifold experiments and extensive analysis, we identify the major sources of systematic error in sensor measurement and construct an error model for compensation. As a result, we provide a practical solution for the real-time error compensation of depth measurement. Moreover, we implement the calibration scheme for multi-modal devices, unifying the spatial coordinate for multi-modal sensors. The main contribution of this work is to present the thorough analysis of systematic error in sensor measurement and therefore provide a reliable methodology for robust error compensation. The proposed system offers a real-time multi-modal sensor calibration method and thereby is applicable for the 3D reconstruction of dynamic scenes.

AB - This paper presents a multi-view acquisition system using multi-modal sensors, composed of time-of-flight (ToF) range sensors and color cameras. Our system captures the multiple pairs of color images and depth maps at multiple viewing directions. In order to ensure the acceptable accuracy of measurements, we compensate errors in sensor measurement and calibrate multi-modal devices. Upon manifold experiments and extensive analysis, we identify the major sources of systematic error in sensor measurement and construct an error model for compensation. As a result, we provide a practical solution for the real-time error compensation of depth measurement. Moreover, we implement the calibration scheme for multi-modal devices, unifying the spatial coordinate for multi-modal sensors. The main contribution of this work is to present the thorough analysis of systematic error in sensor measurement and therefore provide a reliable methodology for robust error compensation. The proposed system offers a real-time multi-modal sensor calibration method and thereby is applicable for the 3D reconstruction of dynamic scenes.

UR - http://www.scopus.com/inward/record.url?scp=84869090899&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84869090899&partnerID=8YFLogxK

U2 - 10.1007/s00371-011-0664-x

DO - 10.1007/s00371-011-0664-x

M3 - Article

AN - SCOPUS:84869090899

VL - 28

SP - 1139

EP - 1151

JO - Visual Computer

JF - Visual Computer

SN - 0178-2789

IS - 12

ER -