Least square based multi-spectral color interpolation algorithm for RGB-NIR image sensors

Ji Yong Kwon, Chul Hee Park, Moon Gi Kang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The use of near-infrared (NIR) band gives us additional invisible information to discriminate objects and enables us to recognize objects more clearly under low light conditions. To acquire color and NIR bands together in a single image sensor developed from a conventional color filter array (CFA), we use a multispectral filter array (MSFA) in the RGB-NIR sensors and design a color interpolation algorithm to fill the information about the multi-spectral (MS) bands from the subsampled MSFA image. Aliasing in the MSFA image caused by the subsampled bands is minimized by balancing the energy of the bands. A panchromatic (PAN) image is generated by filtering the low-pass kernel to the MSFA image. This PAN image without chrominance signals, which contains the most high-frequency in the MSFA image, is used to reconstruct the MS images by solving the least square cost function between the PAN and MS images. The experiments show that the proposed algorithm estimates the high-resolution MS images very well.

Original languageEnglish
Title of host publicationVISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings
EditorsFrancisco Imai, Jose Braz, Sebastiano Battiato
PublisherSciTePress
Pages38-45
Number of pages8
ISBN (Electronic)9789897580895
Publication statusPublished - 2015 Jan 1
Event10th International Conference on Computer Vision Theory and Applications, VISAPP 2015 - Berlin, Germany
Duration: 2015 Mar 112015 Mar 14

Publication series

NameVISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings
Volume1

Other

Other10th International Conference on Computer Vision Theory and Applications, VISAPP 2015
CountryGermany
CityBerlin
Period15/3/1115/3/14

Fingerprint

Image sensors
Interpolation
Color
Infrared radiation
Cost functions
Sensors
Experiments

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Cite this

Kwon, J. Y., Park, C. H., & Kang, M. G. (2015). Least square based multi-spectral color interpolation algorithm for RGB-NIR image sensors. In F. Imai, J. Braz, & S. Battiato (Eds.), VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings (pp. 38-45). (VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings; Vol. 1). SciTePress.
Kwon, Ji Yong ; Park, Chul Hee ; Kang, Moon Gi. / Least square based multi-spectral color interpolation algorithm for RGB-NIR image sensors. VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings. editor / Francisco Imai ; Jose Braz ; Sebastiano Battiato. SciTePress, 2015. pp. 38-45 (VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings).
@inproceedings{d817b26f8316488493fdcb4ecd94c739,
title = "Least square based multi-spectral color interpolation algorithm for RGB-NIR image sensors",
abstract = "The use of near-infrared (NIR) band gives us additional invisible information to discriminate objects and enables us to recognize objects more clearly under low light conditions. To acquire color and NIR bands together in a single image sensor developed from a conventional color filter array (CFA), we use a multispectral filter array (MSFA) in the RGB-NIR sensors and design a color interpolation algorithm to fill the information about the multi-spectral (MS) bands from the subsampled MSFA image. Aliasing in the MSFA image caused by the subsampled bands is minimized by balancing the energy of the bands. A panchromatic (PAN) image is generated by filtering the low-pass kernel to the MSFA image. This PAN image without chrominance signals, which contains the most high-frequency in the MSFA image, is used to reconstruct the MS images by solving the least square cost function between the PAN and MS images. The experiments show that the proposed algorithm estimates the high-resolution MS images very well.",
author = "Kwon, {Ji Yong} and Park, {Chul Hee} and Kang, {Moon Gi}",
year = "2015",
month = "1",
day = "1",
language = "English",
series = "VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings",
publisher = "SciTePress",
pages = "38--45",
editor = "Francisco Imai and Jose Braz and Sebastiano Battiato",
booktitle = "VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings",

}

Kwon, JY, Park, CH & Kang, MG 2015, Least square based multi-spectral color interpolation algorithm for RGB-NIR image sensors. in F Imai, J Braz & S Battiato (eds), VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings. VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings, vol. 1, SciTePress, pp. 38-45, 10th International Conference on Computer Vision Theory and Applications, VISAPP 2015, Berlin, Germany, 15/3/11.

Least square based multi-spectral color interpolation algorithm for RGB-NIR image sensors. / Kwon, Ji Yong; Park, Chul Hee; Kang, Moon Gi.

VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings. ed. / Francisco Imai; Jose Braz; Sebastiano Battiato. SciTePress, 2015. p. 38-45 (VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings; Vol. 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Least square based multi-spectral color interpolation algorithm for RGB-NIR image sensors

AU - Kwon, Ji Yong

AU - Park, Chul Hee

AU - Kang, Moon Gi

PY - 2015/1/1

Y1 - 2015/1/1

N2 - The use of near-infrared (NIR) band gives us additional invisible information to discriminate objects and enables us to recognize objects more clearly under low light conditions. To acquire color and NIR bands together in a single image sensor developed from a conventional color filter array (CFA), we use a multispectral filter array (MSFA) in the RGB-NIR sensors and design a color interpolation algorithm to fill the information about the multi-spectral (MS) bands from the subsampled MSFA image. Aliasing in the MSFA image caused by the subsampled bands is minimized by balancing the energy of the bands. A panchromatic (PAN) image is generated by filtering the low-pass kernel to the MSFA image. This PAN image without chrominance signals, which contains the most high-frequency in the MSFA image, is used to reconstruct the MS images by solving the least square cost function between the PAN and MS images. The experiments show that the proposed algorithm estimates the high-resolution MS images very well.

AB - The use of near-infrared (NIR) band gives us additional invisible information to discriminate objects and enables us to recognize objects more clearly under low light conditions. To acquire color and NIR bands together in a single image sensor developed from a conventional color filter array (CFA), we use a multispectral filter array (MSFA) in the RGB-NIR sensors and design a color interpolation algorithm to fill the information about the multi-spectral (MS) bands from the subsampled MSFA image. Aliasing in the MSFA image caused by the subsampled bands is minimized by balancing the energy of the bands. A panchromatic (PAN) image is generated by filtering the low-pass kernel to the MSFA image. This PAN image without chrominance signals, which contains the most high-frequency in the MSFA image, is used to reconstruct the MS images by solving the least square cost function between the PAN and MS images. The experiments show that the proposed algorithm estimates the high-resolution MS images very well.

UR - http://www.scopus.com/inward/record.url?scp=84939517393&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84939517393&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84939517393

T3 - VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings

SP - 38

EP - 45

BT - VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings

A2 - Imai, Francisco

A2 - Braz, Jose

A2 - Battiato, Sebastiano

PB - SciTePress

ER -

Kwon JY, Park CH, Kang MG. Least square based multi-spectral color interpolation algorithm for RGB-NIR image sensors. In Imai F, Braz J, Battiato S, editors, VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings. SciTePress. 2015. p. 38-45. (VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings).