Color restoration of RGBN multispectral filter array sensor images based on spectral decomposition

Chulhee Park, Moon Gi Kang

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

A multispectral filter array (MSFA) image sensor with red, green, blue and near-infrared (NIR) filters is useful for various imaging applications with the advantages that it obtains color information and NIR information simultaneously. Because the MSFA image sensor needs to acquire invisible band information, it is necessary to remove the IR cut-offfilter (IRCF). However, without the IRCF, the color of the image is desaturated by the interference of the additional NIR component of each RGB color channel. To overcome color degradation, a signal processing approach is required to restore natural color by removing the unwanted NIR contribution to the RGB color channels while the additional NIR information remains in the N channel. Thus, in this paper, we propose a color restoration method for an imaging system based on the MSFA image sensor with RGBN filters. To remove the unnecessary NIR component in each RGB color channel, spectral estimation and spectral decomposition are performed based on the spectral characteristics of the MSFA sensor. The proposed color restoration method estimates the spectral intensity in NIR band and recovers hue and color saturation by decomposing the visible band component and the NIR band component in each RGB color channel. The experimental results show that the proposed method effectively restores natural color and minimizes angular errors.

Original languageEnglish
Article number719
JournalSensors (Switzerland)
Volume16
Issue number5
DOIs
Publication statusPublished - 2016 May 1

Fingerprint

Sensor arrays
Image sensors
restoration
Restoration
Color
Decomposition
color
decomposition
filters
sensors
Infrared radiation
infrared filters
Imaging systems
signal processing
Signal processing
degradation
saturation
interference
Imaging techniques

All Science Journal Classification (ASJC) codes

  • Analytical Chemistry
  • Atomic and Molecular Physics, and Optics
  • Biochemistry
  • Electrical and Electronic Engineering

Cite this

@article{096a9f6afa7f4ad8b7551359821fdbdd,
title = "Color restoration of RGBN multispectral filter array sensor images based on spectral decomposition",
abstract = "A multispectral filter array (MSFA) image sensor with red, green, blue and near-infrared (NIR) filters is useful for various imaging applications with the advantages that it obtains color information and NIR information simultaneously. Because the MSFA image sensor needs to acquire invisible band information, it is necessary to remove the IR cut-offfilter (IRCF). However, without the IRCF, the color of the image is desaturated by the interference of the additional NIR component of each RGB color channel. To overcome color degradation, a signal processing approach is required to restore natural color by removing the unwanted NIR contribution to the RGB color channels while the additional NIR information remains in the N channel. Thus, in this paper, we propose a color restoration method for an imaging system based on the MSFA image sensor with RGBN filters. To remove the unnecessary NIR component in each RGB color channel, spectral estimation and spectral decomposition are performed based on the spectral characteristics of the MSFA sensor. The proposed color restoration method estimates the spectral intensity in NIR band and recovers hue and color saturation by decomposing the visible band component and the NIR band component in each RGB color channel. The experimental results show that the proposed method effectively restores natural color and minimizes angular errors.",
author = "Chulhee Park and Kang, {Moon Gi}",
year = "2016",
month = "5",
day = "1",
doi = "10.3390/s16050719",
language = "English",
volume = "16",
journal = "Sensors",
issn = "1424-3210",
publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",
number = "5",

}

Color restoration of RGBN multispectral filter array sensor images based on spectral decomposition. / Park, Chulhee; Kang, Moon Gi.

In: Sensors (Switzerland), Vol. 16, No. 5, 719, 01.05.2016.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Color restoration of RGBN multispectral filter array sensor images based on spectral decomposition

AU - Park, Chulhee

AU - Kang, Moon Gi

PY - 2016/5/1

Y1 - 2016/5/1

N2 - A multispectral filter array (MSFA) image sensor with red, green, blue and near-infrared (NIR) filters is useful for various imaging applications with the advantages that it obtains color information and NIR information simultaneously. Because the MSFA image sensor needs to acquire invisible band information, it is necessary to remove the IR cut-offfilter (IRCF). However, without the IRCF, the color of the image is desaturated by the interference of the additional NIR component of each RGB color channel. To overcome color degradation, a signal processing approach is required to restore natural color by removing the unwanted NIR contribution to the RGB color channels while the additional NIR information remains in the N channel. Thus, in this paper, we propose a color restoration method for an imaging system based on the MSFA image sensor with RGBN filters. To remove the unnecessary NIR component in each RGB color channel, spectral estimation and spectral decomposition are performed based on the spectral characteristics of the MSFA sensor. The proposed color restoration method estimates the spectral intensity in NIR band and recovers hue and color saturation by decomposing the visible band component and the NIR band component in each RGB color channel. The experimental results show that the proposed method effectively restores natural color and minimizes angular errors.

AB - A multispectral filter array (MSFA) image sensor with red, green, blue and near-infrared (NIR) filters is useful for various imaging applications with the advantages that it obtains color information and NIR information simultaneously. Because the MSFA image sensor needs to acquire invisible band information, it is necessary to remove the IR cut-offfilter (IRCF). However, without the IRCF, the color of the image is desaturated by the interference of the additional NIR component of each RGB color channel. To overcome color degradation, a signal processing approach is required to restore natural color by removing the unwanted NIR contribution to the RGB color channels while the additional NIR information remains in the N channel. Thus, in this paper, we propose a color restoration method for an imaging system based on the MSFA image sensor with RGBN filters. To remove the unnecessary NIR component in each RGB color channel, spectral estimation and spectral decomposition are performed based on the spectral characteristics of the MSFA sensor. The proposed color restoration method estimates the spectral intensity in NIR band and recovers hue and color saturation by decomposing the visible band component and the NIR band component in each RGB color channel. The experimental results show that the proposed method effectively restores natural color and minimizes angular errors.

UR - http://www.scopus.com/inward/record.url?scp=84982091494&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84982091494&partnerID=8YFLogxK

U2 - 10.3390/s16050719

DO - 10.3390/s16050719

M3 - Article

VL - 16

JO - Sensors

JF - Sensors

SN - 1424-3210

IS - 5

M1 - 719

ER -