Multispectral demosaicking considering out-of-focus problem for red-green-blue-near-infrared image sensors

Ji Yong Kwon, Moon Gi Kang

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

A near-infrared (NIR) band provides information invisible to human eyes for discriminating and recognizing objects more clearly under low lighting conditions. To capture color and NIR images simultaneously, a multispectral filter array (MSFA) sensor is used. However, because lenses have different refractive indices for different wavelengths, lenses may fail to focus all rays to the same convergence. This is the reason an out-of-focus problem occurs and images are blurred. In this paper, a demosaicking algorithm that considers the out-of-focus problem is proposed. This algorithm is used by the MSFA of a red-green-blue-NIR image sensor to obtain color and NIR images. After the energies of the multispectral (MS) channels in the MSFA image are balanced to minimize aliasing, that image is filtered by the estimated low-pass kernel to generate a panchromatic (PAN) image. When an image is acquired, the out-of-focus problem and the formation process of the PAN image are modeled. The desired MS image is estimated by solving the least squares approach of the difference between the PAN and MS images based on the models. The experimental results show that the proposed algorithm performs well in estimating high-quality MS images and reduces the out-of-focus problem.

Original languageEnglish
Article number023010
JournalJournal of Electronic Imaging
Volume25
Issue number2
DOIs
Publication statusPublished - 2016 Mar 1

Fingerprint

Image sensors
Infrared radiation
sensors
Lenses
Color
Sensor arrays
Refractive index
Lighting
filters
Wavelength
lenses
color
illuminating
rays
estimating
refractivity

All Science Journal Classification (ASJC) codes

  • Atomic and Molecular Physics, and Optics
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

@article{b71300dfa4fc48a2954193c40ed5b790,
title = "Multispectral demosaicking considering out-of-focus problem for red-green-blue-near-infrared image sensors",
abstract = "A near-infrared (NIR) band provides information invisible to human eyes for discriminating and recognizing objects more clearly under low lighting conditions. To capture color and NIR images simultaneously, a multispectral filter array (MSFA) sensor is used. However, because lenses have different refractive indices for different wavelengths, lenses may fail to focus all rays to the same convergence. This is the reason an out-of-focus problem occurs and images are blurred. In this paper, a demosaicking algorithm that considers the out-of-focus problem is proposed. This algorithm is used by the MSFA of a red-green-blue-NIR image sensor to obtain color and NIR images. After the energies of the multispectral (MS) channels in the MSFA image are balanced to minimize aliasing, that image is filtered by the estimated low-pass kernel to generate a panchromatic (PAN) image. When an image is acquired, the out-of-focus problem and the formation process of the PAN image are modeled. The desired MS image is estimated by solving the least squares approach of the difference between the PAN and MS images based on the models. The experimental results show that the proposed algorithm performs well in estimating high-quality MS images and reduces the out-of-focus problem.",
author = "Kwon, {Ji Yong} and Kang, {Moon Gi}",
year = "2016",
month = "3",
day = "1",
doi = "10.1117/1.JEI.25.2.023010",
language = "English",
volume = "25",
journal = "Journal of Electronic Imaging",
issn = "1017-9909",
publisher = "SPIE",
number = "2",

}

Multispectral demosaicking considering out-of-focus problem for red-green-blue-near-infrared image sensors. / Kwon, Ji Yong; Kang, Moon Gi.

In: Journal of Electronic Imaging, Vol. 25, No. 2, 023010, 01.03.2016.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Multispectral demosaicking considering out-of-focus problem for red-green-blue-near-infrared image sensors

AU - Kwon, Ji Yong

AU - Kang, Moon Gi

PY - 2016/3/1

Y1 - 2016/3/1

N2 - A near-infrared (NIR) band provides information invisible to human eyes for discriminating and recognizing objects more clearly under low lighting conditions. To capture color and NIR images simultaneously, a multispectral filter array (MSFA) sensor is used. However, because lenses have different refractive indices for different wavelengths, lenses may fail to focus all rays to the same convergence. This is the reason an out-of-focus problem occurs and images are blurred. In this paper, a demosaicking algorithm that considers the out-of-focus problem is proposed. This algorithm is used by the MSFA of a red-green-blue-NIR image sensor to obtain color and NIR images. After the energies of the multispectral (MS) channels in the MSFA image are balanced to minimize aliasing, that image is filtered by the estimated low-pass kernel to generate a panchromatic (PAN) image. When an image is acquired, the out-of-focus problem and the formation process of the PAN image are modeled. The desired MS image is estimated by solving the least squares approach of the difference between the PAN and MS images based on the models. The experimental results show that the proposed algorithm performs well in estimating high-quality MS images and reduces the out-of-focus problem.

AB - A near-infrared (NIR) band provides information invisible to human eyes for discriminating and recognizing objects more clearly under low lighting conditions. To capture color and NIR images simultaneously, a multispectral filter array (MSFA) sensor is used. However, because lenses have different refractive indices for different wavelengths, lenses may fail to focus all rays to the same convergence. This is the reason an out-of-focus problem occurs and images are blurred. In this paper, a demosaicking algorithm that considers the out-of-focus problem is proposed. This algorithm is used by the MSFA of a red-green-blue-NIR image sensor to obtain color and NIR images. After the energies of the multispectral (MS) channels in the MSFA image are balanced to minimize aliasing, that image is filtered by the estimated low-pass kernel to generate a panchromatic (PAN) image. When an image is acquired, the out-of-focus problem and the formation process of the PAN image are modeled. The desired MS image is estimated by solving the least squares approach of the difference between the PAN and MS images based on the models. The experimental results show that the proposed algorithm performs well in estimating high-quality MS images and reduces the out-of-focus problem.

UR - http://www.scopus.com/inward/record.url?scp=84964371020&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964371020&partnerID=8YFLogxK

U2 - 10.1117/1.JEI.25.2.023010

DO - 10.1117/1.JEI.25.2.023010

M3 - Article

AN - SCOPUS:84964371020

VL - 25

JO - Journal of Electronic Imaging

JF - Journal of Electronic Imaging

SN - 1017-9909

IS - 2

M1 - 023010

ER -