Motion-compensated spatial-temporal filtering for noisy CFA sequence

Min Seok Lee, Sang Wook Park, Moon Gi Kang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Spatial-temporal filters have been widely used in video denoising module. The filters are commonly designed for monochromatic image. However, most digital video cameras use a color filter array (CFA) to get color sequence. We propose a recursive spatial-temporal filter using motion estimation (ME) and motion compensated prediction (MCP) for CFA sequence. In the proposed ME method, we obtain candidate motion vectors from CFA sequence through hypothetical luminance maps. With the estimated motion vectors, the accurate MCP is obtained from CFA sequence by weighted averaging, which is determined by spatial-temporal LMMSE. Then, the temporal filter combines estimated MCP and current pixel. This process is controlled by the motion detection value. After temporal filtering, the spatial filter is applied to the filtered current frame as a post-processing. Experimental results show that the proposed method achieves good denoising performance without motion blurring and acquires high visual quality.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Image Processing
Subtitle of host publicationAlgorithms and Systems X; and Parallel Processing for Imaging Applications II
Volume8295
DOIs
Publication statusPublished - 2012 Mar 5
EventImage Processing: Algorithms and Systems X; and Parallel Processing for Imaging Applications II - Burlingame, CA, United States
Duration: 2012 Jan 232012 Jan 25

Other

OtherImage Processing: Algorithms and Systems X; and Parallel Processing for Imaging Applications II
CountryUnited States
CityBurlingame, CA
Period12/1/2312/1/25

Fingerprint

Color Filter Array
Filtering
Filter
Color
color
filters
Motion
Motion Vector
Motion Estimation
Motion estimation
Denoising
Prediction
Motion Detection
Digital Video
Luminance
Digital cameras
Video cameras
Post-processing
Averaging
predictions

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Lee, M. S., Park, S. W., & Kang, M. G. (2012). Motion-compensated spatial-temporal filtering for noisy CFA sequence. In Proceedings of SPIE-IS and T Electronic Imaging - Image Processing: Algorithms and Systems X; and Parallel Processing for Imaging Applications II (Vol. 8295). [82951D] https://doi.org/10.1117/12.907564
Lee, Min Seok ; Park, Sang Wook ; Kang, Moon Gi. / Motion-compensated spatial-temporal filtering for noisy CFA sequence. Proceedings of SPIE-IS and T Electronic Imaging - Image Processing: Algorithms and Systems X; and Parallel Processing for Imaging Applications II. Vol. 8295 2012.
@inproceedings{43f3dd51402d443e801dcd7453d058af,
title = "Motion-compensated spatial-temporal filtering for noisy CFA sequence",
abstract = "Spatial-temporal filters have been widely used in video denoising module. The filters are commonly designed for monochromatic image. However, most digital video cameras use a color filter array (CFA) to get color sequence. We propose a recursive spatial-temporal filter using motion estimation (ME) and motion compensated prediction (MCP) for CFA sequence. In the proposed ME method, we obtain candidate motion vectors from CFA sequence through hypothetical luminance maps. With the estimated motion vectors, the accurate MCP is obtained from CFA sequence by weighted averaging, which is determined by spatial-temporal LMMSE. Then, the temporal filter combines estimated MCP and current pixel. This process is controlled by the motion detection value. After temporal filtering, the spatial filter is applied to the filtered current frame as a post-processing. Experimental results show that the proposed method achieves good denoising performance without motion blurring and acquires high visual quality.",
author = "Lee, {Min Seok} and Park, {Sang Wook} and Kang, {Moon Gi}",
year = "2012",
month = "3",
day = "5",
doi = "10.1117/12.907564",
language = "English",
isbn = "9780819489425",
volume = "8295",
booktitle = "Proceedings of SPIE-IS and T Electronic Imaging - Image Processing",

}

Lee, MS, Park, SW & Kang, MG 2012, Motion-compensated spatial-temporal filtering for noisy CFA sequence. in Proceedings of SPIE-IS and T Electronic Imaging - Image Processing: Algorithms and Systems X; and Parallel Processing for Imaging Applications II. vol. 8295, 82951D, Image Processing: Algorithms and Systems X; and Parallel Processing for Imaging Applications II, Burlingame, CA, United States, 12/1/23. https://doi.org/10.1117/12.907564

Motion-compensated spatial-temporal filtering for noisy CFA sequence. / Lee, Min Seok; Park, Sang Wook; Kang, Moon Gi.

Proceedings of SPIE-IS and T Electronic Imaging - Image Processing: Algorithms and Systems X; and Parallel Processing for Imaging Applications II. Vol. 8295 2012. 82951D.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Motion-compensated spatial-temporal filtering for noisy CFA sequence

AU - Lee, Min Seok

AU - Park, Sang Wook

AU - Kang, Moon Gi

PY - 2012/3/5

Y1 - 2012/3/5

N2 - Spatial-temporal filters have been widely used in video denoising module. The filters are commonly designed for monochromatic image. However, most digital video cameras use a color filter array (CFA) to get color sequence. We propose a recursive spatial-temporal filter using motion estimation (ME) and motion compensated prediction (MCP) for CFA sequence. In the proposed ME method, we obtain candidate motion vectors from CFA sequence through hypothetical luminance maps. With the estimated motion vectors, the accurate MCP is obtained from CFA sequence by weighted averaging, which is determined by spatial-temporal LMMSE. Then, the temporal filter combines estimated MCP and current pixel. This process is controlled by the motion detection value. After temporal filtering, the spatial filter is applied to the filtered current frame as a post-processing. Experimental results show that the proposed method achieves good denoising performance without motion blurring and acquires high visual quality.

AB - Spatial-temporal filters have been widely used in video denoising module. The filters are commonly designed for monochromatic image. However, most digital video cameras use a color filter array (CFA) to get color sequence. We propose a recursive spatial-temporal filter using motion estimation (ME) and motion compensated prediction (MCP) for CFA sequence. In the proposed ME method, we obtain candidate motion vectors from CFA sequence through hypothetical luminance maps. With the estimated motion vectors, the accurate MCP is obtained from CFA sequence by weighted averaging, which is determined by spatial-temporal LMMSE. Then, the temporal filter combines estimated MCP and current pixel. This process is controlled by the motion detection value. After temporal filtering, the spatial filter is applied to the filtered current frame as a post-processing. Experimental results show that the proposed method achieves good denoising performance without motion blurring and acquires high visual quality.

UR - http://www.scopus.com/inward/record.url?scp=84863141180&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863141180&partnerID=8YFLogxK

U2 - 10.1117/12.907564

DO - 10.1117/12.907564

M3 - Conference contribution

SN - 9780819489425

VL - 8295

BT - Proceedings of SPIE-IS and T Electronic Imaging - Image Processing

ER -

Lee MS, Park SW, Kang MG. Motion-compensated spatial-temporal filtering for noisy CFA sequence. In Proceedings of SPIE-IS and T Electronic Imaging - Image Processing: Algorithms and Systems X; and Parallel Processing for Imaging Applications II. Vol. 8295. 2012. 82951D https://doi.org/10.1117/12.907564