Enhanced film grain noise removal and synthesis for high fidelity video coding

Inseong Hwang, Jinwoo Jeong, Sungjei Kim, Jangwon Choi, Yoonsik Choe

Research output: Contribution to journalArticle

Abstract

In this paper, we propose a novel technique for film grain noise removal and synthesis that can be adopted in high fidelity video coding. Film grain noise enhances the natural appearance of high fidelity video, therefore, it should be preserved. However, film grain noise is a burden to typical video compression systems because it has relatively large energy levels in the high frequency region. In order to improve the coding performance while preserving film grain noise, we propose film grain noise removal in the pre-processing step and film grain noise synthesis in the post processing step. In the pre-processing step, the film grain noise is removed by using temporal and inter-color correlations. Specifically, color image denoisng using inter color prediction provides good denoising performance in the noise-concentrated B plane, because film grain noise has inter-color correlation in the RGB domain. In the post-processing step, we present a noise model to generate noise that is close to the actual noise in terms of a couple of observed statistical properties, such as the inter-color correlation and power of the film grain noise. The results show that the coding gain of the denoised video is higher than for previous works, while the visual quality of the final reconstructed video is well preserved.

Original languageEnglish
Pages (from-to)2253-2264
Number of pages12
JournalIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
VolumeE96-A
Issue number11
DOIs
Publication statusPublished - 2013 Jan 1

Fingerprint

Noise Removal
Video Coding
Image coding
Fidelity
Synthesis
Color
Processing
Post-processing
Preprocessing
Coding Gain
Video Compression
Denoising
Image compression
Color Image
Energy Levels
Statistical property
Electron energy levels
Coding
Prediction

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Computer Graphics and Computer-Aided Design
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

@article{5527e5f806c3421a8ea00cf925c9aea3,
title = "Enhanced film grain noise removal and synthesis for high fidelity video coding",
abstract = "In this paper, we propose a novel technique for film grain noise removal and synthesis that can be adopted in high fidelity video coding. Film grain noise enhances the natural appearance of high fidelity video, therefore, it should be preserved. However, film grain noise is a burden to typical video compression systems because it has relatively large energy levels in the high frequency region. In order to improve the coding performance while preserving film grain noise, we propose film grain noise removal in the pre-processing step and film grain noise synthesis in the post processing step. In the pre-processing step, the film grain noise is removed by using temporal and inter-color correlations. Specifically, color image denoisng using inter color prediction provides good denoising performance in the noise-concentrated B plane, because film grain noise has inter-color correlation in the RGB domain. In the post-processing step, we present a noise model to generate noise that is close to the actual noise in terms of a couple of observed statistical properties, such as the inter-color correlation and power of the film grain noise. The results show that the coding gain of the denoised video is higher than for previous works, while the visual quality of the final reconstructed video is well preserved.",
author = "Inseong Hwang and Jinwoo Jeong and Sungjei Kim and Jangwon Choi and Yoonsik Choe",
year = "2013",
month = "1",
day = "1",
doi = "10.1587/transfun.E96.A.2253",
language = "English",
volume = "E96-A",
pages = "2253--2264",
journal = "IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences",
issn = "0916-8508",
publisher = "Maruzen Co., Ltd/Maruzen Kabushikikaisha",
number = "11",

}

Enhanced film grain noise removal and synthesis for high fidelity video coding. / Hwang, Inseong; Jeong, Jinwoo; Kim, Sungjei; Choi, Jangwon; Choe, Yoonsik.

In: IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, Vol. E96-A, No. 11, 01.01.2013, p. 2253-2264.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Enhanced film grain noise removal and synthesis for high fidelity video coding

AU - Hwang, Inseong

AU - Jeong, Jinwoo

AU - Kim, Sungjei

AU - Choi, Jangwon

AU - Choe, Yoonsik

PY - 2013/1/1

Y1 - 2013/1/1

N2 - In this paper, we propose a novel technique for film grain noise removal and synthesis that can be adopted in high fidelity video coding. Film grain noise enhances the natural appearance of high fidelity video, therefore, it should be preserved. However, film grain noise is a burden to typical video compression systems because it has relatively large energy levels in the high frequency region. In order to improve the coding performance while preserving film grain noise, we propose film grain noise removal in the pre-processing step and film grain noise synthesis in the post processing step. In the pre-processing step, the film grain noise is removed by using temporal and inter-color correlations. Specifically, color image denoisng using inter color prediction provides good denoising performance in the noise-concentrated B plane, because film grain noise has inter-color correlation in the RGB domain. In the post-processing step, we present a noise model to generate noise that is close to the actual noise in terms of a couple of observed statistical properties, such as the inter-color correlation and power of the film grain noise. The results show that the coding gain of the denoised video is higher than for previous works, while the visual quality of the final reconstructed video is well preserved.

AB - In this paper, we propose a novel technique for film grain noise removal and synthesis that can be adopted in high fidelity video coding. Film grain noise enhances the natural appearance of high fidelity video, therefore, it should be preserved. However, film grain noise is a burden to typical video compression systems because it has relatively large energy levels in the high frequency region. In order to improve the coding performance while preserving film grain noise, we propose film grain noise removal in the pre-processing step and film grain noise synthesis in the post processing step. In the pre-processing step, the film grain noise is removed by using temporal and inter-color correlations. Specifically, color image denoisng using inter color prediction provides good denoising performance in the noise-concentrated B plane, because film grain noise has inter-color correlation in the RGB domain. In the post-processing step, we present a noise model to generate noise that is close to the actual noise in terms of a couple of observed statistical properties, such as the inter-color correlation and power of the film grain noise. The results show that the coding gain of the denoised video is higher than for previous works, while the visual quality of the final reconstructed video is well preserved.

UR - http://www.scopus.com/inward/record.url?scp=84888623989&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84888623989&partnerID=8YFLogxK

U2 - 10.1587/transfun.E96.A.2253

DO - 10.1587/transfun.E96.A.2253

M3 - Article

VL - E96-A

SP - 2253

EP - 2264

JO - IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

JF - IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

SN - 0916-8508

IS - 11

ER -