Subjective quality evaluation of foveated video coding using audio-visual focus of attention

Jong Seok Lee, Francesca De Simone, Touradj Ebrahimi

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

This paper presents a foveated coding method using audio-visual focus of attention and its evaluation through extensive subjective experiments on both standard-definition and high-definition sequences. Regarding a sound-emitting region as the location drawing the human attention, the method applies varying quality levels in an image frame according to the distance of a pixel to the identified sound source. Two experiments are presented to prove the efficiency of the method. Experiment 1 examines the validity and effectiveness of the method in comparison to the constant quality coding for high-quality conditions. In Experiment 2, the method is compared to the fixed bit rate coding for low quality conditions where coding artifacts are noticeable. The results demonstrate that the foveated coding method provides considerable coding gain without significant quality degradation, but uneven distributions of the coding artifacts (blockiness) by the method are often less preferred than the uniform distribution of the artifacts. Additional interesting findings are also discussed, such as content dependence of the performance of the method, the memory effect in multiple viewings, and the difference in the quality perception for frame size variations.

Original languageEnglish
Article number5986675
Pages (from-to)1322-1331
Number of pages10
JournalIEEE Journal on Selected Topics in Signal Processing
Volume5
Issue number7
DOIs
Publication statusPublished - 2011 Nov 1

Fingerprint

Image coding
Experiments
Acoustic waves
Pixels
Data storage equipment
Degradation

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Electrical and Electronic Engineering

Cite this

@article{312df2c155a84f5581d2d7704697b873,
title = "Subjective quality evaluation of foveated video coding using audio-visual focus of attention",
abstract = "This paper presents a foveated coding method using audio-visual focus of attention and its evaluation through extensive subjective experiments on both standard-definition and high-definition sequences. Regarding a sound-emitting region as the location drawing the human attention, the method applies varying quality levels in an image frame according to the distance of a pixel to the identified sound source. Two experiments are presented to prove the efficiency of the method. Experiment 1 examines the validity and effectiveness of the method in comparison to the constant quality coding for high-quality conditions. In Experiment 2, the method is compared to the fixed bit rate coding for low quality conditions where coding artifacts are noticeable. The results demonstrate that the foveated coding method provides considerable coding gain without significant quality degradation, but uneven distributions of the coding artifacts (blockiness) by the method are often less preferred than the uniform distribution of the artifacts. Additional interesting findings are also discussed, such as content dependence of the performance of the method, the memory effect in multiple viewings, and the difference in the quality perception for frame size variations.",
author = "Lee, {Jong Seok} and {De Simone}, Francesca and Touradj Ebrahimi",
year = "2011",
month = "11",
day = "1",
doi = "10.1109/JSTSP.2011.2165199",
language = "English",
volume = "5",
pages = "1322--1331",
journal = "IEEE Journal on Selected Topics in Signal Processing",
issn = "1932-4553",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "7",

}

Subjective quality evaluation of foveated video coding using audio-visual focus of attention. / Lee, Jong Seok; De Simone, Francesca; Ebrahimi, Touradj.

In: IEEE Journal on Selected Topics in Signal Processing, Vol. 5, No. 7, 5986675, 01.11.2011, p. 1322-1331.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Subjective quality evaluation of foveated video coding using audio-visual focus of attention

AU - Lee, Jong Seok

AU - De Simone, Francesca

AU - Ebrahimi, Touradj

PY - 2011/11/1

Y1 - 2011/11/1

N2 - This paper presents a foveated coding method using audio-visual focus of attention and its evaluation through extensive subjective experiments on both standard-definition and high-definition sequences. Regarding a sound-emitting region as the location drawing the human attention, the method applies varying quality levels in an image frame according to the distance of a pixel to the identified sound source. Two experiments are presented to prove the efficiency of the method. Experiment 1 examines the validity and effectiveness of the method in comparison to the constant quality coding for high-quality conditions. In Experiment 2, the method is compared to the fixed bit rate coding for low quality conditions where coding artifacts are noticeable. The results demonstrate that the foveated coding method provides considerable coding gain without significant quality degradation, but uneven distributions of the coding artifacts (blockiness) by the method are often less preferred than the uniform distribution of the artifacts. Additional interesting findings are also discussed, such as content dependence of the performance of the method, the memory effect in multiple viewings, and the difference in the quality perception for frame size variations.

AB - This paper presents a foveated coding method using audio-visual focus of attention and its evaluation through extensive subjective experiments on both standard-definition and high-definition sequences. Regarding a sound-emitting region as the location drawing the human attention, the method applies varying quality levels in an image frame according to the distance of a pixel to the identified sound source. Two experiments are presented to prove the efficiency of the method. Experiment 1 examines the validity and effectiveness of the method in comparison to the constant quality coding for high-quality conditions. In Experiment 2, the method is compared to the fixed bit rate coding for low quality conditions where coding artifacts are noticeable. The results demonstrate that the foveated coding method provides considerable coding gain without significant quality degradation, but uneven distributions of the coding artifacts (blockiness) by the method are often less preferred than the uniform distribution of the artifacts. Additional interesting findings are also discussed, such as content dependence of the performance of the method, the memory effect in multiple viewings, and the difference in the quality perception for frame size variations.

UR - http://www.scopus.com/inward/record.url?scp=80054802141&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80054802141&partnerID=8YFLogxK

U2 - 10.1109/JSTSP.2011.2165199

DO - 10.1109/JSTSP.2011.2165199

M3 - Article

AN - SCOPUS:80054802141

VL - 5

SP - 1322

EP - 1331

JO - IEEE Journal on Selected Topics in Signal Processing

JF - IEEE Journal on Selected Topics in Signal Processing

SN - 1932-4553

IS - 7

M1 - 5986675

ER -