Subjective quality evaluation VIA paired comparison

Application to scalable video coding

Jong-Seok Lee, Francesca De Simone, Touradj Ebrahimi

Research output: Contribution to journalArticle

71 Citations (Scopus)

Abstract

Scalable video coding is a powerful solution for content delivery in many interactive multimedia services due to its adaptability to varying terminal and network constraints. In order to successfully exploit such adaptability, it is necessary to understand users' preference among various scalability options and consequently develop an optimal bit rate adaptation strategy. In this paper, we present a study of subjective quality assessment of scalable video coding, which investigates the influence of the combination of scalability options on perceived quality with the goal of providing guidelines for an adaptive strategy that selects the optimal combination for a given bandwidth constraint. In particular, the study is based on paired comparison of stimuli that is suitable for our goal due to its simplicity and easiness. We propose a new method, called Paired Evaluation via Analysis of Reliability (PEAR), which analyzes paired comparison results and produces not only quality scores but also intuitive measures of confidence of the scores for significance analysis. Results and analysis of extensive subjective tests for two different scalable video codecs and high definition contents are described, from which general consistent conclusions are drawn. The video and subjective data used in the paper are publicly available to the research community.

Original languageEnglish
Article number5772009
Pages (from-to)882-893
Number of pages12
JournalIEEE Transactions on Multimedia
Volume13
Issue number5
DOIs
Publication statusPublished - 2011 Oct 1

Fingerprint

Scalable video coding
Scalability
Multimedia services
Bandwidth

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering
  • Signal Processing
  • Media Technology
  • Computer Science Applications

Cite this

Lee, Jong-Seok ; De Simone, Francesca ; Ebrahimi, Touradj. / Subjective quality evaluation VIA paired comparison : Application to scalable video coding. In: IEEE Transactions on Multimedia. 2011 ; Vol. 13, No. 5. pp. 882-893.
@article{959281d1d21a4e0b8556f2d5190617a3,
title = "Subjective quality evaluation VIA paired comparison: Application to scalable video coding",
abstract = "Scalable video coding is a powerful solution for content delivery in many interactive multimedia services due to its adaptability to varying terminal and network constraints. In order to successfully exploit such adaptability, it is necessary to understand users' preference among various scalability options and consequently develop an optimal bit rate adaptation strategy. In this paper, we present a study of subjective quality assessment of scalable video coding, which investigates the influence of the combination of scalability options on perceived quality with the goal of providing guidelines for an adaptive strategy that selects the optimal combination for a given bandwidth constraint. In particular, the study is based on paired comparison of stimuli that is suitable for our goal due to its simplicity and easiness. We propose a new method, called Paired Evaluation via Analysis of Reliability (PEAR), which analyzes paired comparison results and produces not only quality scores but also intuitive measures of confidence of the scores for significance analysis. Results and analysis of extensive subjective tests for two different scalable video codecs and high definition contents are described, from which general consistent conclusions are drawn. The video and subjective data used in the paper are publicly available to the research community.",
author = "Jong-Seok Lee and {De Simone}, Francesca and Touradj Ebrahimi",
year = "2011",
month = "10",
day = "1",
doi = "10.1109/TMM.2011.2157333",
language = "English",
volume = "13",
pages = "882--893",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "5",

}

Subjective quality evaluation VIA paired comparison : Application to scalable video coding. / Lee, Jong-Seok; De Simone, Francesca; Ebrahimi, Touradj.

In: IEEE Transactions on Multimedia, Vol. 13, No. 5, 5772009, 01.10.2011, p. 882-893.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Subjective quality evaluation VIA paired comparison

T2 - Application to scalable video coding

AU - Lee, Jong-Seok

AU - De Simone, Francesca

AU - Ebrahimi, Touradj

PY - 2011/10/1

Y1 - 2011/10/1

N2 - Scalable video coding is a powerful solution for content delivery in many interactive multimedia services due to its adaptability to varying terminal and network constraints. In order to successfully exploit such adaptability, it is necessary to understand users' preference among various scalability options and consequently develop an optimal bit rate adaptation strategy. In this paper, we present a study of subjective quality assessment of scalable video coding, which investigates the influence of the combination of scalability options on perceived quality with the goal of providing guidelines for an adaptive strategy that selects the optimal combination for a given bandwidth constraint. In particular, the study is based on paired comparison of stimuli that is suitable for our goal due to its simplicity and easiness. We propose a new method, called Paired Evaluation via Analysis of Reliability (PEAR), which analyzes paired comparison results and produces not only quality scores but also intuitive measures of confidence of the scores for significance analysis. Results and analysis of extensive subjective tests for two different scalable video codecs and high definition contents are described, from which general consistent conclusions are drawn. The video and subjective data used in the paper are publicly available to the research community.

AB - Scalable video coding is a powerful solution for content delivery in many interactive multimedia services due to its adaptability to varying terminal and network constraints. In order to successfully exploit such adaptability, it is necessary to understand users' preference among various scalability options and consequently develop an optimal bit rate adaptation strategy. In this paper, we present a study of subjective quality assessment of scalable video coding, which investigates the influence of the combination of scalability options on perceived quality with the goal of providing guidelines for an adaptive strategy that selects the optimal combination for a given bandwidth constraint. In particular, the study is based on paired comparison of stimuli that is suitable for our goal due to its simplicity and easiness. We propose a new method, called Paired Evaluation via Analysis of Reliability (PEAR), which analyzes paired comparison results and produces not only quality scores but also intuitive measures of confidence of the scores for significance analysis. Results and analysis of extensive subjective tests for two different scalable video codecs and high definition contents are described, from which general consistent conclusions are drawn. The video and subjective data used in the paper are publicly available to the research community.

UR - http://www.scopus.com/inward/record.url?scp=80052932019&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052932019&partnerID=8YFLogxK

U2 - 10.1109/TMM.2011.2157333

DO - 10.1109/TMM.2011.2157333

M3 - Article

VL - 13

SP - 882

EP - 893

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 5

M1 - 5772009

ER -