Paired comparison for subjective multimedia quality assessment: Theory and practice

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

For subjective multimedia quality assessment, paired comparison has been used less frequently than other methodologies such as single stimulus and double stimulus methodologies, mainly due to its increased time complexity. However, it has been shown that paired comparison provides improved discriminability between stimuli, which consequently improves reliability of the test results. Analyzing comparison results involves several challenges in quality score computation, outlier detection, etc. This paper presents theoretical backgrounds on these challenges and use cases where paired comparison are successfully applied. In particular, the issue of the increased time complexity is discussed along with recently proposed solutions.

Original languageEnglish
Title of host publication2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013
Pages1099-1102
Number of pages4
DOIs
Publication statusPublished - 2013 Sep 9
Event2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013 - Beijing, China
Duration: 2013 May 192013 May 23

Publication series

NameProceedings - IEEE International Symposium on Circuits and Systems
ISSN (Print)0271-4310

Other

Other2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013
CountryChina
CityBeijing
Period13/5/1913/5/23

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Cite this

Lee, J. S. (2013). Paired comparison for subjective multimedia quality assessment: Theory and practice. In 2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013 (pp. 1099-1102). [6572042] (Proceedings - IEEE International Symposium on Circuits and Systems). https://doi.org/10.1109/ISCAS.2013.6572042
Lee, Jong Seok. / Paired comparison for subjective multimedia quality assessment : Theory and practice. 2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013. 2013. pp. 1099-1102 (Proceedings - IEEE International Symposium on Circuits and Systems).
@inproceedings{a210271a84db4a74ab4a114ff97986f6,
title = "Paired comparison for subjective multimedia quality assessment: Theory and practice",
abstract = "For subjective multimedia quality assessment, paired comparison has been used less frequently than other methodologies such as single stimulus and double stimulus methodologies, mainly due to its increased time complexity. However, it has been shown that paired comparison provides improved discriminability between stimuli, which consequently improves reliability of the test results. Analyzing comparison results involves several challenges in quality score computation, outlier detection, etc. This paper presents theoretical backgrounds on these challenges and use cases where paired comparison are successfully applied. In particular, the issue of the increased time complexity is discussed along with recently proposed solutions.",
author = "Lee, {Jong Seok}",
year = "2013",
month = "9",
day = "9",
doi = "10.1109/ISCAS.2013.6572042",
language = "English",
isbn = "9781467357609",
series = "Proceedings - IEEE International Symposium on Circuits and Systems",
pages = "1099--1102",
booktitle = "2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013",

}

Lee, JS 2013, Paired comparison for subjective multimedia quality assessment: Theory and practice. in 2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013., 6572042, Proceedings - IEEE International Symposium on Circuits and Systems, pp. 1099-1102, 2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013, Beijing, China, 13/5/19. https://doi.org/10.1109/ISCAS.2013.6572042

Paired comparison for subjective multimedia quality assessment : Theory and practice. / Lee, Jong Seok.

2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013. 2013. p. 1099-1102 6572042 (Proceedings - IEEE International Symposium on Circuits and Systems).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Paired comparison for subjective multimedia quality assessment

T2 - Theory and practice

AU - Lee, Jong Seok

PY - 2013/9/9

Y1 - 2013/9/9

N2 - For subjective multimedia quality assessment, paired comparison has been used less frequently than other methodologies such as single stimulus and double stimulus methodologies, mainly due to its increased time complexity. However, it has been shown that paired comparison provides improved discriminability between stimuli, which consequently improves reliability of the test results. Analyzing comparison results involves several challenges in quality score computation, outlier detection, etc. This paper presents theoretical backgrounds on these challenges and use cases where paired comparison are successfully applied. In particular, the issue of the increased time complexity is discussed along with recently proposed solutions.

AB - For subjective multimedia quality assessment, paired comparison has been used less frequently than other methodologies such as single stimulus and double stimulus methodologies, mainly due to its increased time complexity. However, it has been shown that paired comparison provides improved discriminability between stimuli, which consequently improves reliability of the test results. Analyzing comparison results involves several challenges in quality score computation, outlier detection, etc. This paper presents theoretical backgrounds on these challenges and use cases where paired comparison are successfully applied. In particular, the issue of the increased time complexity is discussed along with recently proposed solutions.

UR - http://www.scopus.com/inward/record.url?scp=84883409115&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84883409115&partnerID=8YFLogxK

U2 - 10.1109/ISCAS.2013.6572042

DO - 10.1109/ISCAS.2013.6572042

M3 - Conference contribution

AN - SCOPUS:84883409115

SN - 9781467357609

T3 - Proceedings - IEEE International Symposium on Circuits and Systems

SP - 1099

EP - 1102

BT - 2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013

ER -

Lee JS. Paired comparison for subjective multimedia quality assessment: Theory and practice. In 2013 IEEE International Symposium on Circuits and Systems, ISCAS 2013. 2013. p. 1099-1102. 6572042. (Proceedings - IEEE International Symposium on Circuits and Systems). https://doi.org/10.1109/ISCAS.2013.6572042