Subjective evaluation of next-generation video compression algorithms

A case study

Francesca De Simone, Lutz Goldmann, Jong-Seok Lee, Touradj Ebrahimi, Vittorio Baroncini

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This paper describes the details and the results of the subjective quality evaluation performed at EPFL, as a contribution to the effort of the Joint Collaborative Team on Video Coding (JCT-VC) for the definition of the next-generation video coding standard. The performance of 27 coding technologies have been evaluated with respect to two H.264/MPEG-4 AVC anchors, considering high definition (HD) test material. The test campaign involved a total of 494 naive observers and took place over a period of four weeks. While similar tests have been conducted as part of the standardization process of previous video coding technologies, the test campaign described in this paper is by far the most extensive in the history of video coding standardization. The obtained subjective quality scores show high consistency and support an accurate comparison of the performance of the different coding solutions.

Original languageEnglish
Title of host publicationApplications of Digital Image Processing XXXIII
DOIs
Publication statusPublished - 2010 Dec 1
EventApplications of Digital Image Processing XXXIII - San Diego, CA, United States
Duration: 2010 Aug 22010 Aug 4

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume7798
ISSN (Print)0277-786X

Other

OtherApplications of Digital Image Processing XXXIII
CountryUnited States
CitySan Diego, CA
Period10/8/210/8/4

Fingerprint

video compression
Video Compression
Subjective Evaluation
Video Coding
Image compression
Image coding
coding
evaluation
Standardization
Coding
standardization
Similar Tests
MPEG-4
Quality Evaluation
Anchors
Observer
materials tests
histories

All Science Journal Classification (ASJC) codes

  • Applied Mathematics
  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics

Cite this

De Simone, F., Goldmann, L., Lee, J-S., Ebrahimi, T., & Baroncini, V. (2010). Subjective evaluation of next-generation video compression algorithms: A case study. In Applications of Digital Image Processing XXXIII [779811] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 7798). https://doi.org/10.1117/12.863485
De Simone, Francesca ; Goldmann, Lutz ; Lee, Jong-Seok ; Ebrahimi, Touradj ; Baroncini, Vittorio. / Subjective evaluation of next-generation video compression algorithms : A case study. Applications of Digital Image Processing XXXIII. 2010. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{baf1804005a04fae8a212a1c0a983fed,
title = "Subjective evaluation of next-generation video compression algorithms: A case study",
abstract = "This paper describes the details and the results of the subjective quality evaluation performed at EPFL, as a contribution to the effort of the Joint Collaborative Team on Video Coding (JCT-VC) for the definition of the next-generation video coding standard. The performance of 27 coding technologies have been evaluated with respect to two H.264/MPEG-4 AVC anchors, considering high definition (HD) test material. The test campaign involved a total of 494 naive observers and took place over a period of four weeks. While similar tests have been conducted as part of the standardization process of previous video coding technologies, the test campaign described in this paper is by far the most extensive in the history of video coding standardization. The obtained subjective quality scores show high consistency and support an accurate comparison of the performance of the different coding solutions.",
author = "{De Simone}, Francesca and Lutz Goldmann and Jong-Seok Lee and Touradj Ebrahimi and Vittorio Baroncini",
year = "2010",
month = "12",
day = "1",
doi = "10.1117/12.863485",
language = "English",
isbn = "9780819482945",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
booktitle = "Applications of Digital Image Processing XXXIII",

}

De Simone, F, Goldmann, L, Lee, J-S, Ebrahimi, T & Baroncini, V 2010, Subjective evaluation of next-generation video compression algorithms: A case study. in Applications of Digital Image Processing XXXIII., 779811, Proceedings of SPIE - The International Society for Optical Engineering, vol. 7798, Applications of Digital Image Processing XXXIII, San Diego, CA, United States, 10/8/2. https://doi.org/10.1117/12.863485

Subjective evaluation of next-generation video compression algorithms : A case study. / De Simone, Francesca; Goldmann, Lutz; Lee, Jong-Seok; Ebrahimi, Touradj; Baroncini, Vittorio.

Applications of Digital Image Processing XXXIII. 2010. 779811 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 7798).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Subjective evaluation of next-generation video compression algorithms

T2 - A case study

AU - De Simone, Francesca

AU - Goldmann, Lutz

AU - Lee, Jong-Seok

AU - Ebrahimi, Touradj

AU - Baroncini, Vittorio

PY - 2010/12/1

Y1 - 2010/12/1

N2 - This paper describes the details and the results of the subjective quality evaluation performed at EPFL, as a contribution to the effort of the Joint Collaborative Team on Video Coding (JCT-VC) for the definition of the next-generation video coding standard. The performance of 27 coding technologies have been evaluated with respect to two H.264/MPEG-4 AVC anchors, considering high definition (HD) test material. The test campaign involved a total of 494 naive observers and took place over a period of four weeks. While similar tests have been conducted as part of the standardization process of previous video coding technologies, the test campaign described in this paper is by far the most extensive in the history of video coding standardization. The obtained subjective quality scores show high consistency and support an accurate comparison of the performance of the different coding solutions.

AB - This paper describes the details and the results of the subjective quality evaluation performed at EPFL, as a contribution to the effort of the Joint Collaborative Team on Video Coding (JCT-VC) for the definition of the next-generation video coding standard. The performance of 27 coding technologies have been evaluated with respect to two H.264/MPEG-4 AVC anchors, considering high definition (HD) test material. The test campaign involved a total of 494 naive observers and took place over a period of four weeks. While similar tests have been conducted as part of the standardization process of previous video coding technologies, the test campaign described in this paper is by far the most extensive in the history of video coding standardization. The obtained subjective quality scores show high consistency and support an accurate comparison of the performance of the different coding solutions.

UR - http://www.scopus.com/inward/record.url?scp=78649401749&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78649401749&partnerID=8YFLogxK

U2 - 10.1117/12.863485

DO - 10.1117/12.863485

M3 - Conference contribution

SN - 9780819482945

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Applications of Digital Image Processing XXXIII

ER -

De Simone F, Goldmann L, Lee J-S, Ebrahimi T, Baroncini V. Subjective evaluation of next-generation video compression algorithms: A case study. In Applications of Digital Image Processing XXXIII. 2010. 779811. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.863485