Towards standardized 3DTV QoE assessment: Cross-lab study on display technology and viewing environment parameters

Marcus Barkowsky, Jing Li, Taehwan Han, Sungwook Youn, Jiheon Ok, Chulhee Lee, Christer Hedberg, Indirajith Vijai Ananth, Kun Wang, Kjell Brunnström, Patrick Le Callet

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

Subjective assessment of Quality of Experience in stereoscopic 3D requires new guidelines for the environmental setup as existing standards such as ITU-R BT.500 may no longer be appropriate. A first step is to perform cross-lab experiments in different viewing conditions on the same video sequences. Three international labs performed Absolute Category Rating studies on a freely available video database containing degradations that are mainly related to video quality degradations. Different conditions have been used in the labs: Passive polarized displays, active shutter displays, differences in viewing distance, the number of parallel viewers, and the voting device. Implicit variations were introduced due to the three different languages in Sweden, South Korea, and France. Although the obtained Mean Opinion Scores are comparable, slight differences occur in function of the video degradations and the viewing distance. An analysis on the statistical differences obtained between the MOS of the video sequences revealed that obtaining an equivalent number of differences may require more observers in some viewing conditions. It was also seen that the alignment of the meaning of the attributes used in Absolute Category Rating in different languages may be beneficial. Statistical analysis was performed showing influence of the viewing distance on votes and MOS results.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIV
DOIs
Publication statusPublished - 2013 Jun 12
Event24th IS and T/SPIE Stereoscopic Displays and Applications Conference, SD and A 2013 - Burlingame, CA, United States
Duration: 2013 Feb 42013 Feb 6

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume8648
ISSN (Print)0277-786X

Other

Other24th IS and T/SPIE Stereoscopic Displays and Applications Conference, SD and A 2013
CountryUnited States
CityBurlingame, CA
Period13/2/413/2/6

Fingerprint

Display
Display devices
Degradation
ratings
degradation
Video Databases
Sweden
Video Quality
Statistical methods
South Korea
voting
Vote
Voting
shutters
Statistical Analysis
Observer
Alignment
France
statistical analysis
Attribute

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Barkowsky, M., Li, J., Han, T., Youn, S., Ok, J., Lee, C., ... Le Callet, P. (2013). Towards standardized 3DTV QoE assessment: Cross-lab study on display technology and viewing environment parameters. In Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIV [864809] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 8648). https://doi.org/10.1117/12.2004050
Barkowsky, Marcus ; Li, Jing ; Han, Taehwan ; Youn, Sungwook ; Ok, Jiheon ; Lee, Chulhee ; Hedberg, Christer ; Ananth, Indirajith Vijai ; Wang, Kun ; Brunnström, Kjell ; Le Callet, Patrick. / Towards standardized 3DTV QoE assessment : Cross-lab study on display technology and viewing environment parameters. Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIV. 2013. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{7b10c565fb874ba4862b580e37091d36,
title = "Towards standardized 3DTV QoE assessment: Cross-lab study on display technology and viewing environment parameters",
abstract = "Subjective assessment of Quality of Experience in stereoscopic 3D requires new guidelines for the environmental setup as existing standards such as ITU-R BT.500 may no longer be appropriate. A first step is to perform cross-lab experiments in different viewing conditions on the same video sequences. Three international labs performed Absolute Category Rating studies on a freely available video database containing degradations that are mainly related to video quality degradations. Different conditions have been used in the labs: Passive polarized displays, active shutter displays, differences in viewing distance, the number of parallel viewers, and the voting device. Implicit variations were introduced due to the three different languages in Sweden, South Korea, and France. Although the obtained Mean Opinion Scores are comparable, slight differences occur in function of the video degradations and the viewing distance. An analysis on the statistical differences obtained between the MOS of the video sequences revealed that obtaining an equivalent number of differences may require more observers in some viewing conditions. It was also seen that the alignment of the meaning of the attributes used in Absolute Category Rating in different languages may be beneficial. Statistical analysis was performed showing influence of the viewing distance on votes and MOS results.",
author = "Marcus Barkowsky and Jing Li and Taehwan Han and Sungwook Youn and Jiheon Ok and Chulhee Lee and Christer Hedberg and Ananth, {Indirajith Vijai} and Kun Wang and Kjell Brunnstr{\"o}m and {Le Callet}, Patrick",
year = "2013",
month = "6",
day = "12",
doi = "10.1117/12.2004050",
language = "English",
isbn = "9780819494214",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
booktitle = "Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIV",

}

Barkowsky, M, Li, J, Han, T, Youn, S, Ok, J, Lee, C, Hedberg, C, Ananth, IV, Wang, K, Brunnström, K & Le Callet, P 2013, Towards standardized 3DTV QoE assessment: Cross-lab study on display technology and viewing environment parameters. in Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIV., 864809, Proceedings of SPIE - The International Society for Optical Engineering, vol. 8648, 24th IS and T/SPIE Stereoscopic Displays and Applications Conference, SD and A 2013, Burlingame, CA, United States, 13/2/4. https://doi.org/10.1117/12.2004050

Towards standardized 3DTV QoE assessment : Cross-lab study on display technology and viewing environment parameters. / Barkowsky, Marcus; Li, Jing; Han, Taehwan; Youn, Sungwook; Ok, Jiheon; Lee, Chulhee; Hedberg, Christer; Ananth, Indirajith Vijai; Wang, Kun; Brunnström, Kjell; Le Callet, Patrick.

Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIV. 2013. 864809 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 8648).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Towards standardized 3DTV QoE assessment

T2 - Cross-lab study on display technology and viewing environment parameters

AU - Barkowsky, Marcus

AU - Li, Jing

AU - Han, Taehwan

AU - Youn, Sungwook

AU - Ok, Jiheon

AU - Lee, Chulhee

AU - Hedberg, Christer

AU - Ananth, Indirajith Vijai

AU - Wang, Kun

AU - Brunnström, Kjell

AU - Le Callet, Patrick

PY - 2013/6/12

Y1 - 2013/6/12

N2 - Subjective assessment of Quality of Experience in stereoscopic 3D requires new guidelines for the environmental setup as existing standards such as ITU-R BT.500 may no longer be appropriate. A first step is to perform cross-lab experiments in different viewing conditions on the same video sequences. Three international labs performed Absolute Category Rating studies on a freely available video database containing degradations that are mainly related to video quality degradations. Different conditions have been used in the labs: Passive polarized displays, active shutter displays, differences in viewing distance, the number of parallel viewers, and the voting device. Implicit variations were introduced due to the three different languages in Sweden, South Korea, and France. Although the obtained Mean Opinion Scores are comparable, slight differences occur in function of the video degradations and the viewing distance. An analysis on the statistical differences obtained between the MOS of the video sequences revealed that obtaining an equivalent number of differences may require more observers in some viewing conditions. It was also seen that the alignment of the meaning of the attributes used in Absolute Category Rating in different languages may be beneficial. Statistical analysis was performed showing influence of the viewing distance on votes and MOS results.

AB - Subjective assessment of Quality of Experience in stereoscopic 3D requires new guidelines for the environmental setup as existing standards such as ITU-R BT.500 may no longer be appropriate. A first step is to perform cross-lab experiments in different viewing conditions on the same video sequences. Three international labs performed Absolute Category Rating studies on a freely available video database containing degradations that are mainly related to video quality degradations. Different conditions have been used in the labs: Passive polarized displays, active shutter displays, differences in viewing distance, the number of parallel viewers, and the voting device. Implicit variations were introduced due to the three different languages in Sweden, South Korea, and France. Although the obtained Mean Opinion Scores are comparable, slight differences occur in function of the video degradations and the viewing distance. An analysis on the statistical differences obtained between the MOS of the video sequences revealed that obtaining an equivalent number of differences may require more observers in some viewing conditions. It was also seen that the alignment of the meaning of the attributes used in Absolute Category Rating in different languages may be beneficial. Statistical analysis was performed showing influence of the viewing distance on votes and MOS results.

UR - http://www.scopus.com/inward/record.url?scp=84878734034&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878734034&partnerID=8YFLogxK

U2 - 10.1117/12.2004050

DO - 10.1117/12.2004050

M3 - Conference contribution

AN - SCOPUS:84878734034

SN - 9780819494214

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIV

ER -

Barkowsky M, Li J, Han T, Youn S, Ok J, Lee C et al. Towards standardized 3DTV QoE assessment: Cross-lab study on display technology and viewing environment parameters. In Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIV. 2013. 864809. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.2004050