Gaze pattern analysis for audio-visual contents under the presence of video transmission errors

Manri Cheon, Jong-Seok Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a study investigating the viewing behavior of human subjects for multimedia contents containing both the audio and video channels when the contents are corrupted by video transmission errors. It considers the human perceptual mechanism in realistic multimedia delivery applications over networks. We design an eye-tracking experiment using several high definition audio-visual contents having a wide range of content characteristics. The results are analyzed in terms of the amount of attention that each region among the sound source region, the region corrupted by packet loss artifacts, and the rest receives under two different audio conditions, i.e., with or without the audio channel. The results show that the effect of the audio channel on the gaze pattern toward packet loss artifacts varies with the contents. In addition, interesting observations such as temporal variations, observer dependence, and content dependence are reported.

Original languageEnglish
Title of host publicationElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
DOIs
Publication statusPublished - 2013 Nov 29
Event2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 - San Jose, CA, United States
Duration: 2013 Jul 152013 Jul 19

Other

Other2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
CountryUnited States
CitySan Jose, CA
Period13/7/1513/7/19

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Gaze pattern analysis for audio-visual contents under the presence of video transmission errors'. Together they form a unique fingerprint.

  • Cite this

    Cheon, M., & Lee, J-S. (2013). Gaze pattern analysis for audio-visual contents under the presence of video transmission errors. In Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 [6618423] https://doi.org/10.1109/ICMEW.2013.6618423