Gaze pattern analysis for audio-visual contents under the presence of video transmission errors

Manri Cheon, Jong-Seok Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a study investigating the viewing behavior of human subjects for multimedia contents containing both the audio and video channels when the contents are corrupted by video transmission errors. It considers the human perceptual mechanism in realistic multimedia delivery applications over networks. We design an eye-tracking experiment using several high definition audio-visual contents having a wide range of content characteristics. The results are analyzed in terms of the amount of attention that each region among the sound source region, the region corrupted by packet loss artifacts, and the rest receives under two different audio conditions, i.e., with or without the audio channel. The results show that the effect of the audio channel on the gaze pattern toward packet loss artifacts varies with the contents. In addition, interesting observations such as temporal variations, observer dependence, and content dependence are reported.

Original languageEnglish
Title of host publicationElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
DOIs
Publication statusPublished - 2013 Nov 29
Event2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 - San Jose, CA, United States
Duration: 2013 Jul 152013 Jul 19

Other

Other2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
CountryUnited States
CitySan Jose, CA
Period13/7/1513/7/19

Fingerprint

Packet loss
Acoustic waves
Experiments

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Cite this

Cheon, M., & Lee, J-S. (2013). Gaze pattern analysis for audio-visual contents under the presence of video transmission errors. In Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 [6618423] https://doi.org/10.1109/ICMEW.2013.6618423
Cheon, Manri ; Lee, Jong-Seok. / Gaze pattern analysis for audio-visual contents under the presence of video transmission errors. Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013. 2013.
@inproceedings{111561b266c34d9483e008f96db9154e,
title = "Gaze pattern analysis for audio-visual contents under the presence of video transmission errors",
abstract = "This paper presents a study investigating the viewing behavior of human subjects for multimedia contents containing both the audio and video channels when the contents are corrupted by video transmission errors. It considers the human perceptual mechanism in realistic multimedia delivery applications over networks. We design an eye-tracking experiment using several high definition audio-visual contents having a wide range of content characteristics. The results are analyzed in terms of the amount of attention that each region among the sound source region, the region corrupted by packet loss artifacts, and the rest receives under two different audio conditions, i.e., with or without the audio channel. The results show that the effect of the audio channel on the gaze pattern toward packet loss artifacts varies with the contents. In addition, interesting observations such as temporal variations, observer dependence, and content dependence are reported.",
author = "Manri Cheon and Jong-Seok Lee",
year = "2013",
month = "11",
day = "29",
doi = "10.1109/ICMEW.2013.6618423",
language = "English",
isbn = "9781479916047",
booktitle = "Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013",

}

Cheon, M & Lee, J-S 2013, Gaze pattern analysis for audio-visual contents under the presence of video transmission errors. in Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013., 6618423, 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013, San Jose, CA, United States, 13/7/15. https://doi.org/10.1109/ICMEW.2013.6618423

Gaze pattern analysis for audio-visual contents under the presence of video transmission errors. / Cheon, Manri; Lee, Jong-Seok.

Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013. 2013. 6618423.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Gaze pattern analysis for audio-visual contents under the presence of video transmission errors

AU - Cheon, Manri

AU - Lee, Jong-Seok

PY - 2013/11/29

Y1 - 2013/11/29

N2 - This paper presents a study investigating the viewing behavior of human subjects for multimedia contents containing both the audio and video channels when the contents are corrupted by video transmission errors. It considers the human perceptual mechanism in realistic multimedia delivery applications over networks. We design an eye-tracking experiment using several high definition audio-visual contents having a wide range of content characteristics. The results are analyzed in terms of the amount of attention that each region among the sound source region, the region corrupted by packet loss artifacts, and the rest receives under two different audio conditions, i.e., with or without the audio channel. The results show that the effect of the audio channel on the gaze pattern toward packet loss artifacts varies with the contents. In addition, interesting observations such as temporal variations, observer dependence, and content dependence are reported.

AB - This paper presents a study investigating the viewing behavior of human subjects for multimedia contents containing both the audio and video channels when the contents are corrupted by video transmission errors. It considers the human perceptual mechanism in realistic multimedia delivery applications over networks. We design an eye-tracking experiment using several high definition audio-visual contents having a wide range of content characteristics. The results are analyzed in terms of the amount of attention that each region among the sound source region, the region corrupted by packet loss artifacts, and the rest receives under two different audio conditions, i.e., with or without the audio channel. The results show that the effect of the audio channel on the gaze pattern toward packet loss artifacts varies with the contents. In addition, interesting observations such as temporal variations, observer dependence, and content dependence are reported.

UR - http://www.scopus.com/inward/record.url?scp=84888253585&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84888253585&partnerID=8YFLogxK

U2 - 10.1109/ICMEW.2013.6618423

DO - 10.1109/ICMEW.2013.6618423

M3 - Conference contribution

SN - 9781479916047

BT - Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013

ER -

Cheon M, Lee J-S. Gaze pattern analysis for audio-visual contents under the presence of video transmission errors. In Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013. 2013. 6618423 https://doi.org/10.1109/ICMEW.2013.6618423