Video coding based on audio-visual attention

Jong Seok Lee, Francesca De Simone, Touradj Ebrahimi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

This paper proposes an efficient video coding method based on audio-visual attention, which is motivated by the fact that cross-modal interaction significantly affects humans' perception of multimedia content. First, we propose an audio-visual source localization method to locate the sound source in a video sequence. Then, its result is used for applying spatial blurring to video frames in order to reduce redundant high-frequency information and achieve coding efficiency. We demonstrate the effectiveness of the proposed method for H.264/AVC coding along with the results of a subjective evaluation.

Original languageEnglish
Title of host publicationProceedings - 2009 IEEE International Conference on Multimedia and Expo, ICME 2009
Pages57-60
Number of pages4
DOIs
Publication statusPublished - 2009 Nov 20
Event2009 IEEE International Conference on Multimedia and Expo, ICME 2009 - New York, NY, United States
Duration: 2009 Jun 282009 Jul 3

Publication series

NameProceedings - 2009 IEEE International Conference on Multimedia and Expo, ICME 2009

Other

Other2009 IEEE International Conference on Multimedia and Expo, ICME 2009
CountryUnited States
CityNew York, NY
Period09/6/2809/7/3

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Networks and Communications
  • Hardware and Architecture
  • Software

Fingerprint Dive into the research topics of 'Video coding based on audio-visual attention'. Together they form a unique fingerprint.

  • Cite this

    Lee, J. S., De Simone, F., & Ebrahimi, T. (2009). Video coding based on audio-visual attention. In Proceedings - 2009 IEEE International Conference on Multimedia and Expo, ICME 2009 (pp. 57-60). [5202435] (Proceedings - 2009 IEEE International Conference on Multimedia and Expo, ICME 2009). https://doi.org/10.1109/ICME.2009.5202435