Efficient video coding in H.264/AVC by using audio-visual information

Jong-Seok Lee, Touradj Ebrahimi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

This paper proposes an efficient video coding method which utilizes audio-visual information, based on the observation that sound-emitting regions in a video sequence attract observer's attention. The regions responsible for the sound are identified by an audio-visual source localization algorithm. Then, the result is used for encoding different regions in the scene with different quality in such a way that a region far from the sound source is coded with a lesser quality than the sound-emitting regions. This is implemented by assigning different quantization parameter values for different regions in H.264/AVC. Experimental results demonstrate the effectiveness of the proposed approach.

Original languageEnglish
Title of host publication2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09
DOIs
Publication statusPublished - 2009 Dec 1
Event2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09 - Rio De Janeiro, Brazil
Duration: 2009 Oct 52009 Oct 7

Publication series

Name2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09

Other

Other2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09
CountryBrazil
CityRio De Janeiro
Period09/10/509/10/7

Fingerprint

Image coding
Acoustic waves

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Signal Processing

Cite this

Lee, J-S., & Ebrahimi, T. (2009). Efficient video coding in H.264/AVC by using audio-visual information. In 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09 [5293288] (2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09). https://doi.org/10.1109/MMSP.2009.5293288
Lee, Jong-Seok ; Ebrahimi, Touradj. / Efficient video coding in H.264/AVC by using audio-visual information. 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09. 2009. (2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09).
@inproceedings{e410357bfd7a4605a7d944e234aeedd2,
title = "Efficient video coding in H.264/AVC by using audio-visual information",
abstract = "This paper proposes an efficient video coding method which utilizes audio-visual information, based on the observation that sound-emitting regions in a video sequence attract observer's attention. The regions responsible for the sound are identified by an audio-visual source localization algorithm. Then, the result is used for encoding different regions in the scene with different quality in such a way that a region far from the sound source is coded with a lesser quality than the sound-emitting regions. This is implemented by assigning different quantization parameter values for different regions in H.264/AVC. Experimental results demonstrate the effectiveness of the proposed approach.",
author = "Jong-Seok Lee and Touradj Ebrahimi",
year = "2009",
month = "12",
day = "1",
doi = "10.1109/MMSP.2009.5293288",
language = "English",
isbn = "9781424444649",
series = "2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09",
booktitle = "2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09",

}

Lee, J-S & Ebrahimi, T 2009, Efficient video coding in H.264/AVC by using audio-visual information. in 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09., 5293288, 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09, 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09, Rio De Janeiro, Brazil, 09/10/5. https://doi.org/10.1109/MMSP.2009.5293288

Efficient video coding in H.264/AVC by using audio-visual information. / Lee, Jong-Seok; Ebrahimi, Touradj.

2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09. 2009. 5293288 (2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Efficient video coding in H.264/AVC by using audio-visual information

AU - Lee, Jong-Seok

AU - Ebrahimi, Touradj

PY - 2009/12/1

Y1 - 2009/12/1

N2 - This paper proposes an efficient video coding method which utilizes audio-visual information, based on the observation that sound-emitting regions in a video sequence attract observer's attention. The regions responsible for the sound are identified by an audio-visual source localization algorithm. Then, the result is used for encoding different regions in the scene with different quality in such a way that a region far from the sound source is coded with a lesser quality than the sound-emitting regions. This is implemented by assigning different quantization parameter values for different regions in H.264/AVC. Experimental results demonstrate the effectiveness of the proposed approach.

AB - This paper proposes an efficient video coding method which utilizes audio-visual information, based on the observation that sound-emitting regions in a video sequence attract observer's attention. The regions responsible for the sound are identified by an audio-visual source localization algorithm. Then, the result is used for encoding different regions in the scene with different quality in such a way that a region far from the sound source is coded with a lesser quality than the sound-emitting regions. This is implemented by assigning different quantization parameter values for different regions in H.264/AVC. Experimental results demonstrate the effectiveness of the proposed approach.

UR - http://www.scopus.com/inward/record.url?scp=74349099570&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=74349099570&partnerID=8YFLogxK

U2 - 10.1109/MMSP.2009.5293288

DO - 10.1109/MMSP.2009.5293288

M3 - Conference contribution

SN - 9781424444649

T3 - 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09

BT - 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09

ER -

Lee J-S, Ebrahimi T. Efficient video coding in H.264/AVC by using audio-visual information. In 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09. 2009. 5293288. (2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09). https://doi.org/10.1109/MMSP.2009.5293288