An interactive 3-D audio system with loudspeakers

Myung Suk Song, Cha Zhang, D. Florencio, Hong Goo Kang

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

Traditional 3-D audio systems using two loudspeakers often have a limited sweet spot and may suffer from poor performance in reverberant environments. This paper presents a novel binaural 3-D audio system that actively combines head tracking and room modeling into 3-D audio synthesis. The user's head position and orientation are first tracked by a webcam-based 3-D head tracker. The system then improves its robustness to head movement and strong early reflections by incorporating the tracking information and an explicit room model into the binaural synthesis and crosstalk cancellation process. Sensitivity analysis on the room model shows that the method is reasonably robust to modeling errors. Subjective listening tests confirm that the proposed 3-D audio system significantly improves the users' perception and ability for localization.

Original languageEnglish
Article number5959214
Pages (from-to)844-855
Number of pages12
JournalIEEE Transactions on Multimedia
Volume13
Issue number5
DOIs
Publication statusPublished - 2011 Oct 1

Fingerprint

Audio systems
Loudspeakers
Crosstalk
Sensitivity analysis

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Song, Myung Suk ; Zhang, Cha ; Florencio, D. ; Kang, Hong Goo. / An interactive 3-D audio system with loudspeakers. In: IEEE Transactions on Multimedia. 2011 ; Vol. 13, No. 5. pp. 844-855.
@article{a7bbea89fae64b1e97cd56d71d1b3f40,
title = "An interactive 3-D audio system with loudspeakers",
abstract = "Traditional 3-D audio systems using two loudspeakers often have a limited sweet spot and may suffer from poor performance in reverberant environments. This paper presents a novel binaural 3-D audio system that actively combines head tracking and room modeling into 3-D audio synthesis. The user's head position and orientation are first tracked by a webcam-based 3-D head tracker. The system then improves its robustness to head movement and strong early reflections by incorporating the tracking information and an explicit room model into the binaural synthesis and crosstalk cancellation process. Sensitivity analysis on the room model shows that the method is reasonably robust to modeling errors. Subjective listening tests confirm that the proposed 3-D audio system significantly improves the users' perception and ability for localization.",
author = "Song, {Myung Suk} and Cha Zhang and D. Florencio and Kang, {Hong Goo}",
year = "2011",
month = "10",
day = "1",
doi = "10.1109/TMM.2011.2162581",
language = "English",
volume = "13",
pages = "844--855",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "5",

}

An interactive 3-D audio system with loudspeakers. / Song, Myung Suk; Zhang, Cha; Florencio, D.; Kang, Hong Goo.

In: IEEE Transactions on Multimedia, Vol. 13, No. 5, 5959214, 01.10.2011, p. 844-855.

Research output: Contribution to journalArticle

TY - JOUR

T1 - An interactive 3-D audio system with loudspeakers

AU - Song, Myung Suk

AU - Zhang, Cha

AU - Florencio, D.

AU - Kang, Hong Goo

PY - 2011/10/1

Y1 - 2011/10/1

N2 - Traditional 3-D audio systems using two loudspeakers often have a limited sweet spot and may suffer from poor performance in reverberant environments. This paper presents a novel binaural 3-D audio system that actively combines head tracking and room modeling into 3-D audio synthesis. The user's head position and orientation are first tracked by a webcam-based 3-D head tracker. The system then improves its robustness to head movement and strong early reflections by incorporating the tracking information and an explicit room model into the binaural synthesis and crosstalk cancellation process. Sensitivity analysis on the room model shows that the method is reasonably robust to modeling errors. Subjective listening tests confirm that the proposed 3-D audio system significantly improves the users' perception and ability for localization.

AB - Traditional 3-D audio systems using two loudspeakers often have a limited sweet spot and may suffer from poor performance in reverberant environments. This paper presents a novel binaural 3-D audio system that actively combines head tracking and room modeling into 3-D audio synthesis. The user's head position and orientation are first tracked by a webcam-based 3-D head tracker. The system then improves its robustness to head movement and strong early reflections by incorporating the tracking information and an explicit room model into the binaural synthesis and crosstalk cancellation process. Sensitivity analysis on the room model shows that the method is reasonably robust to modeling errors. Subjective listening tests confirm that the proposed 3-D audio system significantly improves the users' perception and ability for localization.

UR - http://www.scopus.com/inward/record.url?scp=80052931795&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052931795&partnerID=8YFLogxK

U2 - 10.1109/TMM.2011.2162581

DO - 10.1109/TMM.2011.2162581

M3 - Article

AN - SCOPUS:80052931795

VL - 13

SP - 844

EP - 855

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 5

M1 - 5959214

ER -