Automatic synchronization of background music and motion in computer animation

Hyun Chul Lee, In Kwon Lee

Research output: Contribution to journalArticle

26 Citations (Scopus)

Abstract

We synchronize background music with an animation by changing the timing of both, an approach which minimizes the damage to either. Starting from a file and motion data, feature points are extracted from both sources, paired, and then synchronized using dynamic programming to time-scale the music and to timewarp the motion. We also introduce the music graph, a directed graph which encapsulates connections between many short music sequences. By traversing a music graph we can generate large amounts of new background music, in which we expect to find a sequence which matches the motion better than the original music.

Original languageEnglish
Pages (from-to)353-361
Number of pages9
JournalComputer Graphics Forum
Volume24
Issue number3
DOIs
Publication statusPublished - 2005 Jan 1

Fingerprint

Computer music
Directed graphs
Animation
Dynamic programming
Synchronization

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design

Cite this

@article{d8f351a9dbb3458d9419c1b671155860,
title = "Automatic synchronization of background music and motion in computer animation",
abstract = "We synchronize background music with an animation by changing the timing of both, an approach which minimizes the damage to either. Starting from a file and motion data, feature points are extracted from both sources, paired, and then synchronized using dynamic programming to time-scale the music and to timewarp the motion. We also introduce the music graph, a directed graph which encapsulates connections between many short music sequences. By traversing a music graph we can generate large amounts of new background music, in which we expect to find a sequence which matches the motion better than the original music.",
author = "Lee, {Hyun Chul} and Lee, {In Kwon}",
year = "2005",
month = "1",
day = "1",
doi = "10.1111/j.1467-8659.2005.00860.x",
language = "English",
volume = "24",
pages = "353--361",
journal = "Computer Graphics Forum",
issn = "0167-7055",
publisher = "Wiley-Blackwell",
number = "3",

}

Automatic synchronization of background music and motion in computer animation. / Lee, Hyun Chul; Lee, In Kwon.

In: Computer Graphics Forum, Vol. 24, No. 3, 01.01.2005, p. 353-361.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Automatic synchronization of background music and motion in computer animation

AU - Lee, Hyun Chul

AU - Lee, In Kwon

PY - 2005/1/1

Y1 - 2005/1/1

N2 - We synchronize background music with an animation by changing the timing of both, an approach which minimizes the damage to either. Starting from a file and motion data, feature points are extracted from both sources, paired, and then synchronized using dynamic programming to time-scale the music and to timewarp the motion. We also introduce the music graph, a directed graph which encapsulates connections between many short music sequences. By traversing a music graph we can generate large amounts of new background music, in which we expect to find a sequence which matches the motion better than the original music.

AB - We synchronize background music with an animation by changing the timing of both, an approach which minimizes the damage to either. Starting from a file and motion data, feature points are extracted from both sources, paired, and then synchronized using dynamic programming to time-scale the music and to timewarp the motion. We also introduce the music graph, a directed graph which encapsulates connections between many short music sequences. By traversing a music graph we can generate large amounts of new background music, in which we expect to find a sequence which matches the motion better than the original music.

UR - http://www.scopus.com/inward/record.url?scp=33745297938&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745297938&partnerID=8YFLogxK

U2 - 10.1111/j.1467-8659.2005.00860.x

DO - 10.1111/j.1467-8659.2005.00860.x

M3 - Article

VL - 24

SP - 353

EP - 361

JO - Computer Graphics Forum

JF - Computer Graphics Forum

SN - 0167-7055

IS - 3

ER -