3D object duplicate detection for video retrieval

Peter Vajda, Ivan Ivanov, Lutz Goldmann, Jong Seok Lee, Touradj Ebrahimi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Content-based video retrieval has become a very active research area in the last decade due to the increasing number of video content shared on social networks such as YouTube and DailyMotion. While most of the content-based video retrieval approaches employ low-level visual features for global analysis of the video, this paper proposes an object-based retrieval method as an alternative. The goal of the proposed method is to retrieve key frames and shots of a video that contain a particular object. The key idea is to apply an existing object duplicate detection method iteratively to the video sequence in order to compensate for 3D view variations, illumination changes and partial occlusions. Our approach combines viewpoint-invariant region descriptors to describe the appearance of an object using a graph model which considers the spatial layout of the individual regions. Given a query object provided by the user in the form of an image and a region of interest, the system retrieves shots containing this object by analyzing a set of key frames for each shot. The robustness of our approach is demonstrated using a video in which a 3D object is recorded from different view points and with partial occlusions.

Original languageEnglish
Title of host publication11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10
Publication statusPublished - 2010 Dec 15
Event11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10 - Desenzano del Garda, Italy
Duration: 2010 Apr 122010 Apr 14

Publication series

Name11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10

Other

Other11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10
CountryItaly
CityDesenzano del Garda
Period10/4/1210/4/14

Fingerprint

Lighting
Object detection

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Cite this

Vajda, P., Ivanov, I., Goldmann, L., Lee, J. S., & Ebrahimi, T. (2010). 3D object duplicate detection for video retrieval. In 11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10 [5617669] (11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10).
Vajda, Peter ; Ivanov, Ivan ; Goldmann, Lutz ; Lee, Jong Seok ; Ebrahimi, Touradj. / 3D object duplicate detection for video retrieval. 11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10. 2010. (11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10).
@inproceedings{3b709cc87ded4289a42669ca993aa341,
title = "3D object duplicate detection for video retrieval",
abstract = "Content-based video retrieval has become a very active research area in the last decade due to the increasing number of video content shared on social networks such as YouTube and DailyMotion. While most of the content-based video retrieval approaches employ low-level visual features for global analysis of the video, this paper proposes an object-based retrieval method as an alternative. The goal of the proposed method is to retrieve key frames and shots of a video that contain a particular object. The key idea is to apply an existing object duplicate detection method iteratively to the video sequence in order to compensate for 3D view variations, illumination changes and partial occlusions. Our approach combines viewpoint-invariant region descriptors to describe the appearance of an object using a graph model which considers the spatial layout of the individual regions. Given a query object provided by the user in the form of an image and a region of interest, the system retrieves shots containing this object by analyzing a set of key frames for each shot. The robustness of our approach is demonstrated using a video in which a 3D object is recorded from different view points and with partial occlusions.",
author = "Peter Vajda and Ivan Ivanov and Lutz Goldmann and Lee, {Jong Seok} and Touradj Ebrahimi",
year = "2010",
month = "12",
day = "15",
language = "English",
isbn = "9781424478484",
series = "11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10",
booktitle = "11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10",

}

Vajda, P, Ivanov, I, Goldmann, L, Lee, JS & Ebrahimi, T 2010, 3D object duplicate detection for video retrieval. in 11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10., 5617669, 11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10, 11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10, Desenzano del Garda, Italy, 10/4/12.

3D object duplicate detection for video retrieval. / Vajda, Peter; Ivanov, Ivan; Goldmann, Lutz; Lee, Jong Seok; Ebrahimi, Touradj.

11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10. 2010. 5617669 (11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - 3D object duplicate detection for video retrieval

AU - Vajda, Peter

AU - Ivanov, Ivan

AU - Goldmann, Lutz

AU - Lee, Jong Seok

AU - Ebrahimi, Touradj

PY - 2010/12/15

Y1 - 2010/12/15

N2 - Content-based video retrieval has become a very active research area in the last decade due to the increasing number of video content shared on social networks such as YouTube and DailyMotion. While most of the content-based video retrieval approaches employ low-level visual features for global analysis of the video, this paper proposes an object-based retrieval method as an alternative. The goal of the proposed method is to retrieve key frames and shots of a video that contain a particular object. The key idea is to apply an existing object duplicate detection method iteratively to the video sequence in order to compensate for 3D view variations, illumination changes and partial occlusions. Our approach combines viewpoint-invariant region descriptors to describe the appearance of an object using a graph model which considers the spatial layout of the individual regions. Given a query object provided by the user in the form of an image and a region of interest, the system retrieves shots containing this object by analyzing a set of key frames for each shot. The robustness of our approach is demonstrated using a video in which a 3D object is recorded from different view points and with partial occlusions.

AB - Content-based video retrieval has become a very active research area in the last decade due to the increasing number of video content shared on social networks such as YouTube and DailyMotion. While most of the content-based video retrieval approaches employ low-level visual features for global analysis of the video, this paper proposes an object-based retrieval method as an alternative. The goal of the proposed method is to retrieve key frames and shots of a video that contain a particular object. The key idea is to apply an existing object duplicate detection method iteratively to the video sequence in order to compensate for 3D view variations, illumination changes and partial occlusions. Our approach combines viewpoint-invariant region descriptors to describe the appearance of an object using a graph model which considers the spatial layout of the individual regions. Given a query object provided by the user in the form of an image and a region of interest, the system retrieves shots containing this object by analyzing a set of key frames for each shot. The robustness of our approach is demonstrated using a video in which a 3D object is recorded from different view points and with partial occlusions.

UR - http://www.scopus.com/inward/record.url?scp=78649956867&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78649956867&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:78649956867

SN - 9781424478484

T3 - 11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10

BT - 11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10

ER -

Vajda P, Ivanov I, Goldmann L, Lee JS, Ebrahimi T. 3D object duplicate detection for video retrieval. In 11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10. 2010. 5617669. (11th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 10).