Query-by-gesture: An alternative content-based image retrieval query scheme

Byoung Chul Ko, Hyeran Byun

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Current research on content-based image retrieval (CBIR)is centered on designing efficient query schemes in order to provide a user with effective mechanisms for image databse search. Among representative CBIR query schemes, query-by-sketch has been one of the attractive query tools that are highly adaptive to user's subjectivity. However, query-by-sketch has a few limitations. That is, most sketch tools demand expertise in image processing or computer vision of the user to provide good enough sketches that can be used as query. Furthermore, sketching the exact shape of an object using amouse can be a burden on the user. To overcome some of the limitations associated with query-by-sketch, we propose a new query method for CIBR, query-by-gesture, that does not require sketches, thereby minimizing user interaction. In our system, the user does not need to use a mouse to make a sketch. Instead, the user draws the shape of the object that he/she intends to search in front of a camera by hand. In addition, our query-by-gesture technique uses relevance feedback to interactively improve retrieval performance and allow progressive refinement of query results according to the user's specification. The efficacy of our proposed method is validated using images from the Corel-Photo CD.

Original languageEnglish
Pages (from-to)375-390
Number of pages16
JournalJournal of Visual Languages and Computing
Volume13
Issue number4
DOIs
Publication statusPublished - 2002 Jan 1

Fingerprint

Image retrieval
Computer vision
Image processing
Cameras
Specifications
Feedback
Content-based Image Retrieval
Gesture

All Science Journal Classification (ASJC) codes

  • Language and Linguistics
  • Human-Computer Interaction
  • Computer Science Applications

Cite this

@article{9f2b361881594ff3948b95e2acfc55d4,
title = "Query-by-gesture: An alternative content-based image retrieval query scheme",
abstract = "Current research on content-based image retrieval (CBIR)is centered on designing efficient query schemes in order to provide a user with effective mechanisms for image databse search. Among representative CBIR query schemes, query-by-sketch has been one of the attractive query tools that are highly adaptive to user's subjectivity. However, query-by-sketch has a few limitations. That is, most sketch tools demand expertise in image processing or computer vision of the user to provide good enough sketches that can be used as query. Furthermore, sketching the exact shape of an object using amouse can be a burden on the user. To overcome some of the limitations associated with query-by-sketch, we propose a new query method for CIBR, query-by-gesture, that does not require sketches, thereby minimizing user interaction. In our system, the user does not need to use a mouse to make a sketch. Instead, the user draws the shape of the object that he/she intends to search in front of a camera by hand. In addition, our query-by-gesture technique uses relevance feedback to interactively improve retrieval performance and allow progressive refinement of query results according to the user's specification. The efficacy of our proposed method is validated using images from the Corel-Photo CD.",
author = "Ko, {Byoung Chul} and Hyeran Byun",
year = "2002",
month = "1",
day = "1",
doi = "10.1006/jvlc.2002.0220",
language = "English",
volume = "13",
pages = "375--390",
journal = "Journal of Visual Languages and Computing",
issn = "1045-926X",
publisher = "Academic Press Inc.",
number = "4",

}

Query-by-gesture : An alternative content-based image retrieval query scheme. / Ko, Byoung Chul; Byun, Hyeran.

In: Journal of Visual Languages and Computing, Vol. 13, No. 4, 01.01.2002, p. 375-390.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Query-by-gesture

T2 - An alternative content-based image retrieval query scheme

AU - Ko, Byoung Chul

AU - Byun, Hyeran

PY - 2002/1/1

Y1 - 2002/1/1

N2 - Current research on content-based image retrieval (CBIR)is centered on designing efficient query schemes in order to provide a user with effective mechanisms for image databse search. Among representative CBIR query schemes, query-by-sketch has been one of the attractive query tools that are highly adaptive to user's subjectivity. However, query-by-sketch has a few limitations. That is, most sketch tools demand expertise in image processing or computer vision of the user to provide good enough sketches that can be used as query. Furthermore, sketching the exact shape of an object using amouse can be a burden on the user. To overcome some of the limitations associated with query-by-sketch, we propose a new query method for CIBR, query-by-gesture, that does not require sketches, thereby minimizing user interaction. In our system, the user does not need to use a mouse to make a sketch. Instead, the user draws the shape of the object that he/she intends to search in front of a camera by hand. In addition, our query-by-gesture technique uses relevance feedback to interactively improve retrieval performance and allow progressive refinement of query results according to the user's specification. The efficacy of our proposed method is validated using images from the Corel-Photo CD.

AB - Current research on content-based image retrieval (CBIR)is centered on designing efficient query schemes in order to provide a user with effective mechanisms for image databse search. Among representative CBIR query schemes, query-by-sketch has been one of the attractive query tools that are highly adaptive to user's subjectivity. However, query-by-sketch has a few limitations. That is, most sketch tools demand expertise in image processing or computer vision of the user to provide good enough sketches that can be used as query. Furthermore, sketching the exact shape of an object using amouse can be a burden on the user. To overcome some of the limitations associated with query-by-sketch, we propose a new query method for CIBR, query-by-gesture, that does not require sketches, thereby minimizing user interaction. In our system, the user does not need to use a mouse to make a sketch. Instead, the user draws the shape of the object that he/she intends to search in front of a camera by hand. In addition, our query-by-gesture technique uses relevance feedback to interactively improve retrieval performance and allow progressive refinement of query results according to the user's specification. The efficacy of our proposed method is validated using images from the Corel-Photo CD.

UR - http://www.scopus.com/inward/record.url?scp=0036700234&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036700234&partnerID=8YFLogxK

U2 - 10.1006/jvlc.2002.0220

DO - 10.1006/jvlc.2002.0220

M3 - Article

AN - SCOPUS:0036700234

VL - 13

SP - 375

EP - 390

JO - Journal of Visual Languages and Computing

JF - Journal of Visual Languages and Computing

SN - 1045-926X

IS - 4

ER -