Skill ontology-based model for quality assurance in crowdsourcing

Kinda El Maarry, Wolf Tilo Balke, Hyunsouk Cho, Seung Won Hwang, Yukino Baba

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

Crowdsourcing continues to gain more momentum as its potential becomes more recognized. Nevertheless, the associated quality aspect remains a valid concern, which introduces uncertainty in the results obtained from the crowd. We identify the different aspects that dynamically affect the overall quality of a crowdsourcing task. Accordingly, we propose a skill ontology-based model that caters for these aspects, as a management technique to be adopted by crowdsourcing platforms. The model maintains a dynamically evolving ontology of skills, with libraries of standardized and personalized assessments for awarding workers skills. Aligning a worker's set of skills to that required by a task, boosts the ultimate resulting quality. We visualize the model's components and workflow, and consider how to guard it against malicious or unqualified workers, whose responses introduce this uncertainty and degrade the overall quality.

Original languageEnglish
Title of host publicationDatabase Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops
Subtitle of host publicationBDMA, DaMEN, SIM3, UnCrowd, Revised Selected Papers
PublisherSpringer Verlag
Pages376-387
Number of pages12
ISBN (Print)9783662439838
DOIs
Publication statusPublished - 2014
Event19th International Conference on Database Systems for Advanced Applications, DASFAA 2014 - Bali, Indonesia
Duration: 2014 Apr 212014 Apr 24

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8505 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other19th International Conference on Database Systems for Advanced Applications, DASFAA 2014
CountryIndonesia
CityBali
Period14/4/2114/4/24

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Skill ontology-based model for quality assurance in crowdsourcing'. Together they form a unique fingerprint.

  • Cite this

    Maarry, K. E., Balke, W. T., Cho, H., Hwang, S. W., & Baba, Y. (2014). Skill ontology-based model for quality assurance in crowdsourcing. In Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops: BDMA, DaMEN, SIM3, UnCrowd, Revised Selected Papers (pp. 376-387). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8505 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-662-43984-5_29