Online social networks for crowdsourced multimedia-involved behavioral testing: An empirical study

Jun Ho Choi, Jong Seok Lee

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Online social networks have emerged as effective crowdsourcing media to recruit participants in recent days. However, issues regarding how to effectively exploit them have not been adequately addressed yet. In this paper, we investigate the reliability and effectiveness of multimedia-involved behavioral testing via social network-based crowdsourcing, especially focused on Facebook as a medium to recruit participants. We conduct a crowdsourcing-based experiment for a music recommendation problem. It is shown that different advertisement methods yield different degrees of efficiency and there exist significant differences in behavioral patterns across different genders and different age groups. In addition, we perform a comparison of our experiment with other multimedia-involved crowdsourcing experiments built on Amazon Mechanical Turk (MTurk), which suggests that crowdsourcing-based experiments using social networks for recruitment can achieve comparable efficiency. Based on the analysis results, advantages and disadvantages of social network-based crowdsourcing and suggestions for successful experiments are also discussed. We conclude that social networks have the potential to support multimedia-involved behavioral tests to gather in-depth data even for long-term periods.

Original languageEnglish
Article number1991
JournalFrontiers in Psychology
Volume6
Issue numberJAN
DOIs
Publication statusPublished - 2016 Jan 1

Fingerprint

Crowdsourcing
Multimedia
Social Support
Music
Age Groups

All Science Journal Classification (ASJC) codes

  • Psychology(all)

Cite this

@article{79ea5e81d9714321955294d87caf3000,
title = "Online social networks for crowdsourced multimedia-involved behavioral testing: An empirical study",
abstract = "Online social networks have emerged as effective crowdsourcing media to recruit participants in recent days. However, issues regarding how to effectively exploit them have not been adequately addressed yet. In this paper, we investigate the reliability and effectiveness of multimedia-involved behavioral testing via social network-based crowdsourcing, especially focused on Facebook as a medium to recruit participants. We conduct a crowdsourcing-based experiment for a music recommendation problem. It is shown that different advertisement methods yield different degrees of efficiency and there exist significant differences in behavioral patterns across different genders and different age groups. In addition, we perform a comparison of our experiment with other multimedia-involved crowdsourcing experiments built on Amazon Mechanical Turk (MTurk), which suggests that crowdsourcing-based experiments using social networks for recruitment can achieve comparable efficiency. Based on the analysis results, advantages and disadvantages of social network-based crowdsourcing and suggestions for successful experiments are also discussed. We conclude that social networks have the potential to support multimedia-involved behavioral tests to gather in-depth data even for long-term periods.",
author = "Choi, {Jun Ho} and Lee, {Jong Seok}",
year = "2016",
month = "1",
day = "1",
doi = "10.3389/fpsyg.2015.01991",
language = "English",
volume = "6",
journal = "Frontiers in Psychology",
issn = "1664-1078",
publisher = "Frontiers Research Foundation",
number = "JAN",

}

Online social networks for crowdsourced multimedia-involved behavioral testing : An empirical study. / Choi, Jun Ho; Lee, Jong Seok.

In: Frontiers in Psychology, Vol. 6, No. JAN, 1991, 01.01.2016.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Online social networks for crowdsourced multimedia-involved behavioral testing

T2 - An empirical study

AU - Choi, Jun Ho

AU - Lee, Jong Seok

PY - 2016/1/1

Y1 - 2016/1/1

N2 - Online social networks have emerged as effective crowdsourcing media to recruit participants in recent days. However, issues regarding how to effectively exploit them have not been adequately addressed yet. In this paper, we investigate the reliability and effectiveness of multimedia-involved behavioral testing via social network-based crowdsourcing, especially focused on Facebook as a medium to recruit participants. We conduct a crowdsourcing-based experiment for a music recommendation problem. It is shown that different advertisement methods yield different degrees of efficiency and there exist significant differences in behavioral patterns across different genders and different age groups. In addition, we perform a comparison of our experiment with other multimedia-involved crowdsourcing experiments built on Amazon Mechanical Turk (MTurk), which suggests that crowdsourcing-based experiments using social networks for recruitment can achieve comparable efficiency. Based on the analysis results, advantages and disadvantages of social network-based crowdsourcing and suggestions for successful experiments are also discussed. We conclude that social networks have the potential to support multimedia-involved behavioral tests to gather in-depth data even for long-term periods.

AB - Online social networks have emerged as effective crowdsourcing media to recruit participants in recent days. However, issues regarding how to effectively exploit them have not been adequately addressed yet. In this paper, we investigate the reliability and effectiveness of multimedia-involved behavioral testing via social network-based crowdsourcing, especially focused on Facebook as a medium to recruit participants. We conduct a crowdsourcing-based experiment for a music recommendation problem. It is shown that different advertisement methods yield different degrees of efficiency and there exist significant differences in behavioral patterns across different genders and different age groups. In addition, we perform a comparison of our experiment with other multimedia-involved crowdsourcing experiments built on Amazon Mechanical Turk (MTurk), which suggests that crowdsourcing-based experiments using social networks for recruitment can achieve comparable efficiency. Based on the analysis results, advantages and disadvantages of social network-based crowdsourcing and suggestions for successful experiments are also discussed. We conclude that social networks have the potential to support multimedia-involved behavioral tests to gather in-depth data even for long-term periods.

UR - http://www.scopus.com/inward/record.url?scp=84958259728&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84958259728&partnerID=8YFLogxK

U2 - 10.3389/fpsyg.2015.01991

DO - 10.3389/fpsyg.2015.01991

M3 - Article

AN - SCOPUS:84958259728

VL - 6

JO - Frontiers in Psychology

JF - Frontiers in Psychology

SN - 1664-1078

IS - JAN

M1 - 1991

ER -