Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages

Yoonsung Hong, Haewoon Kwak, Youngmin Baek, Sue Moon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

With the growing amount of textual data produced by online social media today, the demands for sentiment analysis are also rapidly increasing; and, this is true for worldwide. However, non-English languages often lack sentiment lexicons, a core resource in performing sentiment analysis. Our solution, Tower of Babel (ToB), is a language-independent sentiment-lexicon-generating crowdsourcing game. We conducted an experiment with 135 participants to explore the difference between our solution and a conventional manual annotation method. We evaluated ToB in terms of effectiveness, efficiency, and satisfactions. Based on the result of the evaluation, we conclude that sentiment classification via ToB is accurate, productive and enjoyable.

Original languageEnglish
Title of host publicationWWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web
Pages549-556
Number of pages8
Publication statusPublished - 2013 Dec 1
Event22nd International Conference on World Wide Web, WWW 2013 - Rio de Janeiro, Brazil
Duration: 2013 May 132013 May 17

Publication series

NameWWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web

Other

Other22nd International Conference on World Wide Web, WWW 2013
CountryBrazil
CityRio de Janeiro
Period13/5/1313/5/17

Fingerprint

Towers
Experiments

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications

Cite this

Hong, Y., Kwak, H., Baek, Y., & Moon, S. (2013). Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages. In WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web (pp. 549-556). (WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web).
Hong, Yoonsung ; Kwak, Haewoon ; Baek, Youngmin ; Moon, Sue. / Tower of babel : A crowdsourcing game building sentiment lexicons for resource-scarce languages. WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web. 2013. pp. 549-556 (WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web).
@inproceedings{5d248ece5de4424d9c60613049316b42,
title = "Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages",
abstract = "With the growing amount of textual data produced by online social media today, the demands for sentiment analysis are also rapidly increasing; and, this is true for worldwide. However, non-English languages often lack sentiment lexicons, a core resource in performing sentiment analysis. Our solution, Tower of Babel (ToB), is a language-independent sentiment-lexicon-generating crowdsourcing game. We conducted an experiment with 135 participants to explore the difference between our solution and a conventional manual annotation method. We evaluated ToB in terms of effectiveness, efficiency, and satisfactions. Based on the result of the evaluation, we conclude that sentiment classification via ToB is accurate, productive and enjoyable.",
author = "Yoonsung Hong and Haewoon Kwak and Youngmin Baek and Sue Moon",
year = "2013",
month = "12",
day = "1",
language = "English",
isbn = "9781450320382",
series = "WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web",
pages = "549--556",
booktitle = "WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web",

}

Hong, Y, Kwak, H, Baek, Y & Moon, S 2013, Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages. in WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web. WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web, pp. 549-556, 22nd International Conference on World Wide Web, WWW 2013, Rio de Janeiro, Brazil, 13/5/13.

Tower of babel : A crowdsourcing game building sentiment lexicons for resource-scarce languages. / Hong, Yoonsung; Kwak, Haewoon; Baek, Youngmin; Moon, Sue.

WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web. 2013. p. 549-556 (WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Tower of babel

T2 - A crowdsourcing game building sentiment lexicons for resource-scarce languages

AU - Hong, Yoonsung

AU - Kwak, Haewoon

AU - Baek, Youngmin

AU - Moon, Sue

PY - 2013/12/1

Y1 - 2013/12/1

N2 - With the growing amount of textual data produced by online social media today, the demands for sentiment analysis are also rapidly increasing; and, this is true for worldwide. However, non-English languages often lack sentiment lexicons, a core resource in performing sentiment analysis. Our solution, Tower of Babel (ToB), is a language-independent sentiment-lexicon-generating crowdsourcing game. We conducted an experiment with 135 participants to explore the difference between our solution and a conventional manual annotation method. We evaluated ToB in terms of effectiveness, efficiency, and satisfactions. Based on the result of the evaluation, we conclude that sentiment classification via ToB is accurate, productive and enjoyable.

AB - With the growing amount of textual data produced by online social media today, the demands for sentiment analysis are also rapidly increasing; and, this is true for worldwide. However, non-English languages often lack sentiment lexicons, a core resource in performing sentiment analysis. Our solution, Tower of Babel (ToB), is a language-independent sentiment-lexicon-generating crowdsourcing game. We conducted an experiment with 135 participants to explore the difference between our solution and a conventional manual annotation method. We evaluated ToB in terms of effectiveness, efficiency, and satisfactions. Based on the result of the evaluation, we conclude that sentiment classification via ToB is accurate, productive and enjoyable.

UR - http://www.scopus.com/inward/record.url?scp=84893081154&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893081154&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84893081154

SN - 9781450320382

T3 - WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web

SP - 549

EP - 556

BT - WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web

ER -

Hong Y, Kwak H, Baek Y, Moon S. Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages. In WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web. 2013. p. 549-556. (WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web).