Automating Content Analysis of Open-Ended Responses: Wordscores and Affective Intonation

Young Min Baek, Joseph N. Cappella, Alyssa Bindman

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

This study presents automated methods for predicting valence and quantifying valenced thoughts of a text. First, it examines whether Wordscores, developed by Laver, Benoit, and Garry (2003), can be adapted to reliably predict the valence of open-ended responses in a survey about bioethical issues in genetics research, and then tests a complementary and novel technique for coding the number of valenced thoughts in open-ended responses, termed Affective Intonation. Results show that Wordscores successfully predicts the valence of brief and grammatically imperfect open-ended responses, and Affective Intonation achieves comparable performance to human coders when estimating number of valenced thoughts. Both Wordscores and Affective Intonation have promise as reliable, effective, and efficient methods when researchers content-analyze large amounts of textual data systematically.

Original languageEnglish
Pages (from-to)275-296
Number of pages22
JournalCommunication Methods and Measures
Volume5
Issue number4
DOIs
Publication statusPublished - 2011 Oct 1

Fingerprint

content analysis
genetic research
coding
performance
Genetics

All Science Journal Classification (ASJC) codes

  • Communication

Cite this

@article{64358318aefe4e63998df12d21aef06a,
title = "Automating Content Analysis of Open-Ended Responses: Wordscores and Affective Intonation",
abstract = "This study presents automated methods for predicting valence and quantifying valenced thoughts of a text. First, it examines whether Wordscores, developed by Laver, Benoit, and Garry (2003), can be adapted to reliably predict the valence of open-ended responses in a survey about bioethical issues in genetics research, and then tests a complementary and novel technique for coding the number of valenced thoughts in open-ended responses, termed Affective Intonation. Results show that Wordscores successfully predicts the valence of brief and grammatically imperfect open-ended responses, and Affective Intonation achieves comparable performance to human coders when estimating number of valenced thoughts. Both Wordscores and Affective Intonation have promise as reliable, effective, and efficient methods when researchers content-analyze large amounts of textual data systematically.",
author = "Baek, {Young Min} and Cappella, {Joseph N.} and Alyssa Bindman",
year = "2011",
month = "10",
day = "1",
doi = "10.1080/19312458.2011.624489",
language = "English",
volume = "5",
pages = "275--296",
journal = "Communication Methods and Measures",
issn = "1931-2458",
publisher = "Routledge",
number = "4",

}

Automating Content Analysis of Open-Ended Responses : Wordscores and Affective Intonation. / Baek, Young Min; Cappella, Joseph N.; Bindman, Alyssa.

In: Communication Methods and Measures, Vol. 5, No. 4, 01.10.2011, p. 275-296.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Automating Content Analysis of Open-Ended Responses

T2 - Wordscores and Affective Intonation

AU - Baek, Young Min

AU - Cappella, Joseph N.

AU - Bindman, Alyssa

PY - 2011/10/1

Y1 - 2011/10/1

N2 - This study presents automated methods for predicting valence and quantifying valenced thoughts of a text. First, it examines whether Wordscores, developed by Laver, Benoit, and Garry (2003), can be adapted to reliably predict the valence of open-ended responses in a survey about bioethical issues in genetics research, and then tests a complementary and novel technique for coding the number of valenced thoughts in open-ended responses, termed Affective Intonation. Results show that Wordscores successfully predicts the valence of brief and grammatically imperfect open-ended responses, and Affective Intonation achieves comparable performance to human coders when estimating number of valenced thoughts. Both Wordscores and Affective Intonation have promise as reliable, effective, and efficient methods when researchers content-analyze large amounts of textual data systematically.

AB - This study presents automated methods for predicting valence and quantifying valenced thoughts of a text. First, it examines whether Wordscores, developed by Laver, Benoit, and Garry (2003), can be adapted to reliably predict the valence of open-ended responses in a survey about bioethical issues in genetics research, and then tests a complementary and novel technique for coding the number of valenced thoughts in open-ended responses, termed Affective Intonation. Results show that Wordscores successfully predicts the valence of brief and grammatically imperfect open-ended responses, and Affective Intonation achieves comparable performance to human coders when estimating number of valenced thoughts. Both Wordscores and Affective Intonation have promise as reliable, effective, and efficient methods when researchers content-analyze large amounts of textual data systematically.

UR - http://www.scopus.com/inward/record.url?scp=84859392536&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84859392536&partnerID=8YFLogxK

U2 - 10.1080/19312458.2011.624489

DO - 10.1080/19312458.2011.624489

M3 - Article

AN - SCOPUS:84859392536

VL - 5

SP - 275

EP - 296

JO - Communication Methods and Measures

JF - Communication Methods and Measures

SN - 1931-2458

IS - 4

ER -