Using novel word context measures to predict human ratings of lexical proficiency

Cynthia M. Berger, Scott A. Crossley, Kristopher Kyle

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

This study introduces a model of lexical proficiency based on novel computational indices related to word context. The indices come from an updated version of the Tool for the Automatic Analysis of Lexical Sophistication (TAALES) and include associative, lexical, and semantic measures of word context. Human ratings of holistic lexical proficiency were obtained for a spoken corpus of 240 transcribed texts produced by second language (L2) adult English learners and native English speakers (NESs). Correlations between lexical proficiency scores from trained human raters and contextual indices were examined and a regression analysis was conducted to investigate the potential for contextual indices to predict proficiency scores. Four indices accounted for approximately 42% of the variance in lexical proficiency scores in the transcribed speech samples. These indices were related to associative, lexical, and semantic operationalizations of word context. The findings demonstrate that computational measures of word context can predict human ratings of lexical proficiency and suggest that lexical, semantic, and associative context each play an important role in the development of lexical proficiency.

Original languageEnglish
Pages (from-to)201-212
Number of pages12
JournalEducational Technology and Society
Volume20
Issue number2
Publication statusPublished - 2017 Jan 1

Fingerprint

rating
Semantics
semantics
Regression analysis
operationalization
regression analysis
language

All Science Journal Classification (ASJC) codes

  • Education
  • Sociology and Political Science
  • Engineering(all)

Cite this

@article{5f9f77a6e0a04361ab21772d8bfa483a,
title = "Using novel word context measures to predict human ratings of lexical proficiency",
abstract = "This study introduces a model of lexical proficiency based on novel computational indices related to word context. The indices come from an updated version of the Tool for the Automatic Analysis of Lexical Sophistication (TAALES) and include associative, lexical, and semantic measures of word context. Human ratings of holistic lexical proficiency were obtained for a spoken corpus of 240 transcribed texts produced by second language (L2) adult English learners and native English speakers (NESs). Correlations between lexical proficiency scores from trained human raters and contextual indices were examined and a regression analysis was conducted to investigate the potential for contextual indices to predict proficiency scores. Four indices accounted for approximately 42{\%} of the variance in lexical proficiency scores in the transcribed speech samples. These indices were related to associative, lexical, and semantic operationalizations of word context. The findings demonstrate that computational measures of word context can predict human ratings of lexical proficiency and suggest that lexical, semantic, and associative context each play an important role in the development of lexical proficiency.",
author = "Berger, {Cynthia M.} and Crossley, {Scott A.} and Kristopher Kyle",
year = "2017",
month = "1",
day = "1",
language = "English",
volume = "20",
pages = "201--212",
journal = "Educational Technology and Society",
issn = "1176-3647",
publisher = "IEEE Computer Society",
number = "2",

}

Using novel word context measures to predict human ratings of lexical proficiency. / Berger, Cynthia M.; Crossley, Scott A.; Kyle, Kristopher.

In: Educational Technology and Society, Vol. 20, No. 2, 01.01.2017, p. 201-212.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Using novel word context measures to predict human ratings of lexical proficiency

AU - Berger, Cynthia M.

AU - Crossley, Scott A.

AU - Kyle, Kristopher

PY - 2017/1/1

Y1 - 2017/1/1

N2 - This study introduces a model of lexical proficiency based on novel computational indices related to word context. The indices come from an updated version of the Tool for the Automatic Analysis of Lexical Sophistication (TAALES) and include associative, lexical, and semantic measures of word context. Human ratings of holistic lexical proficiency were obtained for a spoken corpus of 240 transcribed texts produced by second language (L2) adult English learners and native English speakers (NESs). Correlations between lexical proficiency scores from trained human raters and contextual indices were examined and a regression analysis was conducted to investigate the potential for contextual indices to predict proficiency scores. Four indices accounted for approximately 42% of the variance in lexical proficiency scores in the transcribed speech samples. These indices were related to associative, lexical, and semantic operationalizations of word context. The findings demonstrate that computational measures of word context can predict human ratings of lexical proficiency and suggest that lexical, semantic, and associative context each play an important role in the development of lexical proficiency.

AB - This study introduces a model of lexical proficiency based on novel computational indices related to word context. The indices come from an updated version of the Tool for the Automatic Analysis of Lexical Sophistication (TAALES) and include associative, lexical, and semantic measures of word context. Human ratings of holistic lexical proficiency were obtained for a spoken corpus of 240 transcribed texts produced by second language (L2) adult English learners and native English speakers (NESs). Correlations between lexical proficiency scores from trained human raters and contextual indices were examined and a regression analysis was conducted to investigate the potential for contextual indices to predict proficiency scores. Four indices accounted for approximately 42% of the variance in lexical proficiency scores in the transcribed speech samples. These indices were related to associative, lexical, and semantic operationalizations of word context. The findings demonstrate that computational measures of word context can predict human ratings of lexical proficiency and suggest that lexical, semantic, and associative context each play an important role in the development of lexical proficiency.

UR - http://www.scopus.com/inward/record.url?scp=85018736103&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85018736103&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:85018736103

VL - 20

SP - 201

EP - 212

JO - Educational Technology and Society

JF - Educational Technology and Society

SN - 1176-3647

IS - 2

ER -