Rater variation in the assessment of speech acts

Research output: Contribution to journalArticlepeer-review

18 Scopus citations

Abstract

This study addresses variability among native speaker raters who evaluated pragmatic performance of learners of English as a foreign language. Using a five-point rating scale, four native English speakers of mixed cultural background (one African American, one Asian American, and two Australians) assessed the appropriateness of two types of speech acts (requests and opinions) produced by 48 Japanese EFL students. To explore norms and the reasoning behind the raters' assessment practice, individual introspective verbal interviews were conducted. Eight students' speech act productions (64 speech acts in total) were selected randomly, and the raters were asked to rate each speech act and then explain their rating decision. Interview data revealed similarities and differences in their use of pragmatic norms and social rules in evaluating appropriateness.

Original languageEnglish (US)
Pages (from-to)453-471
Number of pages19
JournalPragmatics
Volume21
Issue number3
DOIs
StatePublished - Sep 2011
Externally publishedYes

Keywords

  • Assessment
  • Pragmatic competence
  • Rater variation
  • Speech acts

ASJC Scopus subject areas

  • Language and Linguistics
  • Philosophy
  • Linguistics and Language

Fingerprint

Dive into the research topics of 'Rater variation in the assessment of speech acts'. Together they form a unique fingerprint.

Cite this