Predicting Communicative Effectiveness in the International Workplace: Support for "TOEIC"® Speaking Test Scores from Linguistic Laypersons

Autor/inn/en	Schmidgall, Jonathan; Powers, Donald E.
Titel	Predicting Communicative Effectiveness in the International Workplace: Support for "TOEIC"® Speaking Test Scores from Linguistic Laypersons
Quelle	In: Language Testing, 38 (2021) 2, S.302-325 (24 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Schmidgall, Jonathan)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0265-5322
DOI	10.1177/0265532220941803
Schlagwörter	Language Tests; English (Second Language); Second Language Learning; Scores; Lay People; Work Environment; Speech Communication; Professional Personnel; Language Usage; Oral Reading; Interpersonal Communication; Role Playing; Rating Scales; Communicative Competence (Languages); Correlation; Language Proficiency; Decision Making; Intercultural Communication; Foreign Countries; Online Surveys; Asia; Europe; Middle East; South America; Test of English for International Communication + Suchen Sie Ihr Suchwort? Language test; Sprachtest; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Laie; Arbeitsmilieu; Personalbestand; Sprachgebrauch; Oral work; Reading; Mündliche Übung; Leseprozess; Lesen; Interpersonale Kommunikation; Rollenspiel; Rating-Skala; Communicative competence; Languages; Kommunikative Kompetenz; Sprache; Korrelation; Language skill; Language skills; Sprachkompetenz; Decision-making; Entscheidungsfindung; Interkulturelle Kommunikation; Ausland; Asien; Europa; Vorderasien; Südamerika
Abstract	In this study we examined the extent to which "TOEIC"® Speaking test scores relate to evaluations by professionals in the international workplace, the target language use domain of TOEIC tests. Linguistic laypersons in 10 countries were invited to participate in an online research survey. The survey incorporated a stratified sample of test-taker (N = 99) responses to three representative tasks from the TOEIC Speaking test (reading a text aloud, responding to questions, expressing an opinion) that were cast as workplace role-play tasks. After completing each role-play task, participants used brief, descriptive six-point rating scales to rate the communicative effectiveness (comprehensibility, task fulfillment, elaboration, and coherence) of each of several speakers. Communicative effectiveness ratings from linguistic laypersons were strongly correlated with TOEIC Speaking test scaled scores (r = 0.84). In addition, regression analysis was used to plot the relationship between layperson and test-based evaluations of speaking proficiency. Results suggested that test takers' performances can be expected to be perceived as effective at score ranges typically associated with important decisions. The results are discussed in terms of their implications for claims about the generalizability of TOEIC Speaking test score interpretations in relation to the evaluations of linguistic laypersons in the international workplace. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01