Accuracy of the Language Environment Analysis System Segmentation and Metrics: A Systematic Review

Autor/inn/en	Cristia, Alejandrina; Bulgarelli, Federica; Bergelson, Elika
Titel	Accuracy of the Language Environment Analysis System Segmentation and Metrics: A Systematic Review
Quelle	In: Journal of Speech, Language, and Hearing Research, 63 (2020) 4, S.1093-1105 (13 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1092-4388
Schlagwörter	Intervention; Measures (Individuals); Language Acquisition; Accuracy; Discourse Analysis; Speech Evaluation; Databases; Comparative Analysis; Specialists; Recall (Psychology); Correlation; Error Patterns; Citations (References); Meta Analysis; Language Impairments + Suchen Sie Ihr Suchwort? Messdaten; Sprachaneignung; Spracherwerb; Diskursanalyse; Datenbank; Abberufung; Korrelation; Fehlertyp; Citations; Zitat; Meta-analysis; Metaanalyse; Speech disorder; Speech disorders; Speech disabilities; Speech disability; Speech handicap; Speech handicaps; Speech impairment; Speech impairments; Language handicaps; Sprachbehinderung
Abstract	Purpose: The Language Environment Analysis (LENA) system provides automated measures facilitating clinical and nonclinical research and interventions on language development, but there are only a few, scattered independent reports of these measures' validity. The objectives of the current systematic review were to (a) discover studies comparing LENA output with manual annotation, namely, accuracy of talker labels, as well as involving adult word counts (AWCs), conversational turn counts (CTCs), and child vocalization counts (CVCs); (b) describe them qualitatively; (c) quantitatively integrate them to assess central tendencies; and (d) quantitatively integrate them to assess potential moderators. Method: Searches on Google Scholar, PubMed, Scopus, and PsycInfo were combined with expert knowledge, and interarticle citations resulting in 238 records screened and 73 records whose full text was inspected. To be included, studies must target children under the age of 18 years and report on accuracy of LENA labels (e.g., precision and/or recall) and/or AWC, CTC, or CVC (correlations and/or error metrics). Results: A total of 33 studies, in 28 articles, were discovered. A qualitative review revealed most validation studies had not been peer reviewed as such and failed to report key methodology and results. Quantitative integration of the results was possible for a broad definition of recall and precision (M = 59% and 68%, respectively; N = 12-13), for AWC (mean r = 0.79, N = 13), CVC (mean r = 0.77, N = 5), and CTC (mean r = 0.36, N = 6). Publication bias and moderators could not be assessed meta-analytically. Conclusion: Further research and improved reporting are needed in studies evaluating LENA segmentation and quantification accuracy, with work investigating CTC being particularly urgent. (As Provided).
Anmerkungen	American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01