Interpreting Kappa in Observational Research: Baserate Matters

Autor/inn/en	Bruckner, Cornelia Taylor; Yoder, Paul
Titel	Interpreting Kappa in Observational Research: Baserate Matters
Quelle	In: American Journal on Mental Retardation, 111 (2006) 6, S.433-441 (9 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0895-8017
DOI	10.1352/0895-8017(2006)111[433:IKIORB]2.0.CO;2
Schlagwörter	Computation; Observation; Guidelines; Evaluation Methods; Evaluation Criteria; Behavior Patterns + Suchen Sie Ihr Suchwort? Beobachtung; Richtlinien
Abstract	Kappa (Cohen, 1960) is a popular agreement statistic used to estimate the accuracy of observers. The response of kappa to differing baserates was examined and methods for estimating the accuracy of observers presented. Results suggest that setting a single value of kappa as "minimally acceptable" (i.e., a criterion value) is not useful in ensuring adequate accuracy of observers. Instead, researchers should use the best estimate of the true baserate of the target behavior "and" the obtained kappa to estimate the accuracy of observers. Investigators can then compare the estimated accuracy of observers to a preselected criterion level. Guidelines are given for selecting a criterion accuracy level. (Author).
Anmerkungen	American Association on Mental Retardation. P.O. Box 7065, Lawrence, KS 66044-7065. Tel: 785-843-1235; Fax: 785-843-1274; e-mail: AJMR@allenpress.com; Web site: http://www.aamr.org/Periodicals/index.shtml
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10