An Application of Reliability Estimation in Longitudinal Designs through Modeling Item-Specific Error Variance

Autor/inn/en	Sideridis, Georgios D.; Tsaousis, Ioannis; Al-Sadaawi, Abdullah
Titel	An Application of Reliability Estimation in Longitudinal Designs through Modeling Item-Specific Error Variance
Quelle	In: Educational and Psychological Measurement, 79 (2019) 6, S.1038-1063 (26 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Sideridis, Georgios D.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/0013164419843162
Schlagwörter	Test Reliability; Test Items; Longitudinal Studies; Foreign Countries; Licensing Examinations (Professions); Teacher Competency Testing; Measurement; Models; Saudi Arabia + Suchen Sie Ihr Suchwort? Testreliabilität; Test content; Testaufgabe; Longitudinal study; Longitudinal method; Longitudinal methods; Längsschnittuntersuchung; Ausland; Messverfahren; Analogiemodell; Saudi-Arabien
Abstract	The purpose of the present study was to apply the methodology developed by Raykov on modeling item-specific variance for the measurement of internal consistency reliability with longitudinal data. Participants were a randomly selected sample of 500 individuals who took on a professional qualifications test in Saudi Arabia over four different occasions. Data were analyzed by use of confirmatory factor analysis, and item error variance was corrected for item specificity. The estimation of reliability involved composite index omega. Results indicated that the initially low and unacceptable levels of internal consistency reliability approached acceptable levels after accounting for item-specific variance. Findings were verified by testing whether the difference estimates of internal consistency reliability deviated from a zero-mean distribution using 10,000 replicated samples assuming a known (symmetric) or unknown (asymmetric) population distribution of the difference reliability coefficients. Percentage improvement reliability estimates indices were also estimated along with their 95% confidence intervals. Two appendices provide annotated Mplus syntax files for future use. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01