The [Alpha] and the [Omega] of Congeneric Test Theory: An Extension of Reliability and Internal Consistency to Heterogeneous Tests

Autor/in	Lucke, Joseph F.
Titel	The [Alpha] and the [Omega] of Congeneric Test Theory: An Extension of Reliability and Internal Consistency to Heterogeneous Tests
Quelle	In: Applied Psychological Measurement, 29 (2005) 1, S.65-81 (17 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0146-6216
DOI	10.1177/0146621604270882
Schlagwörter	Psychometrics; Item Response Theory; Test Reliability; Psychological Studies; Evaluation Methods; Test Theory; Social Influences + Suchen Sie Ihr Suchwort? Psychometry; Psychometrie; Item-Response-Theorie; Testreliabilität; Testtheorie; Sozialer Einfluss
Abstract	Psychometric theory focuses primarily on tests that are homogeneous, measuring only one attribute of a psychosocial entity. However, the complexity of psychosocial behavior often requires tests that are heterogeneous, measuring more than one attribute. In this presentation, reliability and internal consistency are extended to heterogeneous tests under the rubric of congeneric test theory. The extensions show that reliability and internal consistency have very similar properties. Reliability and internal consistency are shown to be unique up to a linear transformation. Whereas internal consistency is a lower bound to reliability in the homogeneous case, it is a strict lower bound in the heterogeneous case. Reliability equals internal consistency if and only if the test is homogeneous and true-score equivalent. An analytic argument shows that neither reliability nor internal consistency can detect whether a test is homogeneous or heterogeneous. The reliability (internal consistency) of a heterogeneous test is the sum of the sub-tests reliabilities (internal consistencies) plus the sum of reliabilities (internal consistencies) involving the correlations among the sub-tests. Higher-order tests are tests in which items measure first-order attributes, first-order attributes reflect second-order attributes, and so on. Reliability (internal consistency) can be partitioned into the sums of direct reliability (direct internal consistency) for the first-order attributes and indirect reliabilities (indirect internal consistencies) for the second- and higher-order attributes. Simple examples demonstrate that internal consistency may be a poor approximator to the reliability of congeneric tests. Given that reliability for congeneric tests can now be estimated by modern statistical software, the need for internal consistency is diminished. However, internal consistency may be useful in bounding or approximating reliability in general linear latent variable models. (Author).
Anmerkungen	Sage Publications, 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243 (Toll Free); Fax: 800-583-2665 (Toll Free).
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10