What We Don't Test: What an Analysis of Unreleased ACS Exam Items Reveals about Content Coverage in General Chemistry Assessments

Autor/inn/en	Reed, Jessica J.; Villafan~e, Sachel M.; Raker, Jeffrey R.; Holme, Thomas A.; Murphy, Kristen L.
Titel	What We Don't Test: What an Analysis of Unreleased ACS Exam Items Reveals about Content Coverage in General Chemistry Assessments
Quelle	In: Journal of Chemical Education, 94 (2017) 4, S.418-428 (11 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Reed, Jessica J.) ORCID (Raker, Jeffrey R.) ORCID (Holme, Thomas A.) ORCID (Murphy, Kristen L.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0021-9584
DOI	10.1021/acs.jchemed.6b00863
Schlagwörter	Science Tests; Chemistry; Test Items; Test Content; Scientific Concepts; Energy; Thermodynamics; Kinetics; Experiments; Visualization; Course Content; College Science + Suchen Sie Ihr Suchwort? Chemie; Test content; Testaufgabe; Energie; Thermodynamik; Kinetik; Erprobung; Visualisation; Visualisierung; Kursprogramm
Abstract	General chemistry courses are often the foundation for the study of other science disciplines and upper-level chemistry concepts. Students who take introductory chemistry courses are more often from health and science-related fields than chemistry. As such, the content taught and assessed in general chemistry courses is envisioned as building blocks for concepts in other science courses and across many science disciplines. American Chemical Society (ACS) exams are developed by committees of expert chemists and serve as representative artifacts of content valued by the chemistry community. Before an exam is released, items developed by an examination committee undergo trial testing, and items deemed too easy, too hard, or not discriminating based on item statistics are removed. Analysis of content coverage from items on multiple released general chemistry ACS exams from the past decade and their associated unreleased trial tests revealed content areas where few exam items were written. Content coverage was analyzed by aligning exam items to the ACS Anchoring Concepts Content Map for General Chemistry. By comparing released and unreleased trial items, we found that many of the content coverage gaps on released exams are the result of a lack of items developed about these concepts. These conceptual holes warrant a discussion of whether what is being assessed is what is desired to be assessed and how curricular improvement and assessment reform efforts address content coverage. (As Provided).
Anmerkungen	Division of Chemical Education, Inc and ACS Publications Division of the American Chemical Society. 1155 Sixteenth Street NW, Washington, DC 20036. Tel: 800-227-5558; Tel: 202-872-4600; e-mail: eic@jce.acs.org; Web site: http://pubs.acs.org/jchemeduc
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01