Validity Evidence for Learning Progression-Based Assessment Items That Fuse Core Disciplinary Ideas and Science Practices
Article first published online: 28 FEB 2013
Copyright © 2013 Wiley Periodicals, Inc.
Journal of Research in Science Teaching
Volume 50, Issue 5, pages 597–626, May 2013
How to Cite
Gotwals, A. W. and Songer, N. B. (2013), Validity Evidence for Learning Progression-Based Assessment Items That Fuse Core Disciplinary Ideas and Science Practices. J. Res. Sci. Teach., 50: 597–626. doi: 10.1002/tea.21083
- Issue published online: 12 APR 2013
- Article first published online: 28 FEB 2013
- Manuscript Accepted: 25 JAN 2013
- Manuscript Received: 11 JAN 2012
- National Science Foundation. Grant Numbers: REC-0089283, REC-0129331
- Spencer Dissertation Fellowship
- learning progressions;
This article evaluates a validity argument for the degree to which assessment tasks are able to provide evidence about knowledge that fuses information from a progression of core disciplinary ideas in ecology and a progression for the scientific practice of developing evidence-based explanations. The article describes the interpretive framework for the argument, including evidence for how well the assessment tasks are matched to the learning progressions and the methods for interpreting students' responses to the tasks. Findings from a dual-pronged validity study that includes a think-aloud analysis and an item difficulty analysis are presented as evidence. The findings suggest that the tasks provide opportunities for students at multiple ability levels to show evidence of both successes and struggles with the development of knowledge that fuses core disciplinary ideas with the scientific practice of developing evidence-based explanations. In addition, these tasks are generally able to distinguish between different ability-level students. However, some of the assumptions in the interpretive argument are not supported, such as the inability of the data to provide evidence that might neatly place students at a given level on our progressions. Implications for the assessment system, specifically, how responses are elicited from students, are discussed. In addition, we discuss the implications of our findings for defining and redesigning learning progressions. © 2013 Wiley Periodicals, Inc. J Res Sci Teach 50: 597–626, 2013.