A genuine interest in science is an important part of scientific literacy, and thus a critical goal for science education. Recent studies, however, have found that school science has not been effective in meeting this goal, an important reason for which is the lack of knowledge about what makes science interesting (or not) to the students. Using instructional episodes as the unit of analysis, this study investigated the effects of learning environment elements (content topic, activity, and learning goal) on student interest in science. The findings indicated that when judging the interestingness of an instructional episode, students focused primarily on the form of activity rather than content topic and learning goal. Activities that were “hands-on” in nature and allowed for engagement with technology elicited higher interest. This study highlights the need to place more emphasis on the role of activity in constructing interesting learning environments, and in the mean time, suggests that student science interest could be improved by making changes to relatively easy-to-manipulate aspects of learning environments, such as those examined in the study. © 2012 Wiley Periodicals, Inc. J Res Sci Teach

We set out to understand how different instantiations of inquiry emerged in two different years of one elementary teacher's classroom. Longitudinal observations from Mrs. Charles' 5th grade science classroom forced us to carefully and deliberately consider who exactly was responsible for the change in the class activities and norms. We provide empirical evidence to show how a focus on the teacher can easily overlook the complex dynamics of the classroom. The data reveal that students had a substantive and generative role in the class's arrival at the different instantiations of scientific inquiry—the nature and form of inquiry—that were constructed each year. We argue that, in an environment where a teacher carefully attends and responds to student thinking, the nascent resources students have for reasoning about phenomena can affect not only the conceptual ideas that emerge, but also influence what inquiry activities or practices become established as normative and productive over time. Our work with Mrs. Charles illuminates an important methodological concern with research on teacher development as well as the construct of teacher learning progressions; research accounts that focus primarily on the teacher may overlook the classroom norms that are negotiated between teacher and student, and thereby provide an incomplete portrayal of the teacher's activity within one classroom and the teacher's progress across multiple years. © 2012 Wiley Periodicals, Inc. J Res Sci Teach

Current classroom practices in the U.S. and internationally have largely been shaped by changing student demographics and accountability policies. This special issue includes manuscripts that develop conceptual frameworks or report on empirical studies addressing large-scale interventions of educational innovations for diverse student groups in varied educational settings. Understanding issues related to large-scale interventions will be particularly important for the U.S. as the science education system embraces new science standards [National Research Council, [2011] A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. Washington, DC: National Research Council.]. In our introduction to the special issue, we discuss critical issues in scaling up educational innovations through which large-scale interventions evolve. First, we describe the process of scaling up an educational innovation. Then, we address challenges in scaling up an innovation. Next, we discuss implications that these challenges present to implementation of an innovation and evaluation of its efficacy and effectiveness. Finally, we briefly introduce the articles that appear in this special issue. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 271–280, 2012

This article develops an argument that the type of intervention research most useful for improving science teaching and learning and leading to scalable interventions includes both research to develop and gather evidence of the efficacy of innovations and a different kind of research, design-based implementation research (DBIR). DBIR in education focuses on what is required to bring interventions and knowledge about learning to all students, wherever they might engage in science learning. This research focuses on implementation, both in the development and initial testing of interventions and in the scaling up process. In contrast to traditional intervention research that focuses principally on one level of educational systems, DBIR designs and tests interventions that cross levels and settings of learning, with the aim of investigating and improving the effective implementation of interventions. The article concludes by outlining four areas of DBIR that may improve the likelihood that new standards for science education will achieve their intended purpose of establishing an effective, equitable, and coherent system of opportunities for science learning in the United States. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 281–304, 2012

This article provides an extended, comprehensive example of how teachers, schools, districts, and external factors (e.g., parental pressure and policy mandates) shape curriculum research in the U.S. It retrospectively examines how three different middle school curriculum units were implemented and scaled-up in a large, diverse school system. The curriculum materials were cognitively based, hands-on, guided inquiry units; each focused on a different “big idea” in science. The units met some criteria for instructional strategies rated by the Project 2061 Curriculum Analysis. Using evidence-based decisions, two of the units were found to be effective and equitable, and went to scale, but one was not effective. However, the course of scale-up was also affected by a changing policy climate, and proceeded in unpredictable ways, with small scale effects not found at large scale, and experienced teachers less effective than inexperienced teachers. Four years after funding ended, none of the units were sustained within the school district. The interactions between the demands of the units and of the school district's policy environment suggests reasons why this occurred, despite evidence that two of the units were successful with diverse learners. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 305–332, 2012

To identify links among professional development, teacher knowledge, practice, and student achievement, researchers have called for study designs that allow causal inferences and that examine relationships among features of interventions and multiple outcomes. In a randomized experiment implemented in six states with over 270 elementary teachers and 7,000 students, this project compared three related but systematically varied teacher interventions—Teaching Cases, Looking at Student Work, and Metacognitive Analysis—along with no-treatment controls. The three courses contained identical science content components, but differed in the ways they incorporated analysis of learner thinking and of teaching, making it possible to measure effects of these features on teacher and student outcomes. Interventions were delivered by staff developers trained to lead the teacher courses in their regions. Each course improved teachers' and students' scores on selected-response science tests well beyond those of controls, and effects were maintained a year later. Student achievement also improved significantly for English language learners in both the study year and follow-up, and treatment effects did not differ based on sex or race/ethnicity. However, only Teaching Cases and Looking at Student Work courses improved the accuracy and completeness of students' written justifications of test answers in the follow-up, and only Teaching Cases had sustained effects on teachers' written justifications. Thus, the content component in common across the three courses had powerful effects on teachers' and students' ability to choose correct test answers, but their ability to explain why answers were correct only improved when the professional development incorporated analysis of student conceptual understandings and implications for instruction; metacognitive analysis of teachers' own learning did not improve student justifications either year. Findings suggest investing in professional development that integrates content learning with analysis of student learning and teaching rather than advanced content or teacher metacognition alone. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 333–362, 2012

This article reports on the collaboration of six states to study how simulation-based science assessments can become transformative components of multi-level, balanced state science assessment systems. The project studied the psychometric quality, feasibility, and utility of simulation-based science assessments designed to serve formative purposes during a unit and to provide summative evidence of end-of-unit proficiencies. The frameworks of evidence-centered assessment design and model-based learning shaped the specifications for the assessments. The simulations provided the three most common forms of accommodations in state testing programs: audio recording of text, screen magnification, and support for extended time. The SimScientists program at WestEd developed simulation-based, curriculum-embedded, and unit benchmark assessments for two middle school topics, Ecosystems and Force & Motion. These were field-tested in three states. Data included student characteristics, responses to the assessments, cognitive labs, classroom observations, and teacher surveys and interviews. UCLA CRESST conducted an evaluation of the implementation. Feasibility and utility were examined in classroom observations, teacher surveys and interviews, and by the six-state Design Panel. Technical quality data included AAAS reviews of the items' alignment with standards and quality of the science, cognitive labs, and assessment data. Student data were analyzed using multidimensional Item Response Theory (IRT) methods. IRT analyses demonstrated the high psychometric quality (reliability and validity) of the assessments and their discrimination between content knowledge and inquiry practices. Students performed better on the interactive, simulation-based assessments than on the static, conventional items in the posttest. Importantly, gaps between performance of the general population and English language learners and students with disabilities were considerably smaller on the simulation-based assessments than on the posttests. The Design Panel participated in development of two models for integrating science simulations into a balanced state science assessment system. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 363–393, 2012

Are well-designed computer simulations an effective tool to support student understanding of complex concepts in chemistry when integrated into high school science classrooms? We investigated scaling up the use of a sequence of simulations of kinetic molecular theory and associated topics of diffusion, gas laws, and phase change, which we designed and experimentally tested. In the two effectiveness studies reported, one in a rural and the other in an urban context, chemistry teachers implemented two alternate versions of a curricular unit—an experimental version, incorporating simulations, and a control version, using text-based materials covering the same content. Participants were 718 high school students (357 rural and 361 urban), in a total of 25 classrooms. The implementation of the simulations was explored using criteria associated with fidelity of implementation (FOI). Each context provided insights into the role of FOI in affecting the effectiveness of the interventions when working with groups of teachers. Results supported the effectiveness of this sequence of simulations as a teaching tool in a classroom context, and confirmed the importance of FOI factors such as adherence and exposure in determining the specific environments in which these materials were most effective. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 394–419, 2012

This article provides commentary on the five articles in this issue on large-scale interventions in science education for diverse student groups in varied educational settings. Using these articles as a point of departure, I discuss three challenges to science education research and practice. The first concerns the changed meaning of science education reform over the past two decades. The science education research and development community must be aware of the shifting policy and public awareness context of their work and react accordingly if it wishes for its work to make a difference in the lives of teachers and students. The second addresses the importance of teacher professional development and the role that well-designed and internally valid research plays in developing knowledge in this area. The third discusses the chaotic and contradictory nature of educational policy in this country and argues that our field needs to align our research work with the ways in which real and impactful decisions are made about education in general and science education in particular. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 420–427, 2012