Project Activities
In the first two years of the project, the research team will iteratively develop the modules for the intervention. In Year 3, they will run a pre-pilot study to determine the most effective module or combination of modules. The team will revise the modules based on the findings from this study. In Year 4, the research team will run a pilot study to compare the most effective module(s) identified in the pre-pilot study against a business-as-usual control condition. Throughout both studies, the research team will collect measures of student learning as well as measures of feasibility and fidelity of implementation.
Structured Abstract
Setting
Participating high schools are located in an urban district in Arizona. Iterative development data collection and the pre-pilot study will take place in an after school context while the pilot study will take place in high school classrooms.
Sample
Researchers will recruit approximately 80 high school students to participate in the iterative development process. The research team will recruit an additional 80 participants to participate in the pre-pilot study. Approximately 26 classrooms, each with about 20 students, will participate in the pilot study. Participants will be reflective of the demographics of their school, which has a diverse population (58% Hispanic, 33% White, 4% African American, 2% Asian/Pacific Islander, and 2% Native American) and has 58% of students with free or reduced lunch status.
The intervention will consist of a module or series of modules to teach the crosscutting emergence structure that underlies many science concepts and phenomena. The research team will develop a Process Module to teach the emergence schema to students directly, by contrasting everyday emergent and sequential processes. They will also develop two Science Modules for diffusion and natural selection that instantiate these concepts within the emergence schema by directly pointing out and explaining each concept's emergent features and attributes. The module (or combination of modules) with the best transfer learning outcomes from the pre-pilot study will be selected as the intervention in the pilot study.
Research design and methods
In Years 1 and 2, the research team will develop the modules and conduct four supplemental studies with small numbers of participants to inform their design. Participants will interact with the materials and will participate in group discussions. The data collected will be used to design certain components of the modules (e.g., determining which examples to use for contrasting emergent and sequential processes). In Year 3, the research team will conduct the pre-pilot study in an after school setting. Students will be randomly assigned to one of four conditions (Process Module only, Science Modules only, all modules, or control) to see which module or combination of modules most effective. In Year 4, the research team will run the pilot study, which will be a quasi-experimental design comparing classrooms randomly assigned to either the best approach identified in the pre-pilot study (the intervention condition) or a control condition. For both the pre-pilot and pilot studies, students will complete pre-tests and post-tests, and feasibility and fidelity of implementation measures will also be collected.
Control condition
The control condition in both the pre-pilot and pilot study is business as usual instruction.
Key measures
For iterative development, measures will primarily include transcriptions of students' responses, feedback, and group discussions. For the pre-pilot and pilot studies, primary measures include researcher-developed pre- and post-tests to measure students' understanding of emergent and sequential processes as well as five science concepts (diffusion, natural selection, and three to-be-determined transfer concepts). Feasibility and fidelity of implementation will be measured with process data (e.g., students' learning progress), log data (e.g., time spent on an activity), classroom observations, and survey data.
Data analytic strategy
For both the pre-pilot and pilot studies, researchers will use multilevel structural equation models to account for the repeated measures design and the hierarchical nature of the data. The analyses will address whether teaching a general schema about emergence will help students better learn and understand other emergent science concepts with reduced misconceptions.
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
The products of this project include a fully developed intervention for high school students to teach the crosscutting concept of emergence and peer-reviewed publications.
Publications:
ERIC Citations: Find available citations in ERIC for this award here.
Bruchok, C., Mar, C., & Craig, S. D. (2017). Is free recall active: The testing effect through the ICAP lens. Journal of Interactive Learning Research, 28(2), 127-148.
Chi, M. T. (2023, July). Individualistic and collective causal knowledge structures for understanding sequential and emergent processes. In Frontiers in Education (Vol. 8, p. 1198362). Frontiers Media SA.
Henderson, J. B., Langbeheim, E., and Chi, M. T. H. (2017). Addressing Robust Misconceptions through Ontological Distinction between Sequential and Emergent Processes. In B. Sherin, T. Amin, & O. Levrini (Eds.), Converging and Complementary Perspectives on Conceptual Change, Routledge.
Su, M., Cho, J. Y., Chi, M. T., Boucher, N., & Vanbibber, B. (2021). Designing Simulation Module to Diagnose Misconceptions in Learning Natural Selection. In Proceedings of the 15th International Conference of the Learning Sciences-ICLS 2021.. International Society of the Learning Sciences.
Su, M., Ha, J., & Xin, Y. (2023). Investigating the efficacy of an ontological framework for teaching natural selection using agent-based simulations. In Proceedings of the 17th International Conference of the Learning Sciences-ICLS 2023, pp. 106-113. International Society of the Learning Sciences.
Su, M., TH, M., Nagashima, T., Gole, J., Xin, Y., & Ha, J. (2024). Exploration of Cognitive Engagement Patterns in Online Environments with Multiple External Representations. In Proceedings of the 18th International Conference of the Learning Sciences-ICLS 2024, pp. 194-201. International Society of the Learning Sciences.
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
