Project Activities
In Year 1, the research team will prototype and develop online versions of the activities and conduct usability studies with approximately 50 students. In Year 2, the research team will conduct feasibility studies and run A/B tests to determine which types and timing of feedback best support learning involving 26 teachers and approximately 650 students. In Year 3, the research team will conduct a pilot study of ICUE Online. In Year 4, the research team will broadly disseminate findings and build awareness of the availability of the freely available ICUE Online materials.
Structured Abstract
Setting
The studies will take place in diverse second grade classrooms in urban and suburban California and Indiana schools.
Sample
Approximately 50 second grade students will participate in usability studies, 26 teachers and 600 second grade students will participate in feasibility studies and A/B testing, and approximately 20 teachers and 500 second grade students will participate in the pilot study.
ICUE Online will consist of interactive, online versions of 32 activities targeting mathematical equivalence. Students will experience novel types of practice and immediate feedback and teachers will have access to reports that detail common errors and individual student performance. The ICUE Online activities will be deployed using the ASSISTments platform.
Research design and methods
In Year 1, the research team will prototype and develop online versions of the activities and conduct usability studies. In Year 2, the research team will conduct feasibility studies and run A/B tests to determine which types and timing of feedback best support learning. In Year 3, the research team will conduct a pilot study of ICUE Online using a randomized controlled trial design. Teachers and their classrooms will be randomly assigned to either use the new activities or an active control consisting of existing second grade math activities in the ASSISTments system.
Control condition
For the pilot study, the control condition is an active control consisting of existing second grade mathematics activities available in the ASSISTments system.
Key measures
Measures to assess usability and feasibility will include verbal protocols from lab studies, classroom observation protocols, teacher interviews, student responses on assessment items, and log data on student actions in the ASSISTments platform. Measures to assess evidence of promise include proximal measures of mathematical equivalence understanding and distal measures such as Mathematics Assessment Resource Service performance tasks.
Data analytic strategy
The research team will use a range of data analytic techniques including qualitative coding and analyses, log analyses, descriptive statistics, and hierarchical linear modeling.
Cost analysis strategy
After the pilot study, the team will carry out a cost analysis of ICUE Online and the existing intervention. Researchers will use findings from the pilot study and cost analyses to prepare a report on the cost effectiveness of the intervention.
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
ICUE Online will be a suite of 32 fully developed online activities to support students in developing deep understanding of mathematical equivalence. Activities will be made available through the widely used ASSISTments system, to facilitate uptake and dissemination. In addition, the research team plans to disseminate findings to a broad range of audiences including practitioners, policymakers, and researchers.
Publications:
Bartel, A. N., Celeste, S. M., Guang, C., Francis-Bongue, L., Hsu, V., Davenport, J. L., ... & McNeil, N. M. (2023, June). Designing dynamic feedback to help second graders understand equivalence: Centering students’ perspectives. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (pp. 527-531).
Related projects
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
