Teachley Problem-Solving Assessment: Supporting Teachers to Assess and Promote Students' Mathematical Thinking

In Phase II, the team will fully develop a machine learning engine to automatically categorize student problem solving strategizes and provides insights to teachers, as well as training materials to support implementation. After development is complete, the research team will conduct a pilot study to assess the feasibility and usability, and promise of the product to support educators in understanding individual students' problem-solving strategies. The study will include 60 grade five classrooms, half will be randomly assigned the product and half will continue to use business as usual procedures. Researchers will employ a mixed-methods design to assess how educators use the product to inform instruction, including researcher developed interview protocols, teacher logs, classroom observations. To examine differences in students in treatment and control classrooms from pre- to post-test, researchers will employ items from the Mathematics Assessment Project and from NAEP items. Researchers will gather cost information using the "ingredients method" and will include all expenditures on things such as personnel, facilities, equipment, materials, and training.