Purpose: Educators new to teaching computer science, include those who were originally trained in other disciplines or have industry experience as content knowledge experts, sometimes have challenges delivering instructional pedagogy. In this project, the research team will fully develop a dashboard with resources and data driven insights on student performance to support educators in implementing a high school-level computer science intervention.

Project Activities: In a previous project, the company developed a high school-level computer science intervention (2 Sigma Schools) for remote teaching and learning with live and pre-recorded lectures describing hands-on activities and online exercises. During Phase In in 2022, the team developed a prototype of a machine learning dashboard to track student learning progressions and generate fine-grained pedagogical recommendations that educators can use to inform practice. At the end of Phase I, a pilot study with four educators and 250 high school students demonstrated that the prototype functioned as intended, and that the machine learning component generated information that educators found useful for providing individualized information on each student.

In Phase II of the project, the research team will fully develop the product, including a data visualization dashboard, a competition platform, and ten classroom instructional modules. Iterative refinements will be conducted with feedback from educators and students at major production milestones until the product is fully functional. After development concludes, a pilot study will test the feasibility and usability, fidelity of implementation, and the promise of the product for improving computer science learning. The team will collect data from 30 middle school science classes, with half randomly assigned to use the product and the other half to use business-as-usual activities for the same course content. Researchers will compare pre-and-post scores for computer science learning. Researchers will gather cost information using the "ingredients method" and will include all expenditures on things such as personnel, facilities, equipment, materials, and training.

Product: This project will develop a reporting dashboard to be integrated with an online computer science program to track high school students' engagement and performance data. The dashboard will enable educators to view their students' learning progression at a fine granularity of standards-aligned skills and competencies, and with Artificial Intelligence will provide them with actionable content and pedagogical recommendations to promote mastery learning in an equitable manner.

Related IES Projects: Intelligent Augmentation for Teachers with Algorithmic Understanding of Student Comprehension of Computer Science Concepts (91990022C0035)

Company Website: https://2sigma.school