Building and Using Evidence in Data Science Education

Step 4. Implementation

A well-run implementation process can help build confidence for future programs and contribute to filling research gaps. A "well-run" process does not necessarily entail improved student success, nor should that be a guaranteed outcome. Rather, clear communication, pre-designed support networks, and transparency can help build confidence among educators, parents, and other stakeholders—critical to long-term success for any intervention, especially when using new technology.

Implement your plans

Have you designed a process for troubleshooting hardware, software, and internet issues that may arise during implementation?
Have you ensured there is active support and mentorship for educators trialing new content, including mentors or other PD staff?
Have you created weekly or monthly communication materials to relevant stakeholders, including families or other primary care-givers?

Additional Resources on Data Collection:

"Putting Data to Work for Young People" by RAND corporation is a step by step plan for collecting, analyzing and managing data to improve decision-making.
The Harvard Family Research Project compiled a resource to summarize a few different ways to collect data in Out of School Time Evaluations.

Collecting data on implementation and outcomes

Have you established your pre and post assessment tools?
Have you designed surveys to understand student, teacher, and parent experiences?
Have you involved students in survey design? It is a great way to get to know what matters most and is relevant to them.
Have you designed a process and obtained necessary approvals to collect and/or merge data of interest, including assessment data, survey data, or descriptive statistics on students, teachers, or other stakeholders?
Have you designed a process to monitor survey and/or assessment data collection and its accuracy during the program?