The Effects of a Systematic Approach to Improving Quality in Afterschool Programs: An Impact Evaluation to Inform the 21st Century Community Learning Centers (CCLC) Program
Contract Information
Current Status:
Underway
Duration:
July 2019 – June 2025
Cost:
$13,359,008
Contract Number:
919900-19-C-0056
Contractor(s):
Mathematica Policy Research
Synergy Enterprises
Research for Action
Pemberton Research
Contact:
The time students spend outside of school hours, including after school, can be important opportunities for their social and academic development. The 21st CCLC program intends to provide these opportunities by funding a broad range of academic enrichment activities in community learning centers, particularly for students from disadvantaged backgrounds. But little is known about the extent and diversity of recent program activities, or whether a systematic approach to support program quality could improve staff practices and student outcomes. This evaluation will produce a national picture of funded program activities and program improvement efforts and evaluate the effectiveness of a continuous quality improvement system aimed at improving staff practices to support students' social and emotional skills.
- What are the activities and services offered by 21st CCLC afterschool centers? How are they staffed and supported to meet local needs?
- What are the impacts of a continuous quality improvement system, which is a common component of 21st CCLC afterschool centers, on staff practices? What are the impacts on students' social and emotional skills and other school-related student outcomes?
- What are the challenges with implementing a continuous quality improvement system, and how are they addressed?
This evaluation includes a descriptive study of grantees and an impact study to determine the effectiveness of a specific strategy designed to improve student and grantee outcomes. The national description of program activities will be based on a survey of a nationally representative sample of 250 21st CCLC afterschool centers. To assess the effectiveness of the continuous quality improvement (CQI) system, approximately 100 21st CCLC afterschool centers were recruited to participate in the impact study. Half of the participating centers were selected by lottery to implement the CQI system supported by the study for two school years, and half continued their normally planned program. The impact study will compare staff practices and student outcomes for the two groups of centers. Information was also collected about program operations and staff training and experiences with the CQI system. Data collection includes afterschool center director interviews, an afterschool staff survey, observations of program quality at each center, student survey and afterschool attendance records, administrative school records, and a school-day teacher survey.
The study's first report is expected in 2024 and will be announced on https://ies.ed.gov/ncee/.
Key findings will be available after the first report is published.