|Title:||Efficacy Study of Adventures Aboard the S.S.GRIN: Social, Emotional, and Academic Skills|
|Principal Investigator:||Schneider, Steve||Awardee:||WestEd|
|Program:||Social and Behavioral Context for Academic Learning [Program Details]|
|Award Period:||3.5 Years (07/01/2018 - 01/31/2022)||Award Amount:||$2,997,518|
|Goal:||Efficacy and Replication||Award Number:||R305A180224|
Co-Principal Investigator: DeRosier, Melissa
Purpose: The purpose of this study is to evaluate the Adventures Aboard the S.S.GRIN program, an online game with embedded social skills training to improve social, emotional, and academic outcomes for children experiencing social difficulties. Research indicates that direct social skills instruction can benefit these students, yet most schools are not equipped to provide this type of targeted support. The Adventures program was created through an IES development grant to address this gap.
Project Activities: The research team will randomly assign schools to provide students with the opportunity to play the Adventures game (treatment) or to continue with their typical practice (control). Within each school, 3rd grade students identified by their teachers as having social skills difficultieswill be pulled out of their regular education classroom to work with school counselors (using either Adventures or typical practice) over a nine-week period during the school year. They will pilot measures and study procedures in Year 1 to prepare for the full randomized control trial in Year 2.
Products: Researchers will produce evidence of the efficacy of the Adventures Aboard the S.S. GRIN online game program for 3rd grade students with social skills challenges. They will also disseminate findings through peer-reviewed publications and other reports shared via project websites, e-newsletters, and social media.
Setting: This study will take place in three primarily urban/suburban school districts in California.
Sample: The sample for this study includes approximately 800 3rd grade students with social skills challenges, their teachers, and counselors from about 100 elementary schools.
Intervention: Adventures Aboard the S.S. GRIN is an online game developed with IES funding that incorporates the content and instructional strategies of a widely-used, efficacious, small-group program (Social Skills Group Intervention - S.S. GRIN). The Adventures program provides schools with a more feasible way to support students experiencing social difficulties like peer rejection, bullying, and social anxiety. The game consists of nine episodes (about 25 minutes each) that use a single-player format and intelligent social tutoring software (ISTS) to provide individualized feedback and a safe environment for practicing newly-learned skills to regulate emotions, control impulses, build friendships, and respect self and others. The ISTS software captures in-game behaviors to assess the student's progress and adapt responses by the ISTS to generate a next step individualized for that student.
Research Design and Methods: The researchers will use a multisite cluster randomized trial design where schools will be randomly assigned to treatment or control groups. Within each school, 3rd grade students identified by their teachers as having social skills difficultieswill be pulled out of their regular education classroom to work with school counselors (Adventures or typical practice) over a nine-week period during the school year. The researchers will pilot measures and study procedures in five schools in Year 1 to prepare for the full randomized control trial in Year 2.
Control Condition: Students in the control condition will engage in business-as-usual activities with their school counselors.
Key Measures: Teachers will complete the Devereux Student Strengths Assessment (DESSA)-Mini to identify 3rd grade students with social skills deficits, as well as the Behavioral andEmotional Rating Scale Second Edition (BERS-2)and the Children's Social Behavior Scaleto measure student social and emotional outcomes. The researchers will use the Smarter Balanced Summative Assessments to measure student academic performance. They will measure implementation fidelity through weekly electronic implementation logs, the Adventures' analytics, and site visits.
Data Analytic Strategy: The research team will analyze differential gains between treatment and control groups on measures of student outcomes using three-level hierarchical linear models. They will use structural equation modeling to analyze the impact of potential mediator (students' perceived self-efficacy for social situations) and moderator (implementation) variables. Researchers will also use the “ingredients method” to estimate program costs for schools to implement the intervention, and use the average cost per student to calculate a cost-effectiveness ratio for the Adventures program.
Related IES Project: Interactive Social Tutoring System for Social Skills Training with Elementary Students (R305A110583)