Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios Evaluation of Homework, Organizatio ...
Home arrow_forward_ios ... arrow_forward_ios Evaluation of Homework, Organizatio ...
Information on IES-Funded Research
Grant Open

Evaluation of Homework, Organization, and Planning Skills Program: A Conceptual Replication

NCER
Program: Education Research Grants
Program topic(s): Social, Emotional, and Behavioral Context for Teaching and Learning
Award amount: $3,950,738
Principal investigator: Thomas Power
Awardee:
Children's Hospital of Philadelphia
Year: 2019
Project type:
Effectiveness
Award number: R305A190222

Purpose

The purpose of this study is to conduct a conceptual replication of an IES Efficacy study that showed the HOPS (Homework, Organization, Planning Skills) intervention improved organizational, time management, and planning (OTMP) skills for middle school students with Attention Deficit Hyperactivity Disorder (ADHD). In this study, an independent research team will test whether HOPS yields similar benefits under routine practice conditions for the full range of students who have OTMP skills deficits, not just those with a formal diagnosis of ADHD.

Project Activities

The independent research team will evaluate HOPS when implemented by school counselors to determine whether OTMP skills, homework performance, and academic achievement improve in the current and subsequent school year for those with OTMP challenges. The research team will study the role of implementation and school climate for the effectiveness of HOPS. They will also examine HOPS' costs and cost-effectiveness relative to typical school services for these students.

Structured Abstract

Setting

The setting for this study is a range of suburban and urban schools in Pennsylvania and New Jersey.

Sample

The sample will include about 240 students in grades 6 to 8 with OTMP deficits (160 participating in HOPS; 80 in control), their parents, and school counselors in 30 schools.
Intervention
: HOPS is a 16-session skills training program provided individually to students in grades 6 to 8 who have OTMP skills deficits that contribute to academic difficulties. The program offers two parent consultations to promote generalization and maintenance of effects beyond the school setting. School counselors will administer HOPS with minimal technical support, as designed by the developer in an IES Development and Innovation study.

Research design and methods

The independent research team will use a cluster randomized design to compare HOPS to treatment-as-usual. They will randomly assign schools to condition at a 2 (HOPS) to 1 (wait-list control group) ratio. Each school will participate in the study for 3 years. To be responsive to the multiple work demands placed on counselors during a school year, schools will enroll students over two years (4 students per year). Students will be selected into the study through teacher nomination and ratings of OTMP skills deficits. The research team will assess student outcomes immediately post treatment and at 6 months after baseline assessment for all students and at 12 months after baseline for students in grades 6 and 7 who receive HOPS. The team will also consider the influence of school climate and support on HOPS impact.

Control condition

In schools randomly assigned to the control group, students will receive typical school services during their first year of participation. These students will receive HOPS in the year following study enrollment.

Key measures

Parents and teachers will rate and report on adolescents' OTMP skills and homework performance. The research team will score homework samples for completeness and accuracy. Teachers will rate students' academic functioning and provide grades. The research team will use a multi-method battery to assess student and parent engagement with HOPS. They will code audio and video recordings of student and parent sessions to assess implementation fidelity. School administrators and staff will complete rating scales to assess school organizational climate.

Data analytic strategy

The research team will use linear mixed-effects models to examine intervention and moderator effects (grade level, severity of organization problems, severity of ADHD and oppositional defiant behavior symptoms, and medication status at baseline) at post-treatment and follow up. The models will account for the multi-level (students within counselors/schools) nature of the data. The research team will use structural equation modeling to determine whether changes in OTMP skills lead to improvements in academic achievement.

Cost analysis strategy

The research team will calculate total costs (labor and non-labor) associated with the implementation of HOPS in each school. They will calculate an incremental cost-effectiveness (ICE) ratio for each outcome measure for effects that differ significantly from the control group.

People and institutions involved

IES program contact(s)

Emily Doolittle

Team Lead for Social Behavioral Research
NCER

Products and publications

Products: Products include information about the effectiveness of HOPS delivered by school counselors compared to services as usual for middle school students with OTMP challenges. Other products include information about costs and cost-effectiveness of school counselor delivered HOPS. The research team will present findings to school administrators, provide workshops for interested parents, and work with the Mid-Atlantic Regional Educational Laboratory to determine how to use project findings and lessons learned to improve student academic outcomes. The research team will also produce peer-reviewed publications and a final dataset.

Related projects

Organizational Skills Interventions for Children with ADHD

R305A100996

Efficacy of an Organizational Skills Intervention for Middle School Students with ADHD

R305A130011

Supplemental information

Co-Principal Investigator: Nissley-Tsiopinis, Jenelle

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

CognitionSocial/Emotional/Behavioral

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in Yellow IES Logo
Grant

Longitudinal Relations Among Social Contexts, Bull...

Award number: R305A230406
Read More
Rectangle Blue 1 Pattern 1
Descriptive Study

Exploring Implementation of Trauma-Engaged Practic...

Author(s): Ashley Boal, Shannon McCullough, Angela Chin
Read More
Rectangle Blue 1 Pattern 1
Tables

School Crime Supplement 2022: Web Tables for the C...

Publication number: NCES 2024027
Read More
icon-dot-govicon-https icon-quote