Skip Navigation
Impact Evaluation of the U.S. Department of Education's Student Mentoring Program

NCEE 2009-4047
March 2009

Exhibit ES.1.  Estimated Overall Impacts on Student Outcomes


  Unadjusted Mean Outcome Estimated Impact
  Treatment Group Control Group Regression Adjusted T-C Group Differencea p-value to Test Difference BH-Corrected Critical Valueb Estimated Effect Size
Outcome Mean Standard Deviation Mean Standard Deviation
Interpersonal Relationships, Personal Responsibility, and Community Involvement
Self-Reported Outcomes
(Range 1-4)
               
Pro-Social Behaviors 2.79 0.81 2.80 0.80 -0.01 0.68 N/A -0.01
Percent Missing Data ≤3%   ≤3%          
Academic Outcomes
Self-Reported Outcome
(Range 1-4)
               
School Efficacy and Bonding 3.06 0.80 3.03 0.85 0.04 0.08 0.02 0.07
Future Orientation 3.85 0.54 3.80 0.63 0.03* 0.04 0.01 0.08
Percent Missing Data ≤3%   ≤3%          
School-Reported Outcome                
Overall Absenteeism Rate (all absences as percent of total days enrolled) 5.03 7.71 5.49 9.63 -0.46* 0.04 0.01 -0.09
Percent Missing Data 0.15   0.18          
Grades (Range 1-5)                
Math 3.19 1.70 3.23 1.67 -0.05 0.23 0.02 -0.05
Reading/ELAc 3.57 1.78 3.61 1.69 -0.04 0.40 0.03 0.04
Science 3.52 1.87 3.55 1.86 -0.03 0.48 0.04 -0.03
Social Studies 3.53 1.92 3.56 1.83 -0.01 0.78 0.05 -0.01
Percent Missing Data ≤33%   ≤33%          
State Assessment Tests                
Math—Percent Proficient 45.69   47.10   -1.53 0.41 0.04 0.94d
Reading/ELA—Percent Proficient 49.40   47.10   -1.67 0.37 0.03 0.94d
Percent Missing Data ≤25%   ≤20%          
Delinquent Behaviors and Participation in Harmful Activities
Self-Reported Outcomes
(Range 1-4)
               
Misconducte 3.20 0.86 3.20 0.85 0.00 0.95 0.05 0.00
Delinquencye 3.87 0.36 3.85 0.40 0.01 0.28 0.02 0.04
Percent Missing Data ≤3%   ≤4%          
School-Reported Outcome                
Truancy (unexcused absences as percent of total days enrolledf 2.04 4.80 2.47 6.91 -0.45* 0.02 0.01 -0.14
Misconduct                
Percent committing any infraction 25.00   22.91   2.56 0.13 0.01 1.59d
Percent committing repeated infractions (2+) 14.21   15.63   -0.98 0.48 0.04 0.93d
Delinquency                
Percent committing any infraction 18.13   20.03   -1.51 0.35 0.03 0.91d
Percent committing repeated infractions (2+) 8.64   9.13   -0.56 0.65 0.04 0.93d
Percent Missing Data ≤22%   ≤23%          
Number of students 1163.00   1197.00          
a Regression Adjusted T-C Group Difference will not necessarily be equal to the difference between the Unadjusted Mean Outcomes.
b Based on Benjamini-Hochberg test.
c ELA = English/Language Arts.
d Odds-ratio.
e Higher scores on the Self-Reported Misconduct and Delinquency scales indicate more positive outcomes.
f Based on 27 sites that reported unexcused absences and total days enrolled. Treatment Group: Missing data ≤38%; Control Group: Missing data ≤36%.
* p-value (of estimated impact) < 0.05, two-tailed test.
+ p-value (of estimated impact < BH-Corrected Critical Value ⇒ statistically significant holding the false discovery rate under multiple testing below 0.05
SOURCE: Impact Evaluation of the U.S. Department of Educationís Student Mentoring Program—Student Survey, Fall 2005 and Spring 2006; Fall 2006 and Spring 2007; School Records, SY 2004-2005, SY 2005-2006, SY 2006-2007.