WWC review of this study

An Efficacy Trial of Research-Based Curriculum Materials with Curriculum-Based Professional Development

Taylor, Joseph A.; Getty, Stephen R.; Kowalski, Susan M.; Wilson, Christopher D.; Carlson, Janet; Van Scotter, Pamela (2015). American Educational Research Journal, v52 n5 p984-1017 Oct 2015. Retrieved from: https://eric.ed.gov/?id=EJ1074631

  • Randomized Controlled Trial
     examining 
    3,052
     Students
    , grade
    10

Reviewed: May 2023

At least one finding shows strong evidence of effectiveness
At least one statistically significant positive finding
Meets WWC standards without reservations
General science achievement outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Washington State High School Proficiency Exam: Science Grade 10 (WA HSPE-Science 10)

BSCS Science: An Inquiry Approach vs. Business as usual

0 Days

Full sample;
3,052 students

384.52

380.84

Yes

 
 
4
 
Teacher Practice outcomes—Statistically significant positive effect found for the domain
Outcome
measure
Comparison Period Sample Intervention
mean
Comparison
mean
Significant? Improvement
    index
Evidence
tier

Reformed Teaching Observation Protocol (RTOP)

BSCS Science: An Inquiry Approach vs. Business as usual

0 Days

Full sample;
53 teachers

71.40

55.00

Yes

 
 
47
 


Evidence Tier rating based solely on this study. This intervention may achieve a higher tier when combined with the full body of evidence.

Characteristics of study sample as reported by study author.


  • 5% English language learners

  • Female: 48%
    Other or unknown: 52%

  • Rural, Suburban
    • B
    • A
    • C
    • D
    • E
    • F
    • G
    • I
    • H
    • J
    • K
    • L
    • P
    • M
    • N
    • O
    • Q
    • R
    • S
    • V
    • U
    • T
    • W
    • X
    • Z
    • Y
    • a
    • h
    • i
    • b
    • d
    • e
    • f
    • c
    • g
    • j
    • k
    • l
    • m
    • n
    • o
    • p
    • q
    • r
    • s
    • t
    • u
    • x
    • w
    • y

    Washington
  • Race
    Asian
    8%
    Black
    7%
    Native American
    2%
    Other or unknown
    27%
    Pacific Islander
    1%
    Two or more races
    3%
    White
    52%
  • Ethnicity
    Hispanic    
    27%
    Other or unknown    
    73%
  • Eligible for Free and Reduced Price Lunch
    Free or reduced price lunch (FRPL)    
    46%
    Other or unknown    
    54%

Setting

The study took place in 18 rural or suburban schools in public secondary schools in Washington state during general education science classes.

Study sample

The researchers randomly assigned 9 schools to the intervention group and 9 schools to the comparison group. The study included 3,052 students in grade 10 and 53 teachers. Approximately 48% of the students were female, 46% were eligible for free or reduced-price lunch, 5% were English learners, and 10% had a special education designation. Fifty-two percent were White, 8% were Asian, 7% were Black, 3% were two or more races, 2% were Native American, 1% were Pacific Islander, and 27% did not report race. Twenty-seven percent were Hispanic or Latino.

Intervention Group

BSCS Science: An Inquiry Approach is a research-based, multi-disciplinary science curriculum and associated professional development for high school teachers that was designed to improve student achievement in science. This product was designed to be used every day during each of three school years in grades 9 through 11 in whole classrooms. In this study, students were exposed to two years of the curriculum in grades 9 and 10 before outcome data were collected. The curriculum included units that covered topics in physical science, life science, earth science, and science and society. Each unit consisted of four chapters that included: (a) opportunities for students to state what they already know, (b) laboratory explorations, (c) interactive readings, (d) formative assessments, (e) opportunities for students to use evidence to develop explanations, and (f) an end-of-chapter project or lesson that served as a summative assessment. Teachers received professional development and support materials that accompanied the curriculum.

Comparison Group

Students in the comparison group received business-as-usual grade 9 and grade 10 science instruction. In grade 9, more than half of the teachers in the comparison group used Prentice Hall's Physical Science and Earth Science textbooks. In grade 10, most schools used their business-as-usual biology curriculum and textbooks. Teachers supplemented the district-supplied textbook with other curricular materials. Comparison teachers may have participated in other business-as-usual training and professional development offered by their schools or school districts.

Support for implementation

Teachers in the intervention group participated in a 3-day summer institute and four 1-day sessions during the school year. The BSCS Science: An Inquiry Approach curriculum developers provided this professional development in each of the two years of the study. At these professional development sessions, the curriculum developers modeled the pedagogical techniques that teachers were supposed to use in their classrooms. Intervention teachers also received support materials that included a discussion of the philosophy behind the instructional approach presented in the curriculum, strategies for implementing the curriculum and helping students monitor their own learning, and additional content material, along with tips for addressing common student misconceptions. These support materials also included ideas for formative and summative assessments.

 

Your export should download shortly as a zip archive.

This download will include data files for study and findings review data and a data dictionary.

Connect With the WWC

loading
back to top