IES Blog

Earlier this year, I wrote a short blog about how I envisioned the Regional Educational Laboratories (REL) Program, The What Works Clearinghouse™ (WWC), and the Comprehensive Center Program could work together to take discovery to scale. In it, I promised I would follow-up with more thoughts on a specific—and critically important—example: making WWC Practice Guides actionable for educators. I do so below. At the end of this blog, I pose a few questions on which I welcome comments.

The challenge. The single most important resources the WWC produces are its Practice Guides. Practice Guides evaluate the research on a given topic—say, teaching fractions in elementary and middle school—and boil study findings down to a handful of evidence-based practices for educators. Each practice is given a rating to indicate the WWC’s confidence in the underlying evidence, along with tips for how practices can be implemented in the classroom. In many ways, Practice Guides are IES’s most specific and definitive statements about what works to improve education practice and promote student achievement.

Despite their importance, the amount of effort IES has intentionally dedicated to producing high-quality resources that support educators in implementing Practice Guide recommendations has been uneven. (By most measures, it has been on the decline.) Why? Although we have confidence that the materials we have already produced are high-quality, we cannot prove it. Rigor is part of our DNA, and the absence of systematic efficacy tests demonstrating tools’ contribution to improved teacher practice has made us hesitant to dramatically expand IES-branded resources.

To their credit, several organizations have stepped in to address the “last mile problem” between Practice Guides and classroom practice. Some, like RELs, are IES partners. As a result, we have seen a small number of Practice Guides turned in to professional learning community guides, massively on-line open courses, and other teacher-facing resources. Despite these efforts, similar resources have not been developed for the overwhelming majority of Practice Guides. This means many of our Guides and the dozens of recommendations for evidence-based practice they contain are languishing underused on IES’s virtual bookshelf.

An idea. IES should “back” the systematic transformation of Practice Guide recommendations from words on a page to high-quality materials that support teachers’ use of evidence-based practices in their classrooms. And because we should demonstrate our own practice works, those materials should be tested for efficacy.

From my perspective, RELs are well-suited to this task. This work unambiguously aligns with RELs’ purpose, which is to improve student achievement using scientifically-valid research. It also leverages RELs’ unique value proposition among federal technical assistance providers: the capacity to conduct rigorous research and development activities in partnership with state and local educators. If RELs took on a greater role in supporting Practice Guides in the next REL cycle—which runs from 2022 until 2027—what might it look like in practice?

One model involves RELs collaborating with state and/or district partners to design, pilot, and test a coherent set of resources (a “toolkit”) that help educators bring Practice Guide recommendations to life in the classroom. Potential products might include rubrics to audit current policy or practice, videos of high-quality instructional practice, sample classroom materials, or professional learning community facilitation guides, each linked to one or more Practice Guide recommendations.

Long-time followers of the WWC may recognize the design aspect of this work as similar to the defunct Doing What Works Program. The difference? New resources would not only be developed in collaboration with educators, they must be piloted and tested with them as well. It’s simple, really: if we expect educators to use evidence-based practices in the classroom, we need evidence-based tools to help teachers succeed when implementing them.  

Once vetted, materials must get into the hands of educators who need them. It’s here where the value of the REL-Comprehensive Center partnership becomes clear. With a mission of supporting each state education agency in its school improvement efforts, Regional Comprehensive Centers are in the ideal position to bring resources and implementation supports to state and local education leaders that meet their unique needs. Tools that are developed, piloted, and refined by a REL and educators in a single state can then be disseminated by the national network of Comprehensive Centers to meet other states’ needs.

Extensions. It isn’t hard to imagine other activities that the WWC, RELs, and Comprehensive Centers might take on to maximize this model’s potential effectiveness. Most hinge on building effective feedback loops.

Promoting continuous improvement of Practice Guide resources is an obvious example. RELs could and should be in the business of following Comprehensive Centers as they work with states and districts to implement REL-developed Practice Guide supports, looking for ways to maximize their effectiveness. Similarly, Comprehensive Centers and RELs should be regularly communicating with one another about needs-sensing, identifying areas where support for evidence-based practice is lacking and determining which partners to involve in the solution. When there is a growing body of evidence to support educator best practice, the WWC is in the best position to take the lead and develop a new Practice Guide. When that body of evidence does not exist yet—or when even the practices themselves are underdeveloped—the RELs and other parts of IES, such as the National Centers for Education and Special Education Research, should step in.  

Questions. When the WWC releases a new Practice Guide, its work may be done—at least temporarily. The work of its partners to support take-up of a Guide’s recommendations will, however, have just begun. I’d appreciate your thoughts on how to best accomplish that transition, and offer up the following additional questions for your consideration:

1. Are we thinking about the problem correctly, and in a helpful way? Are there elements of the problem that should be redefined, and would that lead us to different solutions?

2. What parts of the problem does this proposed solution address well, and where are its shortcomings? Are there other solutions—even solutions that don’t seem to fit squarely within today’s model of the REL Program—that might be more effective?

3. If we proceed under a model like that which is described above:

1. What sort of REL partnership models would be most effective in supporting the conceptualization, design, piloting, and testing of teacher-facing “toolkits” aligned to WWC Practice Guides?

2. What research and evaluation activities—and which outcome measures—should be incorporated into this activity to give IES confidence that the resulting “toolkits” are likely to be associated with changed teacher practice and improved student outcomes?

3. How does the 5-year limit on REL contracts affect the feasibility of this idea, including its scope and cost? What could be accomplished in 5 years, and what might take longer to see to completion?

4. How could RELs leverage existing ED-sponsored content, such as that created by Doing What Works, in service of this new effort?

If you have thoughts on these questions or other feedback you would like to share, please e-mail me. I can be reached directly at matthew.soldner@ed.gov. Thanks in advance for the consideration!

by Matthew Soldner, NCEE Commissioner 

On August 27, 2019, NASA launched a national contest for Kindergarten to Grade 12 students to name the Mars 2020 rover, the newest robotic scientist to be sent to Mars.  Scheduled to launch aboard a rocket in July 2020 from Cape Canaveral Air Force Station in Florida and touch down on Mars in February 2021, the to-be-named rover weighs more than 2,300 pounds (1,000 kilograms) and will search for astrobiological signs of past microbial life, characterize the planet’s climate and geology, collect samples for future return to Earth, and pave the way for human exploration of the Red Planet.

By focusing the Mars 2020 “Name the Rover” contest on K to 12 students, NASA seeks to engage U.S. students in the engineering and scientific work that makes Mars exploration possible. The contest also supports national goals to stimulate interest in science, technology, engineering, and mathematics (STEM) and help create the next generation of STEM leaders.

Students can sign up and submit their entries for the competition at https://www.futureengineers.org/nametherover. Entries must include a proposed name for the rover and a short essay of 150 words or less explaining the reasons for the name. NASA will select 156 state winners (one from each state and age group), before narrowing down to the top 9 entries that will be part of a public poll. The grand prize winner who will name the rover will be selected and announced in spring of 2020.

Even if you are not a student you can still participate. US residents over the age of 18 can apply to be judges for the contest to help NASA make their selection.

The Mars 2020 Project at NASA’s Jet Propulsion Laboratory manages rover development for NASA’s Science Mission Directorate. NASA’s Launch Services Program, based at the agency’s Kennedy Space Center in Florida, is responsible for launch management.

NASA Partners with an ED/IES SBIR Awardee to Run the Contest

The education technology firm that NASA selected to help run the competition is Burbank, California-based, Future Engineers.  The “Name the Rover” contest leverages Future Engineers’ online challenge platform, which was developed with the support of a 2017 award from the US Department of Education and Institute of Education Sciences’ Small Business Innovation Research program (ED/IES SBIR).  The platform will receive, manage, display, and judge what is anticipated to be tens of thousands or more student submissions from around the country.

Future Engineers has a history of collaborating on space-themed student challenges. The company previously ran a national competition series in 2018 for the ASME Foundation with technical assistance from NASA, where K-12 students submitted digital designs of useful objects that could be 3D printed on the International Space Station, resulting in the first student-designed 3D print in space.

Future Engineers developed its platform to be an online hub for classrooms and educators to access free, project-based STEM activities, and to provide a portal where students submit and compete in different kinds of maker and innovation challenges across the country. The Mars 2020 “Name the Rover” contest will be the first naming challenge issued on its platform.

We look forward to the results of the competition!

Originally posted on the U.S. Department of Education’s Homeroom blog.

Edward Metz is a research scientist at the Institute of Education Sciences in the US Department of Education.

Bob Collom is an integration lead in the Mars Exploration Program at NASA Headquarters.

About ED/IES SBIR

The U.S. Department of Education’s Small Business Innovation Research program, administered by the Institute of Education Sciences (IES), funds projects to develop education technology products designed to support students, teachers, or administrators in general or special education. The program emphasizes rigorous and relevant research to inform iterative development and to evaluate whether fully-developed products show promise for leading to the intended outcomes. The program also focuses on commercialization once the award period ends so that products can reach students and teachers and be sustained over time. ED/IES SBIR-supported products are currently used by millions of students in thousands of schools around the country.

About NASA’s Mars Exploration Program (MEP)

NASA’s Mars Exploration Program (MEP) in the Planetary Science Division is a science-driven program that seeks to understand whether Mars was, is, or can be, a habitable world. To find out, we need to understand how geologic, climatic, and other processes have worked to shape Mars and its environment over time, as well as how they interact today. To that end, all of our future missions will be driven by rigorous scientific questions that will continuously evolve as we make new discoveries. MEP continues to explore Mars and to provide a continuous flow of scientific information and discovery through a carefully selected series of robotic orbiters, landers and mobile laboratories interconnected by a high-bandwidth Mars/Earth communications network.

Over the summer, researchers, technologists, and policymakers gathered in Accra, Ghana for the Association for Computing Machinery’s Conference on Computing and Sustainable Societies (ACM COMPASS) to discuss the role of information technologies in international development.

Two IES-funded researchers from Carnegie Mellon University’s Program in Interdisciplinary Education Research, Michael Madaio and Dr. Amy Ogan, shared their research on developing voice-based early literacy technologies and evaluating their efficacy with low-literate, bilingual families in the Ivory Coast. 

Their research draws on methods from human-computer interaction, the learning sciences, and information-communication technology for development, to design educational technologies that are culturally and contextually appropriate.

Although the COMPASS conference focused on cross-cultural applications and technology for development, the research presented has implications for U.S. based education researchers, practitioners, and policymakers.

For instance, while research provides evidence for the importance of parental involvement in early literacy, parents with low literacy in the target language – as in many bilingual immigrant communities in the U.S. – may not be able to support their children with the explicit, instrumental help suggested by prior research (for example, letter naming or bookreading). This suggests that there may be opportunities for technology to scaffold low-literate or English Learners (EL) parental support in other ways.

At the conference, researchers described interactive voice-based systems (known as “IVR”) that help low-literate users find out about crop yields, understand local government policies, and engage on social media.  

This body of work has implications for designers of learning technologies in the U.S. Many families may not have a smartphone, but basic feature phones are ubiquitous worldwide, including in low-income, immigrant communities in the U.S. Thus, designers of learning technologies may consider designing SMS- or voice-based (such as IVR) systems, while schools or school districts may consider how to use voice-based systems to engage low-literate or EL families who may not have a smartphone or who may not be able to read SMS information messages.

In a rapidly changing, increasingly globalized world, research at IES may benefit from increased international engagement with international research, both focusing specifically on education, as well as information technology research that has implications for educational research, practice, and policy.

This guest blog was written by Michael Madaio. He is an IES Predoctoral Fellow in the Program in Interdisciplinary Education Research at Carnegie Mellon University. He is placed in the Human-Computer Interaction Institute.

About 1 in 5 school-age children experience serious mental health issues yet few receive services. In rural schools, geographic isolation and limited resources make receiving services even more difficult. The IES-funded National Center for Rural School Mental Health is addressing this challenge.

The 5 year, $10 million National R&D Center is supporting partnerships with a wide variety of rural school districts in three states (Missouri, Virginia, and Montana) to develop and test ways to support the mental health needs of their students. I recently spoke with Dr. Wendy Reinke, the Center’s director, about the unique mental health needs in the rural settings where the center is working and how she and her colleagues are approaching this work.  

Tell us a little bit about the rural communities you are partnering with in Missouri, Virginia, and Montana.

Each state provides a unique geological context that we anticipate will inform the tools and interventions we are developing for wide use in rural schools. For instance, Missouri sits in the middle of the country where half of the school districts are considered rural and another third or so are considered small towns. Virginia encompasses central Appalachia which struggles with issues of under-employment, mental health, and school dropout. In the northwest, rural residents are scattered across Montana’s 56 counties, 30 of which are classified as “frontier” counties with three or fewer persons per square mile.  The tools and interventions we develop will need to be feasible and effective across these very different contexts.

What are the most common mental health challenges being faced in the different rural communities you are partnering with?

Part of the work of the Rural Mental Health Center will be learning more about the types of  mental health challenges faced by rural communities. From my current work in Missouri’s rural schools, common areas of concern include youth with depression, anxiety, conduct problems, substance abuse, and suicidality.  Identifying youth early can help to prevent or reduce the burden of these problems.  Accordingly, we plan to not only offer interventions for youth facing mental health challenges but work with schools to prevent and identify early, youth who would benefit from supports.

The work you have planned for the center builds on prior IES-funded work. Tell us more about how this work provides a foundation for launching the work of the center.

A cornerstone of the Center is the use of an assessment tool that will allow schools to gather data to determine their needs for school-level prevention, group-based interventions, and individualized interventions.  This tool was developed in partnership with six school districts (five of which are rural) and University of Missouri researchers.  Through the IES partnership grant we were able to validate the measure and gather stakeholder input to improve the tool and the overall intervention model.  These data collected using this tool will be linked to evidence-based interventions, several of which have been developed and evaluated through IES funding.  It is very exciting to have the opportunity to pull all of these projects together to support our rural schools.

Much of your earlier research has been done in urban school districts. How did you become interested in research with rural schools? What would you recommend to other researchers interested in doing research with rural schools?

I grew up and attended school in a rural coal-mining town in Pennsylvania. When I moved to Missouri, I had access and opportunity in working alongside rural school districts.  One recommendation, which I think goes for research in any schools, is to operate as a partner with them. For instance, the six school districts we worked with formed a Coalition, and we include the Coalition as co-authors on any publication or presentation that comes from this work.  Further, we present with partners at conferences and report back findings to the community.  I think an open and collaborative relationship gains trust, allowing for additional opportunities to conduct research alongside our school partners. Additionally, our ideas for studies are nearly always driven by the needs expressed by our schools based on the pressing challenges they report to us.

The Center also has a policy focus with work that will be led by your Montana partners. Tell us more about this aspect of the Center’s work and the types of policy issues the Center will address.

We will be working with rural school district partners across the three states to identify important issues facing rural schools.  Dr. Ryan Tolleson-Knee from the University of Montana will be leading this initiative.  At the Center kick-off meeting held in June, a subgroup of rural school partners interested in policy was formed.  The plan is for this subgroup to develop a toolkit that can be readily used by public school personnel and state and national policymakers to improve outcomes for youth.  One topic of interest is how might rural school districts partner with one another (similar to the Coalition described earlier) to maximize and share resources across the communities.  Over the next five years, the toolkit will expand and connect to issues faced by our rural schools.

Written by Emily Doolittle, NCER Team Lead for Social Behavioral Research

Across the United States, parents have an increasing number of educational options for their children, including traditional public schools, public charter schools, private schools, and homeschooling. Although the majority of students attend traditional public schools, the numbers of students attending public charter schools or homeschool programs are growing, according to recently released data.

Using survey data from the National Center for Education Statistics (NCES), the newly released School Choice in the United States: 2019 report provides information on student enrollment; individual, family, and school characteristics of students enrolled in different educational settings; achievement; school crime and safety; and differences in the school choice options that parents select and their satisfaction with their children’s school.

School Enrollment Trends

Over time, the numbers of students enrolled in traditional public schools, public charter schools, and homeschool programs have increased (see figure 1). Enrollment in traditional public schools was 1 percent higher in fall 2016 (47.3 million) than in fall 2000 (46.6 million). 

Public charter schools grew at a much more rapid rate in that time, with enrollment increasing by more than 500 percent, from 0.4 million in fall 2000 to 3.0 million in fall 2016. Enrollment in homeschool programs has also grown, nearly doubling from 1999 (0.9 million) to 2016 (1.7 million). However, private school enrollment fell 4 percent between fall 1999 and fall 2015.

Figure 1. Enrollment in traditional public schools, public charter schools, private schools, and homeschooling

SOURCE: U.S. Department of Education, National Center for Education Statistics, Common Core of Data (CCD), “Public Elementary/Secondary School Universe Survey,” 2000–01 and 2016–17; Private School Universe Survey (PSS), 1999–2000 and 2015–16; Parent Survey and Parent and Family Involvement in Education Survey of the National Household Education Surveys Program (Parent-NHES:1999 and PFI-NHES:2016).

Student and School Characteristics

This report also explores enrollment in different school options across a range of characteristics, including students’ racial/ethnic background (see figure 2), family composition, household poverty status, parent education and employment, and more.

For example, public schools enrolled higher percentages of Black and Hispanic students than did private schools in fall 2015. Within the public school sector, public charter schools enrolled higher percentages of Black and Hispanic students and lower percentages of White and Asian/Pacific Islander students than did traditional public schools in fall 2016. And, the percentages of students who were homeschooled in 2016 were higher for White and Hispanic students than for Black and Asian students.

Figure 2. Percentage distribution of elementary and secondary enrollment, by school type and student race/ethnicity: 2015 and 2016
 

#Rounds to zero.
NOTE: Figure excludes homeschooled children. Race categories exclude persons of Hispanic ethnicity. Although rounded numbers are displayed, the figures are based on unrounded data. Detail may not sum to totals because of rounding.
SOURCE: U.S. Department of Education, National Center for Education Statistics, Private School Universe Survey (PSS), 2015–16; and Common Core of Data (CCD), "Public Elementary/Secondary School Universe Survey," 2016–17.

In 2016, about 58 percent of public charter school students were enrolled in schools in cities, compared with 29 percent of traditional public school students; traditional public school students were more likely than public charter school students to attend schools in suburban areas, towns, and rural areas.

In 2015, about 43 percent of private school students were enrolled in schools in cities, and 40 percent were enrolled in schools in suburban areas. However, homeschooling in 2016 was more prevalent among students in rural areas than among those in cities and suburban areas.

Parental Choice

In 2016, parents whose children were enrolled in public or private schools were asked about their decisions regarding school choice. Twenty-eight percent of students had parents who reported that they had considered schools other than the one in which their children were currently enrolled, and 80 percent had parents who reported that their children’s current school was their first choice. Among public school students, 20 percent had parents who reported they moved to their current neighborhood so their children could attend their current public school.

Each of these percentages was higher for students from nonpoor households than for students from near-poor or poor households (see figure 3). For example, 31 percent of students in nonpoor households had parents who reported that they considered other schools for their children, compared with 23 percent of students in near-poor households and 21 percent of students in poor households.

Figure 3. Percentage of students enrolled in grades 1 through 12 whose parents considered other schools, reported current school was their first choice, or moved to their current neighborhood for the public school, by family poverty status: 2016

¹ Includes public school students only. Private school students are excluded.
NOTE: Data exclude homeschooled children.
SOURCE: U.S. Department of Education, National Center for Education Statistics, Parent and Family Involvement Survey of the National Household Education Surveys Program (PFI-NCES:2016).

Browse the full School Choice in the United States: 2019 report to learn more about these and other trends related to school choice and student enrollment.

By Amy Rathbun and Ke Wang, AIR