IES Blog

Institute of Education Sciences

#IES2016: The IES Year in Review

By Ruth Curran Neild, Delegated Director, IES

2016 was a busy year for the Institute of Education Sciences (IES) as we continued our commitment to support a culture of evidence-use in education. Among our work over the past 12 months:

  • We released more than 200 publications, including statistical reports and data collections, research findings and compendia, program evaluations, intervention reports, educator’s practice guides  and more;
  • We made significant improvements to our communications and dissemination efforts, including a new IES website, an improved What Works Clearinghouse site, videos about our work and the launch of IES and NCES Facebook pages. We also published 80 blogs focused on our work and our mission;  
  • We launched tools, like RCT-YES and  Find What Works, that make it easier to conduct, report, and find research;
  • We awarded more than $200 million in research grants and funding across a wide variety of topics, including:
    • More than $150 million in grants from the National Center for Education Research;
    • More than $70 million in grants from the National Center for Special Education Research; and
    • About $5.75 million in funding for the development of education technology through the ED/IES Small Business Innovation Research program.

At the end of the year, we shared a small portion of our 2016 work on Twitter using the hashtag #IES2016. If you weren’t following Twitter over the holidays, we created a Storify of those tweets, which we’ve embedded below.  Also, check out the What Works Clearinghouse (WWC) Year in Review website for an overview of the WWC’s work in 2016.

 

 

Persistence Pays Off: Introducing the New WWC Website

By Ruth Curran Neild, Delegated Director, IES

Stick with it, teachers tell their students.  Don’t give up when the going gets tough. Important work is often difficult. Keep at it.

More than a decade ago, it took this kind of dogged determination to launch an entity that would review education research against rigorous standards—the What Works Clearinghouse (WWC).   There were some skeptics, but also many supporters. And year after year, the WWC persisted, building out new topic areas, adding systematic reviews and practice guides, and identifying more interventions with positive effects on student outcomes.

Over time, WWC standards began to influence the field, with researchers designing studies that would meet its rigorous expectations. At the same time, researchers provided input that helped us improve WWC and its standards. Now, there are about 1,000 effectiveness studies available that meet our high bar for research design.  

By 2014, there was so much content in the WWC and so many people using the WWC website that it was time to retool our online presence and make our resources easier to find.

So IES staff and WWC contractors undertook an extensive project to create a more flexible database and intuitive search engine that meets a variety of user needs. A new relational database was built from the ground up, using study review data previously kept in thousands of different spreadsheets. Focus groups and user testing allowed us to identify the most important functionalities and best design features.

After more than two years of work, we launched the new WWC website today (Sept. 13), with a much-improved Find What Works feature that makes it easier to identify interventions, programs, and policies have improved student outcomes. (The video below can help you learn how to navigate the new site). The new WWC site has something for all types of users:

Do you want just top-level information about a program’s effects?  We can give you that.

Do you want to dig into the details of a particular study, including outcome domains, population, geographic context, and implementation?  We can give you that, too.

Do you want a quick assessment of whether a study was conducted with students like yours?  Find What Works can do that.

Do you want an easy way to compare the research on interventions?  Yes, absolutely – that’s a new feature.  

Do you want to see a list of randomized controlled trials (RCTs) that meet WWC standards and found at least one statistically significant positive effect?  No problem.

This is a proud day indeed for the What Works Clearinghouse, but there’s more to come.  We are always working on new resources for our users. In the next few months, look for a new practice guide on teaching writing in grades 6-12, as well as online WWC reviewer training, which we hope will help to meet the high demand for this credential. And we are continuing to expand our topic areas, including reviews of studies of postsecondary education programs to identify those that are showing promise for improving student outcomes.  

A lot of hard work and persistence went into this project from many people, including IES staff and the teams from Mathematica Policy Research and Sanametrix that worked on the site. I want to say “thank you” to them all. I also want to thank the many people who have been a part of the WWC over the years; including IES team members, study reviewers, and contractors. They have helped get us to this point today.  

Most of all, I want to thank the hundreds of thousands of educators, researchers, and decision makers who visit and use the WWC each year. We are glad that the What Works Clearinghouse has been a part of your work and hope it will continue to be a go-to resource for many years to come. 

 

Five ED/IES SBIR Companies Win National Industry Awards for Innovation

The U.S. Department of Education’s Small Business Innovation Research (SBIR) program at the Institute of Education Sciences (ED/IES SBIR) has served as a catalyst for the research and development of innovative technology that seeks to transform how and where students learn.

In 2016, the program continues to be recognized for spurring innovation, with five companies winning national awards and recognition for their ED/IES SBIR-developed technologies.

In June, Strange Loop Games’ Eco won the Climate Change Challenge at the Games for Change Festival in New York City. Eco is a multi-player environment where students collectively work to build a virtual ecosystem. The game provides students the opportunity to see how individual and collective decisions and actions affect their environment and climate.

In May, mtelegence’s Readorium won the Best Reading/English/Language Arts Solution through the Software & Information Industry Association’s (SIIA) CODiE program. Readorium is a web-based intervention that provides engaging content and games to middle school students to improve reading comprehension of science content.

Science4us, in May, won the best Science Instructional Solution through the SIIA CODiE program, and won THE Best Science Program through the BESSIE awards in April. Science4Us is a web-based game and simulation platform that provides foundational science learning opportunities for students in Kindergarten through Grade 2.

Also in May, Electric Funstuff’s Mission US won the Website Gold from the Parents' Choice Awards. In 2016, Mission US was a finalist for three other awards, including Best Learning Game at Games For Change, Outstanding Interactive Series through the Daytime Emmy Awards, and Best Web Game through the Webby Awards.  Mission US, which is partially funded by ED/IES SBIR, is a series of tablet-based interactive role-playing game that immerses 5th through 9th grade students in history.

In February, Querium was recognized as one of the 10 Most Innovative Education Technology Companies of 2016 by Fast Company Magazine. Querium is developing the Stepwise Virtual Tutor, which is a mobile and desktop virtual tutor that provides real-time assessments and support to middle and high school students in Algebra.

For information on more ED/IES SBIR supported companies that have won awards and been recognized for innovation in technology, check out the program’s News Archive. Stay tuned for updates on ED/IES SBIR on Twitter and Facebook.

About ED/IES SBIR: The Small Business Innovation Research program at the Department of Education’s Institute of Education Sciences funds firms and partners to develop commercially viable technology products to improve student learning or teacher practice in regular and special education.  ED/IES SBIR emphasizes rigorous research to inform the development process and to evaluate whether products show promise for delivering on the intended outcomes.

Spend Five Minutes Getting to Know IES

By Dana Tofig, Communications Director, IES
 
At the Institute of Education Sciences, we sometimes describe ourselves as the country’s “engine” that powers high-quality education statistics, research, and evaluation, or as the “infrastructure” that supports a steady supply of scientific evidence in education.  
 
But many users of IES resources are familiar with just a small slice of what we sponsor to provide quality evidence in education and support for its use across the country. While they may have heard of the National Assessment of Educational Progress (NAEP), the What Works Clearinghouse, or the ERIC database of research, studies, and periodicals, they may not know that all those programs, and many more, are housed under one roof at IES. 
 
To help people better understand our work and see how it is connected, we have developed a new video that gives an overview of IES and the six broad types of work that we do.  The video runs just under five minutes, so it doesn’t touch on everything, but it does give a good introduction to IES and our work to connect research to practice. 
 

Please share the video with friends and colleagues who might be interested in the work of IES. In the coming months, we will release additional videos that delve further into each of our focus areas.
 
This video is part of our ongoing efforts to ramp up our communication and dissemination efforts, including the launch of a new, mobile friendly website design and an IES Facebook page where you can get information about the latest reports, resources, and grant opportunities. In the fall, IES will also launch a new What Works Clearinghouse website, which will include an improved "Find What Works" tool. This will make it easier for educators to search for and compare the research about the effectiveness of interventions in education.
 
We are here to serve the public – and we always want to get better at what we do! If you have thoughts or ideas for how we can improve our communication and dissemination efforts, please send an email to dana.tofig@ed.gov.

RCT-YES: Supporting a Culture of Research Use in Education

By Ruth Curran Neild, Delegated Director, IES

The mission of the Institute of Education Sciences (IES), at its core, is to create a culture in which independent, rigorous research and statistics are used to improve education. But sometimes research is seen by practitioners and policymakers as something that is done for them or to them, but not by them. And that’s something we’re hoping to change.

IES is always looking for new ways to involve educators in producing and learning about high-quality, useful research. We believe that if state and school district staff see themselves as full participants in scientific investigation, they will be more likely to make research a part of their routine practice. Simply put, we want to make it easier for educators to learn what works in their context and to contribute to the general knowledge of effective practices in education.    

That’s why we’re so pleased to add the RCT-YESTM software to the IES-funded toolkit of free, user-friendly resources for conducting research. Peter Schochet of Mathematica Policy Research, Inc. led the development of the software, as part of a contract with IES held by Decision Information Resources, Inc.

RCT-YES has a straightforward interface that allows the user to specify the analyses for data from a randomized controlled trial (RCT) or a quasi-experiment. Definitions and tips in the software help guide the user and accompanying documentation includes a mini-course on RCTs. When the user enters information about the data set and study design, RCT-YES produces a program to run the specified analyses (in either R or Stata) and provide a set of formatted tables.

The target users are those who have a basic knowledge of statistics and research design but do not have advanced training in conducting or analyzing data from impact studies. But we expect that even experienced researchers will like the simplicity and convenience of RCT-YES and benefit from some of its novel features, such as how it reports results.

When used properly, RCT-YES provides all of the statistics needed by the What Works ClearinghouseTM (WWC) to conduct a study review.  This is an important feature because the WWC often needs to contact authors—even experienced ones—to obtain additional statistics to make a determination of study quality.  RCT-YES could help advance the field by increasing the completeness of study reports.

Another unique feature of the software is that it defaults to practices recommended by IES’ National Center for Education Statistics for the protection of personally identifiable information. For example, the program suppresses reporting on small-size subgroups.

While the user sees only the simplicity of the interface, the underlying estimation methods and code required painstaking and sophisticated work.  RCT-YES relies on design-based estimation methods, and the development, articulation, peer review, and publication of this approach in the context of RCT-YES was the first careful step. Design-based methods make fewer assumptions about the statistical model than methods traditionally used in education (such as hierarchical linear modeling), making this approach especially appropriate for software designed with educators in mind.

The software is available for download from the RCT-YES website, where you can also find support videos, documentation, a user guide, and links to other helpful resources. The videos below, which are also hosted on the RCT-YES website, give a quick overview of the software.

There are many other ways that IES fosters a culture of research use in education. For instance, our 10 Regional Educational Laboratories (RELs) have research alliances that work with states and districts to develop research agendas. The RELs also host events to share best practices for putting research into action, such as the year-long series of webinars and training sessions on building, implementing, and effectively using Early Warning Systems to reduce dropping out.

IES also offers grants to states and districts to do quick evaluations of programs and policies that have been implemented in their schools. The low-cost, short-duration evaluations not only help the grantees discover what is working, but can help others who might use the same program or implement a similar policy. (We’ll announce the first round of grant recipients in the coming weeks).

Visit the IES website to learn more about our work. You can also stay on top of news and information from IES by following us on Facebook and Twitter