Inside IES Research

Notes from NCER & NCSER

Join us for IES Innovation Day at the 2023 ED Games Expo

For the first time, IES is hosting IES Innovation Day as part of the 9th annual ED Games Expo. This full day event of engaging panel sessions, taking place Thursday, September 21, 2023, from 9:00 AM to 3:15 PM, will highlight IES’s investments in advanced research and development. The day will feature—

  • Lightning talks from IES-funded project teams who have developed and conducted research on education technology (EdTech) innovations
  • Sessions on modernizing the research and development infrastructure and preparing to scale evidence-based products
  • Demos of IES-funded EdTech products
  • An afternoon session with IES Director Mark Schneider focused on the Institute’s vision for achieving transformative impact at scale
  • Remarks by the White House Office of Science and Technology Policy Director, Arati Prabhakar

IES Innovation Day is one of the many events taking place at the 2023 ED Games Expo this September 19-22 at the Kennedy Center REACH and at locations across Washington, DC. The ED Games Expo is the public showcase of game changing EdTech innovations created through more than 50 programs at the IES, the U.S. Department of Education, and across government. This multi-day event engages a broad audience, including EdTech developers and researchers, organizations across the education ecosystem, students and educators, members of the public including families and children, and representatives and leaders from Federal agencies and offices.

Register to attend these free events:

Can’t make it to the Expo in-person? Join through a livestreamed Science is Cool virtual event on Thursday, September 21 from 12:00 PM to 5:00 PM Eastern Time. Speakers at the virtual event will include EdTech developers and STEM education experts who will discuss their classroom interventions and share how they used art and design in creating them.

ED/IES SBIR: Advancing Research to Practice at Scale in Education

This image depicts a young girl with headphones holding onto a mic that is attached.

The Department of Education and Institute of Education Sciences Small Business Innovation Research Program (known as ED/IES SBIR), funds projects to develop and evaluate new education technology products that ready to be widely deployed to address pressing educational needs.

In advance of IES Innovation Day at the ED Games Expo on September 21, 2023 at the Kennedy Center REACH in Washington, DC, this blog features a series of ED/IES SBIR awards that were funded for the purpose of creating education technology to ready previously funded evidence-based products for use at scale. Two of the projects highlighted below, one led by Jay Connor of Learning Ovations and the other by Clark McKown of xSEL Labs, will be featured as part of panels. This event is open to the public. Register for the Expo here.


Over its 20-year history, ED/IES SBIR has been well known for stimulating pioneering firms, such as Filament Games, Future EngineersPocketLab, and Schell Games, to create entrepreneurial and novel education technology products. ED/IES SBIR has also established a track record for investing in a different set of projects—ones that facilitate the uptake of innovations originally developed in university or laboratory settings. This is important because even when researcher-developed innovations (for example, models, programs, and tools) are shown to have evidence for impact, many are not delivered at scale, preventing learners from fully benefiting from these innovations.

Examples of ED/IES SBIR Research to Practice Projects

Over the past two decades, ED/IES SBIR projects have provided useful models for how researchers can navigate and overcome the research-to-practice gap. ED/IES SBIR has made several awards to projects that were originally researcher-initiated, many through IES research grants. These researchers either founded a small business or partnered with an existing small business to develop and commercialize new education technology products to advance research to practice at scale in education.

The short descriptions of these projects below include links to IES website pages with additional information on the unique project models. These projects converted findings from research into scalable, education technology delivered interventions, added new components to existing research-based prototypes to enable feasible implementation and to improve the user experience, and upgraded technology systems to handle large numbers of users across numerous sites.

  • Learning Ovations: Through a series of IES and NIH funded research, Dr. Carol Connor led an academic team to develop a personalized early learning assessment, the A2i, and demonstrated its efficacy for improving literacy outcomes through multiple trials. To ready the A2i for use in larger numbers of settings and to improve data processing and reporting, Learning Ovations won an ED/IES SBIR award to upgrade the underlying data architecture and create automated supports and functionalities. In 2022, Scholastic acquired Learning Ovations, with plans for the A2i to be integrated into its suite of products. See the Learning Ovations Success Story for more information.
  • Mindset Works: Through an IES research grant in 2002 and with funding from other sources, Dr. Carol Dweck led a research team to develop the concept of the growth mindset—the understanding that ability and intelligence can develop with effort and learning. Lisa Blackwell, a member of the research team, founded Mindset Works and won a 2010 ED/IES SBIR award to develop training modules and animated lessons to deploy this instructional model through a multi-media website. A research grant funded in 2015 tested and demonstrated the efficacy of the technology-delivered Growth Mindset Intervention to improve outcomes of struggling learners. See the Mindset Works Success Story for more information.
  • Nimble Assessment Systems: Through IES and other grants, Dr. Michael Russell led team of researchers to conducted foundational research and develop and validation of new forms of assessment. Informed by this research, Nimble Assessment Systems developed NimbleTools with an award from a ED/IES SBIR, a set of universally designed accommodation tools to improve accessibility of assessments for students with disabilities. Measured Progress acquired Nimble Assessment Systems, and the product was integrated into its suite of products for state and district assessments. See the Nimble Tools Success Story for more information.
  • Children’s Progress: Through NIH grants, Dr. Eugene Galanter led a research team to create a computer-based assessment that adapted to how a student responded to each question and delivered individualized narratives for each student. With awards from NIH SBIR and ED/IES SBIR, Children’s Progress developed a commercial version of the computer-adaptive dynamic assessment (CPAA) for early childhood in literacy and math. In 2012, Northwest Evaluation Association (NWEA) acquired Children’s Progress, with the assessment technology incorporated into the NWEA’s assessment platform and used at scale. See the Children’s Progress Success Story for more information.
  • Teachley: Through IES and NSF funded research, Dr. Herb Ginsburg led an academic team to develop prototype software programs for children from preschool to grade 3 to practice mathematics. In 2011, three members of the research team founded a small business, Teachley, which won ED/IES SBIR awards to extend the research model into easily playable, engaging, and widely used math game apps. See the Teachley Success Story for more information.
  • Analytic Measures: With funding from IES, Dr. Jaren Bernstein led a research team to develop prototypes of automated oral reading fluency assessments that were administered to students during the NAEP and other national assessments by IES’s National Center for Education Statistics. Analytic Measures won ED/IES SBIR awards (here and here) to develop the school-ready version of these assessments. In 2022, Google acquired the intellectual property of the assessments with plans to incorporate the tools into its suite of products for education. See this Analytic Measures Success Story more information.
  • Lightning Squad: Through awards from ED’s Office of Education Research and Improvement (now IES) and the Office of Elementary and Secondary Education, Drs. Nancy Madden and Bob Slavin led a research team to develop a model to make tutoring more cost-effective. With awards from ED/IES SBIR, Sirius Thinking partnered with Success For All to develop a mixed online and face-to-face multimedia intervention for struggling readers in grades 1 to 3. The program is now in wide-scale use in schools and in tutoring programs. See the Lightning Squad Success Story for more information.
  • Apprendis: With research grants from IES and other sources, Dr. Janice Gobert led teams at Worcester Polytechnic Institute and Rutgers University to develop and evaluated Inq-ITS (Inquiry Intelligent Tutoring System) virtual labs for students in grades 4 to 10. Apprendis was founded in order to commercialize InqITS and won an ED/IES SBIR award to develop a teacher alert system that generates real-time insights to inform instruction. InqITS is currently in wide-scale use.
  • Common Ground Publishing: Through IES and other grants, Drs. Bill Cope and Mary Kalantzis led a team of researchers to conduct research on new forms of technology-delivered formative assessment for student writing. A technology-based company spun out of a university tech-transfer office, Common Ground Publishing, and won ED/IES SBIR awards (here and here) to develop CGScholar based on this research. CGScholar is an AI-based digital media learning management system designed to support student writing, learning, and formative assessment, which has been in wide-scale use for several years.  See the CGScholar Success Story for more information.
  • xSEL Labs: With funding from IES, Dr. Clark McKown led a team led to develop screening assessments for social and emotional learning and conducted research to demonstrate the efficacy of the tool. xSEL Labs was founded to commercialize the assessments, and with an ED/IES SBIR award, is developing a platform to support educators and administrators using research-based SEL assessments. In 2023, 7 Mindsets acquired xSEL Labs was acquired to commercialize the platform at scale.

A New Program Area at ED/IES SBIR to Continue Advancing Research to Practice
With a history of awards to advance research to practice, ED/IES SBIR created a new program area in 2022 called Direct to Phase II to invest in more projects to develop commercially viable education technology products to ready existing evidence-based research for use at scale. The program resulted in one award (see here) in 2022. Please see the ED/IES SBIR solicitation page for information on the next opportunity for funding through its FY2024 program.


Stay tuned for updates on Twitter, Facebook, and LinkedIn as ED/IES SBIR continues to support projects to advance research to practice at scale.

Edward Metz (Edward.Metz@ed.govis a research scientist and the program manager for the Small Business Innovation Research Program at the US Department of Education’s Institute of Education Sciences.

 

The ED/IES SBIR 2021 Year in Review and a Look Ahead to 2022

The Department of Education’s Small Business Innovation Research Program (SBIR), administered by IES, provides awards for the research and development of new, commercially viable education technology products. Known as ED/IES SBIR, the program’s goal is to grow a portfolio of scalable, research-based products that address pressing needs across topic areas in education and special education.

From an education technology perspective, 2021 will surely be remembered as the “year after” the onset of the global pandemic—where demand for effective education tools and platforms skyrocketed and developers pivoted to meet the needs of the return to in-person and hybrid learning environments. Dozens of ED/IES SBIR-developers contributed to these efforts, with millions of students and educators using their products to support remote and in-person learning in 2021. This blog shares some highlights from the ED/IES SBIR program in 2021 and provides a preview of its recently released 2022 solicitations.

The ED Games Expo

IES hosted the 8th annual ED Games Expo virtually in June 2021 to provide resources to the public in response to pandemic-related challenges. As part of the virtual Expo, 170 IES- and government-supported education technology products were available at no cost to educators and students around the country. The Expo also presented 35 virtual events for the public that have been viewed more than 10,000 times on YouTube, highlighted by a Kick Off Show introduced by Secretary of Education Miguel Cardona and including master classes for educators and behind-the-sciences “how to” events for students. Dates for the next ED Games Expo will be announced soon.

New ED/IES SBIR Awards

ED/IES SBIR announced 29 new 2021 awards, including 18 for prototype development and 11 for full-scale education technology product development. The awards continue trends from recent years.

One exciting trend is the employment of advanced technologies such as artificial intelligence, machine learning, natural language processing, or algorithms to personalize student learning. Examples include projects by Myriad Sensors (Pocket Lab) to develop an AI engine to assess and provide feedback to students while doing physical science experiments, Analytic Measures Inc. (AMI) to create an natural language processing engine to recommend personalized practice activities based on a student’s level of oral reading fluency, and by KooApps and Kings Peak Technology to use machine learning to provide immediate vocabulary support to English learners.

Another trend in 2021 is the development of new products to scale existing IES-funded research. Projects that build on prior IES research include: Nimble Hiring to develop a platform to improve school district hiring and educator retention, xSEL Labs to create a platform for social and behavioral learning innovations, and Emberex to create a user interface with reporting and recommendation features to meet modern standards for a reading assessment.

ED/IES SBIR also continues to support projects in new areas. For example, three new projects are developing music-based technologies to support learning (Muzology, Edify, and Lyrics to Learn).

Highlights From Individual Projects in the Portfolio

Many ED/IES SBIR-supported companies enjoyed newsworthy successes in 2021.

ED/IES SBIR Releases Two 2022 Program Solicitations

On December 1, 2021, ED/IES SBIR released two new solicitations. Phase I solicitation #91990022R0001 is a request for proposals for $250,000 awards for 8 months for the research, development, and evaluation of new prototypes of education and special education technology products. Direct to Phase II solicitation #91990022R0002 is a request for proposals for $1,000,000 for 2 years for R&D and evaluation to develop new technology to prepare existing researcher-developed evidence-based innovations (products, interventions, practices) for use at scale, and to plan for commercialization. The goal is to support the successful transfer of research to practice at scale in education and special education. Proposals for both solicitations are due February 1, 2022.

Stay tuned for updates in 2022 on Twitter and Facebook as IES continues to support innovative forms of technology.


Edward Metz is a research scientist and the program manager for the Small Business Innovation Research Program at the US Department of Education’s Institute of Education Sciences. Please contact Edward.Metz@ed.gov with questions or for more information.

 

IES Supported Intervention “INSIGHTS Into Children’s Temperament” is Featured at the 2021 ED Games Expo

The ED Games Expo is an annual showcase of game-changing innovations in education technology developed through programs at ED and across the federal government. Since 2013, the Expo has been an in-person event at venues across Washington, D.C. Because of COVID-19, the 2021 Expo will be an entirely virtual experience from June 1 to 5.

This year, the Expo will showcase more than 160 learning games and technologies and feature 35 different virtual EdTech events of interest to a broad audience of viewers. See the Agenda for the lineup for the Ed Games Expo.

 

ED Games Expo: Featuring INSIGHTS into Children’s Temperament

INSIGHTS into Children’s Temperament, an IES-supported intervention, is being featured at the Expo this year. INSIGHTS supports children’s social-emotional development and academic learning by helping teachers and parents see how differences in children’s behavior might reflect temperament/personality. Children work with the INSIGHTS puppets and learn that other children and adults react differently to the same situation due to their temperaments. IES has supported two randomized controlled trials (RCTs, the “gold standard” for claims of impact) of INSIGHTS – one in New York City and the other (ongoing) in rural Nebraska. Evidence from the NYC RCT and a longitudinal follow up indicate that children who participate in the INSIGHTS program during early elementary school experience better academic and social behavioral outcomes immediately following participation in the program, and these positive impacts persist into middle school. 

 

During the 2020 ED Games Expo, Sandee McClowry and her team performed an INSIGHTS lesson at the Kennedy Center to hundreds of attendees, including children, students, and families. INSIGHTS will be featured in this year’s ED Games Expo in three ways.

  • Tuesday, June 1 at 8PM Eastern: There will be an “ED Games Expo Kick Off Show” hosted by the puppets from the INSIGHTS intervention and the characters from the Between the Lions children’s television program. All of the characters will share information about the ED Games Expo while having a lot of fun and hijinks on a road trip to Washington, DC.  The Show will be introduced by the Secretary of Education, Miguel Cardona, and will also feature cameo appearances by IES, ED, and government team members.
  • Wednesday, June 2 from 9PM to 9:45PM Eastern: Sandee McClowry will be hosting a Master Class for Educators. The event will introduce all of the INSIGHTS friends, including Coretta the Cautious, Gregory the Grumpy, Fredrico the Friendly, and Hilary the Hard Worker. The video will provide practical guidance to educators on how to deliver the intervention in a classroom. The event will conclude with a rich and engaging discussion with expert practitioners about how INSIGHTS addresses the social and emotional learning of children, educators, and parents. Click Here to access the YouTube broadcast of the Master Class and set a reminder to watch on June 1.
  • Materials from INSIGHTS, including puppets that can be printed out and professional development resources for educators, will be available to try out during the Expo and in the month of June.

 

For URL links to watch the ED Games Expo Kick Off Show and Master Class for Educators, See the Agenda. For more information and on how to access the resources INSIGHTS intervention, see the website.


Written by Emily Doolittle (Emily.Doolittle@ed.gov), NCER Team Lead for Social Behavioral Research at IES

 

Highlighting the Science of Learning at the 2021 ED Games Expo

Research on how people learn is critical for informing the design of effective education technology products. To design products that improve student learning, we need to understand how students approach solving problems, the information they need to adopt optimal solution strategies, the skills that underlie success in particular academic domains, the best ways to arrange information on a screen to guide student attention to relevant information, and the best study strategies for optimizing learning and retention. Through its research grants programs, IES has invested in research projects to develop and test education technology products based in the science of learning.

 

The 2021 ED Games Expo, which takes place virtually from June 1-5, features a number of these products, and you can learn more about them through a mix of live and pre-recorded sessions and videos. Most are ready to demo now. Students and educators can send questions about the research, game-play, or ed tech experience directly to the participating researchers. Here are just a few of the many ways you can interact with IES-funded researchers at the Expo:

 

  1. The Virtual Learning Lab (VLL) will be hosting a live, virtual session on Friday, June 4th from 4:00-5:30pm Eastern Time to celebrate their 5-year research collaboration to explore precision education in the context of algebra instruction. The VLL developed an AI-powered video recommendation system that personalizes math instruction within Math Nation. The researchers measured student ability and engagement, detected effects of virtual learning environment usage on achievement, and identified characteristics of effective online tutoring. The session will feature short talks and opportunities for Q&A: 
  • A Video Recommendation System for Algebra (Walter Leite, University of Florida)
  • Reinforcement Learning for Enhancing Collaborative Problem Solving (Guojing Zhou, University of Colorado Boulder)
  • Natural Language Processing for VLE Research (Danielle McNamara, Arizona State University)
  • Identifying Pedagogical Conversational Patterns in Online Algebra Learning (Jinnie Shin, University of Florida)
  • Scaling Items and Persons for Obtaining Ability Estimates in VLEs (A. Corinne Huggins-Manley, University of Florida)
  • Measuring Student Ability from Single- and Multiple-Attempt Practice Assessments in VLEs (Ziying Li, University of Florida)
  • Detecting Careless Responding to Assessment Items in VLEs (Sanaz Nazari, University of Florida)
  • Personalization, Content Exposure, and Fairness in Assessment (Daniel Katz, University of California, Santa Barbara)
  • Fair AI in VLEs (Chenglu Li, University of Florida)

 

  1. The ED Games Expo YouTube Playlist, which will be posted on June 1st on the event page, features 26 products developed with IES grant funding. For ed tech products informed by research on how people learn, check out the products funded through the Cognition and Student Learning topic:
  • Graspable Math allows math teachers to assign interactive algebra tasks and turns equations into tangible objects that middle school and high school students can manipulate to practice and explore. Teachers can follow live, step-by-step, student work.
  • eBravo Boulder Reading Intervention is a self-paced personalized reading comprehension curriculum that teaches secondary students the problem-solving skills good readers use to learn from challenging texts, in this case in the science discipline of ecology. Reading strategies and exercises are guided by well-researched models of reading comprehension, helping students build deep, durable, and reusable knowledge from text. 
  • iSTART and Writing Pal are interventions designed for middle school students, high school students, and young adults improve their reading and writing skills. Within these interventions, students play games to practice reading comprehension and writing strategies.
  • All You Can Eat, Gwakkamole, and CrushStations are part of a suite of Executive Function skill-building games, designed to improve student shifting, inhibitory control, and working memory respectively.

 

We hope you can join us for this exciting event in June to learn more about and try out all the research-based products ready to be used in our nation’s schools. For more information on the featured resources and online events, please see this blog.


Written by Erin Higgins (Erin.Higgins@ed.gov), Program Officer for the Cognition and Student Learning program, National Center for Education Research