IES Blog

In today’s diverse classrooms, it is both challenging and critical to gather accurate and meaningful information about student knowledge and skills. Certain populations present unique challenges in this regard – for example, English learners (ELs) often struggle on assessments delivered in English. On “typical” classroom and state assessments, it can be difficult to parse how much of an EL student’s performance stems from content knowledge, and how much from language learner status. This lack of clarity makes it harder to make informed decisions about what students need instructionally, and often results in ELs being excluded from challenging (or even typical) coursework.

Over the past several years, NCER has invested in several grants to design innovative assessments that will collect and deliver better information about what ELs know and can do across the PK-12 spectrum. This work is producing some exciting results and products.

• Jason Anthony and his colleagues at the University of South Florida have developed the School Readiness Curriculum Based Measurement System (SR-CBMS), a collection of measures for English- and Spanish-speaking 3- to 5-year-old children. Over the course of two back-to-back Measurement projects, Dr. Anthony’s team co-developed and co-normed item banks in English and Spanish in 13 different domains covering language, math, and science. The assessments are intended for a variety of uses, including screening, benchmarking, progress monitoring, and evaluation. The team used item development and evaluation procedures designed to assure that both the English and Spanish tests are sociolinguistically appropriate for both monolingual and bilingual speakers.

• Daryl Greenfield and his team at the University of Miami created Enfoque en Ciencia, a computerized-adaptive test (CAT) designed to assess Latino preschoolers’ science knowledge and skills. Enfoque en Ciencia is built on 400 Spanish-language items that cover three science content domains and eight science practices. The items were independently translated into four major Spanish dialects and reviewed by a team of bilingual experts and early childhood researchers to create a consensus translation that would be appropriate for 3 to 5 year olds. The assessment is delivered via touch screen and is equated with an English-language version of the same test, Lens on Science.

​

• A University of Houston team led by David Francis is engaged in a project to study the factors that affect assessment of vocabulary knowledge among ELs in unintended ways. Using a variety of psychometric methods, this team explores data from the Word Generation Academic Vocabulary Test to identify features that affect item difficulty and explore whether these features operate similarly for current, former, as well as students who have never been classified as ELs. The team will also preview a set of test recommendations for improving the accuracy and reliability of extant vocabulary assessments.

• Researchers led by Rebecca Kopriva at the University of Wisconsin recently completed work on a set of technology-based, classroom-embedded formative assessments intended to support and encourage teachers to teach more complex math and science to ELs. The assessments use multiple methods to reduce the overall language load typically associated with challenging content in middle school math and science. The tools use auto-scoring techniques and are capable of providing immediate feedback to students and teachers in the form of specific, individualized, data-driven guidance to improve instruction for ELs.

By leveraging technology, developing new item formats and scoring models, and expanding the linguistic repertoire students may access, these teams have found ways to allow ELs – and all students – to show what really matters: their academic content knowledge and skills.

Written by Molly Faulkner-Bond (former NCER program officer).

The Montessori method of education was developed over 100 years ago by Dr. Maria Montessori. This “whole child” approach centers around the theory that children are capable of initiating learning in a thoughtfully prepared environment that develops children’s physical, social, emotional, and cognitive growth. Core components of Montessori education are mixed age classrooms in three-year groupings (e.g., 3-6 year olds, 6-9, 9-12, etc.), a carefully prepared environment filled with appropriate materials and lessons, student freedom to select lessons and activities each day, and daily uninterrupted 3-hour work blocks.

According to the National Center for Montessori in the Public Sector (NCMPS), there are currently over 5,000 Montessori schools in the U.S., 500 of which are public schools and over 150 of which serve public preschool and kindergarten students.  Despite its growing popularity in public preschools and Head Start schools, no large-scale evaluation of the efficacy of the Montessori model on children’s academic, social, and emotional skills has been conducted. 

This year, IES funded the first such study. A project team led by Dr. Ann-Marie Faria and Ms. Karen Manship (American Institutes for Research) and Dr. Angeline Lillard (University of Virginia) will study more than 650 children for three years, beginning with their entry at age 3 into preschool. Importantly, this study relies on individual random student assignment via lottery entry to compare preschool students who enroll in Montessori at age 3 to those who are assigned to a waitlist control group (and thus are in other settings such as public PreK, daycare, or a home setting). Data will be collected in diverse urban and suburban school districts across the country, including Houston (TX), Hartford and New Haven (CT), and Washington, DC.

Researchers will examine the impact of preschool Montessori education on children’s academic, social, and emotional skills, as well as kindergarten readiness skills. The research team will also conduct a cost effectiveness study of the public Montessori preschool model, and will examine the effect of fidelity of implementation of Montessori on student outcomes. Collectively, the findings from this study will provide valuable evidence of the efficacy of Montessori preschool education. Ultimately, the researchers plan to disseminate their findings to educators, parents, and policymakers through research briefs, infographics, blog posts, and webinars.

By Amanda M. Dettmer, PhD, American Psychological Association Executive Branch Science Fellow/ AAAS Science & Technology Policy Fellowship

Photo credit: Marilyn Horan, Carroll Creek Montessori Public Charter School

Social and emotional learning (SEL) is a key ingredient of high-quality education care, is important for both educators and children, and has been associated with children’s concurrent and later academic and social success.

Over a decade ago, Yale University’s Center for Emotional Intelligence developed and began testing RULER, an SEL program geared toward children and educators (i.e., school leaders, teachers, and staff). RULER stands for five key social and emotional skills: Recognizing emotions in self and others, Understanding the causes of emotions in self and others, Labeling and talking about emotions, Expressing emotions across situations, and Regulating emotions effectively. For children and the key adults in their lives, RULER combines a whole-school professional development approach with a skill-building curriculum targeting educator and student social and emotional skills, school and classroom climate, and educator and student well-being. RULER is currently offered for pre-k–12 and out-of-school-time settings.

IES has supported the development and testing of RULER programs since 2012. The first IES award supported the modification of existing components of the RULER K-8^th grade intervention and creation of new developmentally appropriate content for preschool settings. RULER is currently implemented in over 200 early childhood school- and home-based programs across the country and nearly 2,000 K-12 schools nationwide. Although RULER’s evidence-base has been growing over the years, RULER has not been systematically studied in large-scale, randomized controlled trials in preschool settings nor has it undergone an external evaluation in the later grades.

That is about to change: this year, IES awarded two grants to study the effects of the RULER programs. One will study the efficacy of whole-school RULER implementation for preschool students (under the Early Learning Programs and Policies program), and the other will do so for grades K-6 (under the Social and Behavioral Context for Academic Learning program).

The Preschool RULER grant (PI: Craig Bailey, PhD) will assess school readiness in children aged 3-5, as well as outcomes at the teacher/classroom and school leader/school levels. The researchers will study 72 early childhood centers, including public, private, and Head Start programs from urban areas in Connecticut, using a multisite, cluster-randomized control trial design. Altogether, approximately 216 classrooms, 1,800 staff, and 2,160 children will participate. Children, educators, and school leaders will be assessed for social and emotional skills, and educators/leaders will be assessed for emotionally intelligent pedagogy and leadership. Children will also be assessed for their approaches to learning, pre-literacy, and pre-math skills. This study will provide evidence about the efficacy of RULER in preschool settings and contribute to our understanding of high quality early childhood interventions that promote social emotional learning.

The other grant, for RULER in grades K-6 (PI: Jason Downer, PhD), will be the first large-scale external evaluation of RULER. The study will take place in 60 urban and suburban public elementary schools, including 420 teachers and 2,520 K-6 students in Virginia. Key outcomes for this study will include school climate assessments (assessed by teacher and principal reports), teacher well-being (assessed by self-report), and four student outcomes: social-emotional skills, behavior, academic engagement and academic achievement (assessed by standardized assessments, tests, and attendance records). Ultimately, this study will describe RULER’s effects on school climate, teacher well-being, classroom climate, and student outcomes.

By Amanda M. Dettmer, AAAS Science & Technology Policy Fellow Sponsored by the American Psychological Association Executive Branch Science Fellowship

Photo credits: Yale Center for Emotional Intelligence

We are pleased to present The Condition of Education 2018, a congressionally mandated annual report summarizing the latest data on education in the United States. This report is designed to help policymakers and the public monitor educational progress. This year’s report includes 47 indicators on topics ranging from prekindergarten through postsecondary education, as well as labor force outcomes and international comparisons. 

In addition to the regularly updated annual indicators, this year’s spotlight indicators highlight new findings from recent NCES surveys. The first spotlight indicator examines the choices and costs that families face as they select early childhood care arrangements. Drawing on data from the NCES National Household Education Survey, the indicator finds that early childhood care expenses were higher in 2016 than in 2001. For example, families’ average hourly out-of-pocket expenses for center-based care were 72 percent higher in 2016 ($7.60) than in 2001 ($4.42), in constant 2016–17 dollars. The indicator also finds that in 2016, some 57 percent of children under the age of 6 had parents who reported there were good choices for child care where they lived. Among children whose parents reported difficulty finding child care in 2016, some 32 percent cited cost as the primary reason. The complete indicator, Early Childhood Care Arrangements: Choices and Costs, contains more information about how these findings varied by family income, race/ethnicity, locale (urban, suburban, town, or rural), and children’s age.

Average hourly out-of-pocket child care expense for children under 6 years old and not yet in kindergarten whose families paid for child care, by primary type of child care arrangement: 2001 and 2016

¹ Center-based arrangements include day care centers, Head Start programs, preschools, prekindergartens, and childhood programs.
NOTE: Estimates include only those children whose families paid at least part of the cost out of pocket for their child to receive nonparental care at least weekly.
SOURCE: U.S. Department of Education, National Center for Education Statistics, Early Childhood Program Participation Survey of the National Household Education Surveys Program (ECPP-NHES: 2001 and 2016). See Digest of Education Statistics 2017, table 202.30c.

The second spotlight describes the characteristics of teachers who entered the teaching profession through an alternative route to certification program. Compared to those who entered through a traditional route, higher percentages of alternative route teachers in 2015–16 were Black (13 vs. 5 percent), Hispanic (15 vs. 8 percent), of Two or more races (2 vs. 1 percent), and male (32 vs. 22 percent), and lower percentages were White (66 vs. 83 percent). Overall, 18 percent of public school teachers in 2015–16 had entered teaching through an alternative route to certification program. The percentages were higher among those who taught career or technical education (37 percent), natural sciences (28 percent), foreign languages (26 percent), English as a second language (24 percent), math and computer science (22 percent), and special education (20 percent). The analysis also examines how the prevalence of alternative route teachers varies between charter schools and traditional public schools, between high and low poverty schools, and between schools that enroll high or low percentages of racial/ethnic minority students. For more findings from this analysis of data from the National Teacher and Principal Survey, see the complete indicator, Characteristics of Public School Teachers Who Completed Alternative Route to Certification Programs.

Percentage distribution of public elementary and secondary school teachers, by route to certification and race/ethnicity: 2015–16

NOTE: Teachers were asked whether they entered teaching through an alternative route to certification program, which is a program that was designed to expedite the transition of nonteachers to a teaching career (for example, a state, district, or university alternative route to certification program). Detail may not sum to totals because of rounding. Race categories exclude persons of Hispanic ethnicity. Data for American Indian/Alaska Native teachers who entered teaching through a traditional route and Pacific Islander teachers who entered teaching through traditional and alternative routes round to zero and are not displayed.
SOURCE: U.S. Department of Education, National Center for Education Statistics, National Teacher and Principal Survey (NTPS), “Public School Teacher Data File,” 2015–16. See Digest of Education Statistics 2017, table 209.24.

The third spotlight presents data on average student loan balances for students completing graduate degrees. Using data from the National Postsecondary Student Aid Study, this indicator examines how average student loan balances changed between 1999–2000 and 2015–16, and how those trends varied by degree type. Among graduate school completers who had student loans for undergraduate or graduate studies, average student loan balances increased for all degree types (in constant 2016–17 dollars). For example, average student loan balances for students who completed research doctorate degrees, such as a Ph.D., doubled during this time period, from $53,500 to $108,400 (an increase of 103 percent). Average student loan balances increased by 90 percent for those who completed professional doctorate degrees, such as medical doctorates and law degrees (from $98,200 to $186,600). The complete indicator, Trends in Student Loan Debt for Graduate School Completers, also describes how average student loan balances varied among specific degree programs, such as medical doctorates, law degrees, and master’s degrees in business administration.

Average cumulative student loan balance for graduate school completers, by degree type: Selected years, 1999–2000 through 2015–16

¹ Includes chiropractic, dentistry, law, medicine, optometry, pharmacy, podiatry, and veterinary medicine. 
NOTE: Data refer to students who completed graduate degrees in the academic years indicated. Includes student loans for undergraduate and graduate studies. Average excludes students with no student loans.
SOURCE: U.S. Department of Education, National Center for Education Statistics, 1999–2000, 2003–04, 2007–08, 2011–12, and 2015–16 National Postsecondary Student Aid Study (NPSAS:2000, NPSAS:04, NPSAS:08, NPSAS:12, and NPSAS:16). See Digest of Education Statistics 2017, table 332.45.

The Condition includes an At a Glance section, which allows readers to quickly make comparisons within and across indicators, and a Highlights section, which captures key findings from each indicator. The report contains a Reader’s Guide, a Glossary, and a Guide to Sources that provide additional background information. Each indicator provides links to the source data tables used to produce the analyses.

As new data are released throughout the year, indicators will be updated and made available on The Condition of Education website. In addition, NCES produces a wide range of reports and datasets designed to help inform policymakers and the public. For more information on our latest activities and releases, please visit our website or follow us on Twitter, Facebook, and LinkedIn.

By James L. Woodworth, NCES Commissioner 

Identifying young children with language delays can improve later outcomes

Language is a core ability that children must master for success both in and out of the classroom. Extensive studies have shown that many tasks, including math, depend on linguistic skill, and that early language skills are predictive of school readiness and academic success. Being able to quickly identify children at early ages with language delays is crucial for targeting effective interventions.

Enter the QUILS.

In 2011, the National Center for Education Research (NCER) at IES funded a 4-year grant to Dr. Roberta Golinkoff (University of Delaware) and Drs. Kathy Hirsh-Pasek (Temple University) and Jill de Villiers (Smith College) to develop a valid and reliable computer-based language assessment for preschoolers aged 3-5 years old. The resulting product was the Quick Interactive Language Screener (QUILS), a computerized tool to measure vocabulary, syntax, and language acquisition skills. The assessment ultimately measures what a child knows about language and how a child learns, and automatically provides results and reports to the teacher.

The preschool version of QUILS is now being used by early childhood educators, administrators, reading specialists, speech-language pathologists, and other early childhood professionals working with young children to identify language delays. The QUILS is also being utilized in other learning domains. For example, a new study relied on the QUILS, among other measures, to examine links between approaches to learning and science readiness in over 300 Head Start students aged 3 to 5 years.

QUILS is now being revised for use with toddlers. In 2016, the National Center for Special Education Research (NCSER) funded a 3-year study to revise the QUILS for use with children aged 24-36 months. The researchers have been testing the tool in both laboratory and natural (child care centers, homes, and Early Head Start programs) settings to determine which assessment items to use in the toddler version of QUILS. Ultimately, these researchers aim to develop a valid and reliable assessment to identify children with language delays so that appropriate interventions can begin early.

By Amanda M. Dettmer, AAAS Science & Technology Policy Fellow Sponsored by the American Psychological Association Executive Branch Science Fellowship