Search Results: (1-15 of 92 records)
|NCSER 2020001||An Introduction to Adaptive Interventions and SMART Designs in Education
Educators must often adapt interventions over time because what works for one student may not work for another and what works now for one student may not work in the future for the same student. Adaptive interventions provide education practitioners with a prespecified, systematic, and replicable way of doing this through a sequence of decision rules for whether, how, and when to modify interventions. The sequential, multiple assignment, randomized trial (SMART) is one type of multistage, experimental design that can help education researchers build high-quality adaptive interventions.
Despite the critical role adaptive interventions can play in various domains of education, research about adaptive interventions and the use of SMART designs to develop effective adaptive interventions in education is in its infancy. To help the field move forward in this area, the National Center for Special Education Research (NCSER) and the National Center for Education Evaluation and Regional Assistance (NCEE) commissioned a paper by leading experts in adaptive interventions and SMART designs. This paper aims to provide information on building and evaluating high-quality adaptive interventions and review the components of SMART designs, discuss the key features of the SMART, and introduce common research questions for which SMARTs may be appropriate.
|NCES 2019084||Technology and K-12 Education: The NCES Ed Tech Equity Initiative
This interactive brochure provides an overview of the Initiative—including its purpose, goal, and target outcomes.
|NCES 2019085||Technology and K-12 Education: Advancing the NCES Ed Tech Equity Initiative
This infographic outlines the key steps NCES is taking to advance the NCES Ed Tech Equity Initiative.
|NCES 2019086||Technology and K-12 Education: The NCES Ed Tech Equity Initiative: Framework
Check out our new factsheet to learn about the factors most critical to informing ed tech equity in the context of K-12 education!
|NCES 2019087||Technology and K-12 Education: The NCES Ed Tech Equity Initiative: Data Collection Priorities
This factsheet outlines the key subtopics NCES will prioritize in its ed tech equity data collections.
|NCEE 20184013||The Investing in Innovation Fund: Summary of 67 Evaluations
The Investing in Innovation (i3) Fund is a tiered-evidence program that aligns the amount of funding awarded to grantees with the strength of the prior evidence supporting the proposed intervention. One of the goals of i3 is to build strong evidence for effective interventions at increasing scale. The i3 program requires grantees to conduct an independent impact evaluation. This report, from the National Center for Education Evaluation and Regional Assistance (NCEE), assesses the quality of the 67 i3 grant evaluations completed by May 2017 and summarizes the findings of the evaluations. The report found that 49 of the first 67 completed i3 grant evaluations were implemented consistent with What Works Clearinghouse (WWC) evidence standards and 12 of the evaluations found a positive impact on at least one student academic outcome.
|REL 2018291||Regional Educational Laboratory researcher-practitioner partnerships: Documenting the research alliance experience
This report provides a detailed account of the Regional Educational Laboratory (REL) Program's experience establishing and supporting research-practice partnerships (called "research alliances") during its 2012–17 contract cycle. The report adds to the growing literature base on researcher-practitioner partnerships by sharing how the RELs reported creating, engaging, and maintaining multiple partnerships, with the purpose of informing future collaborative efforts for researchers and practitioners and for those who wish to support research-practice partnerships. It addresses questions about: how REL research alliances fit within the broader context of research-practice partnerships; what characteristics existed among REL research alliances and how they evolved over time; and what challenges RELs reported experiencing while establishing and supporting research alliances and the strategies RELs employed to address those challenges. Finally, the paper discusses the implications of the REL research alliance experience for other networks of research-practice partnerships.
|NFES 2017007||The Forum Guide to Collecting and Using Attendance Data
The Forum Guide to Collecting and Using Attendance Data is designed to help state and local education agency staff improve their attendance data practices – the collection, reporting, and use of attendance data to improve student and school outcomes. The guide offers best practice suggestions and features real-life examples of how attendance data have been used by education agencies. The guide includes a set of voluntary attendance codes that can be used to compare attendance data across schools, districts, and states. The guide also features tip sheets for a wide range of education agency staff who work with attendance data.
|NCES 2017121||Program for International Student Assessment (PISA) 2015 United States Restricted-use Data File
This CD-ROM contains PISA 2015 restricted-use data for the United States. The CD-ROM includes the data file, a codebook, instructions on how to merge with the U.S. PISA 2015 public-use dataset (NCES 2017-120), and a cross-walk to assist in merging with other public datasets, such as the Common Core of Data (CCD) and Private School Survey (PSS). As these data files can be used to identify respondent schools, a restricted-use license must be obtained before access to the data is granted. Click on the restricted-use license link below for more details.
|NCEE 20184002||Asymdystopia: The threat of small biases in evaluations of education interventions that need to be powered to detect small impacts
Evaluators of education interventions are increasingly designing studies to detect impacts much smaller than the 0.20 standard deviations that Cohen (1988) characterized as "small." While the need to detect smaller impacts is based on compelling arguments that such impacts are substantively meaningful, the drive to detect smaller impacts may create a new challenge for researchers: the need to guard against smaller inaccuracies (or "biases"). The purpose of this report is twofold. First, the report examines the potential for small biases to increase the risk of making false inferences as studies are powered to detect smaller impacts, a phenomenon the report calls asymdystopia. The report examines this potential for both randomized controlled trials (RCTs) and studies using regression discontinuity designs (RDDs). Second, the report recommends strategies researchers can use to avoid or mitigate these biases. For RCTs, the report recommends that evaluators either substantially limit attrition rates or offer a strong justification for why attrition is unlikely to be related to study outcomes. For RDDs, new statistical methods can protect against bias from incorrect regression models, but these methods often require larger sample sizes in order to detect small effects.
|REL 2017214||Workshop on Survey Methods in Education Research: Facilitator's guide and resources
Regional Educational Laboratory Midwest has developed a tool for state and local education agencies to use to organize and conduct training for their staff members who design and conduct surveys. Surveys are often used by education agencies to collect data to assess needs, inform policy decisions, evaluate programs, or respond to legislative mandates. The workshop presentation materials draw from evidence-based research from the field of survey research methodology and offer guidance on designing and administering high-quality surveys. The materials provide practical advice and examples drawn from experiences in developing surveys for local, state, and national education applications. The workshop includes eight modules that describe the steps of survey design and administration—from planning to data collection—and covers the following topics: planning for a survey, exploring existing item sources, writing items, pretesting survey items, sampling, data collection methods, response rates, and focus groups. The facilitator's guidebook includes the goals for each module, considerations for adapting the materials for various purposes, an annotated agenda, and participant handouts (slide decks and accompanying notes, activities, and handouts). Individuals and groups who are developing surveys can use these materials to facilitate workshops, guide a survey project, or ensure that they are adhering to best practices for designing and conducting surveys. Although this guide is intended to help survey researchers in state and local education agencies organize and conduct a training for their staff, the materials also can be used as a stand-alone resource for anyone wishing to learn the basics about survey design and administration in education settings.
|REL 2017266||Puerto Rico school characteristics and student graduation: Implications for research and policy
The purpose of the study is to examine the relationship between Puerto Rico’s high school characteristics and student graduation rates. The study examines graduation rates for all public high schools for students who started grade 10 in 2010/11 (in Puerto Rico high school begins in grade 10) and were expected to graduate at the end of the 2012/13 school year, which were the most recent graduation data available. Using data provided by the Puerto Rico Department of Education as well as publicly available data, this study first examined the correlational relationships between graduation rates and two types of variables: student composition characteristics, which are not amenable to change or intervention but help to improve the description of graduation trends in Puerto Rico (for example, the percentage of students who are living in poverty); and school characteristics, which are amenable to change or intervention by officials (for example, the ratio of students per teacher). Regression analyses were used to estimate the conditional association between various characteristics and on-time graduation in Puerto Rico high schools after controlling for other factors. The percentage of students proficient in Spanish language arts was associated with higher graduation rates, after controlling for other school characteristics both overall and by subgroup (males, females, students below poverty, and special education students). After controlling for other characteristics, the percentage of students proficient in mathematics was not associated with graduation rates. Lower student-to-teacher ratios were associated with higher graduation rates for males, students living in poverty, and special education students, after controlling for other school characteristics. The percentage of highly qualified teachers was associated with lower graduation rates overall and for all subgroups except females, after controlling for other school characteristics. Correlations between each school characteristic and graduation rates are also presented in the report. The findings from this study provide a starting point for stakeholders in Puerto Rico who are interested in addressing the low rates of graduation in their high schools and communities through the use of data-driven decision-making.
|REL 2017264||Establishing and sustaining networked improvement communities: Lessons from Michigan and Minnesota
The purpose of this report is to share lessons learned by Regional Educational Laboratory (REL) Midwest researchers as they worked with educators in Michigan and Minnesota to establish and sustain two networked improvement communities (NICs). A NIC is a type of collaborative research partnership that uses principles of improvement science within networks to learn from variation across contexts. At the request of the Michigan Department of Education, REL Midwest worked with educators at the school, district, intermediate school district, and state levels to establish the Michigan Focus NIC, with the goal of reducing disparities in student achievement within schools. At the request of the Minnesota Department of Education, REL Midwest worked with educators at the state and regional levels to establish the Minnesota Statewide System of Support NIC. This NIC aimed to improve the supports that the Minnesota Department of Education provides to its six Regional Centers of Excellence, which implement school improvement strategies in the schools in the state with the lowest performance and largest achievement gaps. Although there is practical guidance for how NICs should structure their work, few published accounts describe the process of forming a NIC. Through its experience working with educators to form two NICs, REL Midwest learned that it is important to: build a cohesive team with members representing different types of expertise; reduce uncertainty by clarifying what participation would entail; build engagement by aligning work with ongoing efforts; use activities that are grounded in daily practice to narrow the problem of practice to one that is high leverage and actionable; and embed capacity building into NICs to build additional expertise for using continuous improvement research to address problems of practice. This report offers guidance to researchers and educators as they work to establish and sustain NICs. The lessons learned come from efforts to establish NICs in two specific contexts and therefore may not be generalizable to other contexts.
|NCEE 20174023||Descriptive analysis in education: A guide for researchers
Whether the goal is to identify and describe trends and variation in populations, create new measures of key phenomena, or describe samples in studies aimed at identifying causal effects, description plays a critical role in the scientific process in general and education research in particular. Descriptive analysis identifies patterns in data to answer questions about who, what, where, when, and to what extent. This guide describes how to more effectively approach, conduct, and communicate quantitative descriptive analysis. The primary audience for this guide includes members of the research community who conduct and publish both descriptive and causal studies, although it could also be useful for policymakers and practitioners who are consumers of research findings. The guide contains chapters that discuss the important role descriptive analysis plays; how to approach descriptive analysis; how to conduct descriptive analysis; and how to communicate descriptive analysis findings.
|REL 2017228||Summary of research on online and blended learning programs that offer differentiated learning options
This report presents a summary of empirical studies of K-12 online and blended instructional approaches that offer differentiated learning options. In these approaches, instruction is provided in whole or in part online. This report includes studies that examine student achievement outcomes and summarizes the methodology, measures, and findings used in the studies of these instructional approaches. Of the 162 studies that were reviewed, 17 met all inclusion criteria and are summarized in this report. The majority of the studies examined blended instructional approaches, while all approaches provided some means to differentiate the content, difficulty level, and/or pacing of the online content. Among the blended instructional approaches, 45 percent were designed to support differentiation of the in-class component of instruction. The majority of studies examining these approaches compared student performance on common standardized achievement measures between students receiving the instructional approach and those in comparison classrooms or schools. Among the most rigorous studies, statistically significant positive effects were found for four blended instructional approaches.