Inside IES Research

Notes from NCER & NCSER

Seeking Summer Interns

Would you like to leverage your superpowers to help improve education, science, and communication? Have you always wondered what really goes on in a federal research office? If so, we have the perfect summer internship for you!

Each year, the two IES research centers—the National Center for Education Research (NCER) and the National Center for Special Education Research (NCSER)—host on-site, summer volunteer interns. These interns help us compile, synthesize, and communicate the research we support through our grant programs. Previous interns have written and been featured in blogs, identified experts for technical working groups, prepared materials for briefings, and reviewed abstracts and reports to identify emerging themes in education research, among other things. And these interns gain knowledge about non-academic pathways for researchers, build writing and communication skills, learn about grant making and federal agencies – all while being able to enjoy everything that Washington, DC has to offer!

Applicant qualifications:

  • Upper-division undergraduate or graduate students
  • Currently enrolled in good standing at a postsecondary institution
  • Have an interest in education research
  • Have experience with software such as the Microsoft Office Suite
  • Be willing to devote at least 20 hours per week
  • Work in the Washington, DC area

If you’re interested, fill in the application on USAJobs (https://www.usajobs.gov/GetJob/ViewDetails/555512800), noting your interest in the Institute of Education Sciences (IES), and submit your materials before April 30, 2020. International students must contact one of the program officers directly: Dr. Meredith Larson (NCER, Meredith.Larson@ed.gov) or Dr. Amy Sussman (NCSER, Amy.Sussman@ed.gov).

We encourage you to contact us for more information about the summer position and possible remote internships during the academic year!

Lexia RAPID Assessment: From Research to Practice at Scale in Education

With a 2010 measurement grant award and a 2010 Reading for Understanding subaward from IES, a team at Florida State University (FSU) led by Barbara Foorman, developed a web-based literacy assessment for Kindergarten to Grade 12 students.

Years of initial research and development of the assessment method, algorithms, and logic model at FSU concluded in 2015 with a fully functioning prototype assessment called RAPID, the Reading Assessment for Prescriptive Instructional Data. A body of research demonstrates its validity and utility. In 2014, to ready the prototype for use in schools and to disseminate on a wide-scale basis, FSU entered into licensing agreements with the Florida Department of Education (FLDOE) to use the prototype assessment royalty-free as the Florida Assessment for Instruction in Reading—Florida Standards (FAIR-FS), and with Lexia Learning Systems LLC, a Rosetta Stone company (Lexia), to create its commercial solution: Lexia® RAPID™ Assessment program.  Today, RAPID (watch video) consists of adaptive screening and diagnostic tests for students as they progress in areas such as word recognition, vocabulary knowledge, syntactic knowledge and reading comprehension. Students use RAPID up to three times per year in sessions of 45 minutes or less, with teachers receiving results immediately to inform instruction.

RAPID is currently used by thousands of educators and students across the U.S. RAPID has been recommended in Massachusetts as a primary screening tool for students ages 5 and older, is on both the Ohio Department of Education List of Approved Screening Assessments and the Michigan Lists of Initial and Extensive Literacy Assessments.

Interview with Barbara Foorman (BF) of Florida State University and Liz Brooke (LB) of Lexia Learning  

Photograph of Barbara Foorman, PhD

From the start of the project, was it always a goal for the assessment to one day be ready to be used widely in schools?

BF: Yes!

How was the connection made with the Florida Department of Education?   

BF: FSU authors (Yaacov Petscher, Chris Schatschneider, and I) gave the assessment royalty-free in perpetuity to the FLDOE, with the caveat that they had to host and maintain it. The FLDOE continues to host and maintain the Grade 3 to 12 system but never completed the programming on the K to 2 system prototype. The assessment we provided to the FLDOE is called the Florida Assessment for Instruction in Reading (FAIR—FS).  We also went to FSU’s Office of Commercialization to create royalty and commercialization agreements.

How was the connection made with Lexia? 

BF: Dr. Liz (Crawford) Brooke, Chief Learning Officer of Lexia/Rosetta Stone, and Dr. Alison Mitchell, Director of Assessment at Lexia, had both previously worked at the Florida Center for Reading Research (FCRR). Liz served as the Director of Interventions, as well as a doctoral student under me, and Alison was a postdoctoral assistant in research. Both Liz and Alison had worked on previous versions of the assessment.

Photograph of Liz Brooke, PhD

LB: Also, both Yaacov and Chris had done some previous work with me on the Assessment Without Testing® technology, which was embedded in our K to 5 literacy curriculum solution, the Lexia® Core5 Reading® program.

Did Lexia have to do additional R&D to develop the FSU assessment into RAPID as a commercial offering for larger scale use? Were resources provided?  

LB: To build and scale the FSU prototype assessment into a commercial platform, our team of developers worked closely with the developers at FSU to reprogram certain software application and databases. We’ve also spent the last several years at Lexia working to translate the valuable results that RAPID generates into meaningful, dynamic and usable data and tools for schools and educators.  This meant designing customized teacher and administrator reports for our myLexia® administrator dashboard, creating a library of offline instructional materials for teachers, as well as developing both online and in-person training materials specifically designed to support our RAPID solution.

BF: They also hired a psychometrician to submit RAPID to the National Center for Intensive Intervention, and had their programmers develop capabilities to support access to RAPID via iPads as well as through the web-based application.

What kind of licensing agreement did you (or FSU) work out?  

BF: The prototype assessment method, algorithms, and logic model that were used to develop RAPID are licensed to Lexia by FSU. Some of these may also be available for FSU to license to other interested companies.  Details of FSU’s licensing agreement terms to Lexia are confidential, however, royalties received by FSU through its licensing arrangements are shared between authors, academic units, and the FSU Research Foundation, according to FSU policies. (Read here for more about commercialization of FSU technologies and innovations.)

Does FSU receive royalties from the sale of RAPID?

BF: Yes. The revenue flows through FSU’s royalty stream—percentages to the three authors and the colleges and departments that we three authors are housed in.

What factors did Lexia consider when determining to partner with FSU to develop RAPID?

LB: We considered the needs of our customers and the fact that we wanted to develop and offer a commercial assessment solution that would provide a great balance between efficiency from the adaptive technology, but also insight based on an emphasis on reading and language skills. At Lexia, we are laser-focused on literacy and supporting the skills students need to be proficient readers. The value of the research foundation of the assessment was a natural fit for that reason. RAPID emphasizes Academic Language skills in a way that many other screening tools miss - often you’d need a specialized assessment given by a speech language pathologist to assess the skills that RAPID captures in a relatively short period of time for a whole classroom of students.

Describe how RAPID is marketed and distributed to schools?

LB: The Lexia RAPID Assessment was designed and is offered as a K-12 universal screening tool that schools can use up to three times per year. We currently offer RAPID as a software as a service -based subscription on an annual cost per license basis that can be either purchased per student or per school.  We also encourage schools that utilize RAPID to participate in a yearlong Lexia Implementation Support Plan that includes professional learning opportunities and data coaching specific to the RAPID solution, to really understand and maximize the value of the data and instructional resources that they receive as part of using RAPID.

Do you have advice for university researchers seeking to move their laboratory research into wide-spread practice?

BF: Start working with your university’s office of commercialization sooner than later to help identify market trends and create Non-Disclosure Agreements. In the case of educational curricula and assessments, researchers need to be (a) knowledgeable about competing products, (b) able to articulate what’s unique and more evidence-based than the competitors’ products, and (c) know that educators will find their product useful.

LB: As Barbara noted, it is critical to identify the specific, real-world need that your work is addressing and to be able to speak to how that’s different than other solutions out there.  It’s also really important to make sure that the research you’ve done has really validated that it does meet the need you are stating, as this will be the foundation of your claims in the market.

____________________________________________________________________________________________

Barbara Foorman, Ph.D., is the Frances Eppes Professor of Education, Director Emeritus of FCRR, and Director of the Regional Educational Laboratory Southeast at FSU. Barbara is an internationally known expert in reading with over 150 peer reviewed publications. Barbara was co-editor of the Journal of Research on Educational Effectiveness and is a co-founder and on the board of the Society for Research on Educational Effectiveness

Liz Brooke, Ph.D., CCC-SLP is the Chief Learning Officer for Rosetta Stone/Lexia Learning. Dr. Liz Brooke is responsible for setting the educational vision for the company's Language and Literacy products, including the Adaptive Blended Learning (ABL) strategy that serves as the foundation for Rosetta Stone’s products and services. Liz has been working in the education sector for over 25 years and has been published in several scholarly journals. Liz joined Lexia in 2010. Prior to that, she worked as the Director of Interventions at the FCRR and she has also served as a speech-language pathologist at Massachusetts General Hospital and in the public school setting. Liz began her career in the classroom as a first-grade teacher.

This interview was produced by Edward Metz of the Institute of Education Sciences. This post is the second in an ongoing series of blog posts examining moving from university research to practice at scale in education.

Why I Want to Become an Education Researcher

In 2015, IES launched the Pathways to the Education Sciences research training program in order to help diversify the pipeline of education researchers. Pathways programs provide year-long training to diverse undergraduate, post-baccalaureate, and masters students. Pathways fellows receive an introduction to education research and scientific methods, meaningful opportunities to participate in education research studies, and professional development and mentoring. Currently, almost 200 students have participated in Pathways and 91 have completed training. Sixty-three percent of completed fellows are currently enrolled in graduate school (26% doctoral, 35% masters). We reached out to 6 Pathways graduates to ask them what inspired them to become education researchers. Here is what they shared with us.

Photograph of Sydnee Garcia

Sydnee Garcia

Pathways Program, University of Texas, San Antonio

Student Affairs masters student, University of Maryland, College Park

I never thought that I would end up in education. Initially, I saw myself helping others through occupational therapy. It was when I reached the University of Texas at San Antonio, my undergraduate institution, that I gained an understanding of the doors that open when someone receives a formal education. My experiences as a UTSA IES Educational Pathways Fellow also strengthened my belief that co-curricular learning is imperative for modern-day students and that all students should have access to this learning. As a current graduate student at the University of Maryland, my hope for the future is to research inequities in higher education and find effective practices to provide opportunities for students from marginalized backgrounds to find space and growth in a system that wasn't built for them. 

Photograph of James A. Hernández

James A. Hernández

PURPOSE Program, Florida State University/Florida Agricultural and Mechanical University

Education Psychology doctoral student, Florida State University

As a 5th grade teacher, I was inspired to learn more about educational research. I was constantly analyzing my students’ learning, and I knew there was a way that I could leverage their data to more effectively educate them. However, I was also aware that I did not have the proper research training to do so nor the confidence to apply to graduate school. So I did the next best thing and became a college advisor. Little did I know my passion for educational research would be further ignited as I employed theories like developmental advising models to support my students. During this experience, I eventually garnered enough courage to apply to an educational research graduate program. Through the support of the IES PURPOSE research training program, I received a research conference poster presentation award and 2nd place in presenting my research in under four minutes. Furthermore, with the IES PURPOSE resources, especially the proseminars and mentorship, I was admitted into a PhD program fully funded by the FEF McKnight fellowship. Upon graduating with my PhD, I intend to bring the educational research skills I have gained from PURPOSE and my doctoral program to the classroom by building a community laboratory school.

Photograph of Troy Kearse

Troy Kearse

RISE Program, University of Maryland, College Park/Bowie State University

Psychology doctoral student, Howard University

In my career, I am determined to become a psychologist and professor, focused on cognitive-behavioral studies, particularly for underrepresented minorities. My interest began after taking an introductory course in psychology at Prince George’s Community College. After transferring to Bowie State University my interest in the diverse field of Psychology was enhanced. My ongoing study on cognitive functioning in student success allows me to appreciate the importance of education as it relates to research. With a minor in tutoring and mentoring, I had the opportunity to work directly with students in introductory psychology courses in order to expand my experience in teaching. As the vice-president of the psychological society at BSU, I began to develop tutoring sessions for students in the form of interactive “jeopardy” games like Kahoot!, or more recently, an on-campus version of Escape Room Live to tackle this problem. Students participating in these programs have enjoyed the extra help. I believe that Project RISE was beneficial to my career goals as it continued to enhance my interest in research, as well as make a difference in academia.

Photograph of Natalie Larez

Natalie Larez

AWARDSS Program, University of Arizona

School Psychology doctoral student, University of California, Santa Barbara

Children spend most of their time within schools, allowing for much of their development to be shaped by this environment. Working with students is something that has always intrigued me. When I started my undergraduate career at the University of Arizona, I searched for opportunities that allowed me to work with students, from kindergarten to college age, especially from underrepresented backgrounds. Through these varied experiences, I quickly realized that many of these students were brilliant but were constrained by the systemic barriers that affect minority communities. Additionally, many had experienced significant trauma that was inhibiting them from moving forward. When I was presented with the opportunity to join a Pathways program, it seemed like the perfect stepping stone to a future that I could only dream of. With the support of my mentor, I was able to investigate the associations between traumatic stress symptoms, resiliency, and school outcomes and identify possible solutions to addressing the educational impact. As a result, I was admitted into a top program that will allow me to build skills to better support students in their academics, mental health, and future aspirations. The AWARDSS program was monumental for my career in research education. The AWARDSS program supported my growth in confidence, research skills, access to knowledge on how to pursue graduate school, and mentors that I will continue to work with throughout my career.

Photograph of India Simone Lenear

India Simone Lenear

RISE Training Program, North Carolina Central University/University of North Carolina Wilmington

Political Science doctoral student, Purdue University

As a child, I always thought I wanted to be a lawyer and then ultimately become the first Black woman U.S. Supreme Court Justice. I shadowed lawyers and judges, and I participated in mentoring training for future lawyers. I even took debate classes because I thought that was my passion. It was not until I took my first political science class that I realized that I really wanted to be a researcher and professor and that my passion lies in higher education. I wanted to be a professor because I loved the relationship and bond that I developed with some of my professors. I wanted to be a researcher because I wanted to be able to conduct research that would broaden and deepen the scope of research within political science. As I began to understand what my passion really was, I was offered an opportunity to participate in the RISE training program, by way of my extracurricular activities on campus. I immediately knew that I needed to take this opportunity. Over the next year, the RISE program helped to train and mold the way I think critically about issues and topics I want to address, while also being able to navigate the requirements and expectations of being a researcher. The skills that RISE taught me have allowed me to become a great student researcher. I am now happy to say that I am enrolled full-time in a political science doctoral program at Purdue University, where I plan to study American politics in education with a focus on race and ethnic politics, identity politics, and Black feminist theory as it impacts students in college.

Tseng Meng Vang

Pathways Program, California State University, Sacramento

Human Development doctoral student, University of California, Davis

My experience as a Hmong American in the United States inspired me to become an education researcher. I still recall the moment my high school teacher telling our class about the college attainment rate of different ethnic groups and being told that Hmong American’s college attainment rate was one of the lowest of all the ethnic groups. This finding made me question why Hmong Americans were performing poorly compared to the general Asian American classification. Since this issue is so close to home for me, I was inspired to understand protective and risk factors of college attainment.

Compiled by Katina Rae Stapleton, National Center for Education Research. This post is the second in an ongoing series of blog posts on issues of diversity, inclusion, and equity within education research.

Inside IES Special Interview Series: From University Research to Practice at Scale in Education

Over two decades, the National Center for Education Research and the National Center for Special Education Research at IES have built a knowledge base to inform and improve education practice. This work has also spurred the development of evidence-based tools, technological products, training guides, instructional approaches, and assessments. 

While some IES-supported interventions are used on a wide scale (hundreds of schools or more), we acknowledge that a “research to practice gap” hinders the uptake of more evidence-based interventions in education.  The gap refers to the space between the initial research and development in university laboratories and pilot evaluations in schools, and everything else that is needed for the interventions to be adopted as a regular practice outside of a research evaluation.

For many academic researchers, advancing beyond the initial stage of R&D and pilot evaluations is complex and often requires additional time, financing, and specialized expertise and support. For example, interventions often need more R&D to ready interventions for scale—whether to ensure that implementation is turnkey and feasible without any researcher assistance, that interventions work the same across divergent settings and across different populations, or to bolster technology systems to be able to process huge amounts of data across numerous sites at the same time. Advancing from research to practice may also entail commercialization planning to address issues such as intellectual property, licensing, sales, and marketing, to facilitate dissemination of interventions from a university to the education marketplace, and to sustain it over time by generating revenue or securing other means of support.

Special Inside IES Research Interview Series

This winter and spring, Inside IES Research is publishing a series of interviews with the teams of researchers, developers, and partners who successfully advanced IES-funded education research from the university laboratory to practice in schools at scale.  Collectively, the interviews illustrate a variety of models and approaches for scaling evidenced-based interventions and for disseminating and sustaining the interventions over time.

Each interview will address a similar set of questions:

  • Was it part of the original plan to develop an intervention that could one day be used at scale in schools?
  • Describe the initial research and development that occurred. 
  • What role did the university play in facilitating the research to practice process? 
  • What other individuals or organizations provided support during the process?
  • Beyond the original R&D process through IES or ED grants, what additional R&D was needed to ready the intervention for larger scale use?
  • What model was used for dissemination and sustainability?
  • What advice would you provide to researchers who are looking to move their research from the lab to market? What steps should they take? What resources should they look for?

Check this page regularly to read new interviews.

We hope you enjoy the series.

This series is produced by Edward Metz of the Institute of Education Sciences

Diversify Education Sciences? Yes, We Can!

In this blog post, Stephen Raudenbush discusses the University of Chicago’s successful efforts to diversify its IES-funded predoctoral training program. This post is the first in a series exploring issues of diversity, inclusion, and equity in the education sciences.

In 2015, the Committee on Education at the University of Chicago launched a national campaign to recruit a talented and diverse group of pre-doctoral fellows. With funding from the Institute of Education Sciences, we sought to train a new generation of social scientists from across the disciplines to bring rigorous methods of social science to bear on questions related to the improvement of education.

We’d had previous success in pre-doctoral training with IES support. Our fellows had a great track record conducting research and getting good jobs, but we were deeply unsatisfied that only 3 of 35 of those fellows were members of under-represented minority groups. This didn’t make sense, particularly in Chicago—a city where 90% of the public-school students are African American and Hispanic—and where our aim was to build a strong research-practice partnership.

Our campaign was quite successful. We now have a terrific team of 23 PhD fellows, including 9 who are African American or Hispanic. All are making excellent progress toward degrees in disciplines as varied as Comparative Human Development, Economics, Political Science, Psychology, Public Policy, Social Services Administration, and Sociology. We’re writing to share our five key strategies that underscored our approach to improving student diversity in the education sciences.

Create a compelling intellectual argument for choosing education sciences. We invited prospective students to join us in an interdisciplinary research project focused on overcoming educational inequality. We organized the training around one question: “How can we improve the contribution of schooling to skills required for the labor market success of urban youth?” We reasoned that many of the most talented minority and non-minority scholars are deeply committed to answering this broad question, and we reasoned that many would be motivated to come to Chicago to study these questions. A plus for us is the University’s longstanding engagement with public schools in Chicago.

Hire a coordinator dedicated to recruitment. Faculty were totally committed to the recruitment goal, but they were too busy teaching, mentoring, doing research, and serving on departmental committees to oversee a major student recruitment campaign. So we hired a dedicated recruitment director to coordinate with prospective students and faculty and carry out many of the administrative tasks associated with recruitment. The recruitment director assigned every prospective student to a faculty member with kindred interests and followed up to see that faculty colleagues made connected with these students.

Reach out to social networks that include diverse students. Within the university, we worked closely with officers at the University of Chicago who are focused on recruiting diverse students. Our faculty made use of personal connections, and we pooled information about people we know at Historically Black Colleges and Universities, Minority-Serving Institutions, and liberal arts colleges. We made it easy for interested students to express interest and connect with faculty and staff through our website. We also found that organizations such as the American Educational Research Association and the National Equity Project were happy to spread the word about our campaign.

Maximize faculty contact with prospective fellows – well before applications are due. Our faculty were heroes in following up with every promising prospective fellow. We think it’s key to make a phone call before admissions decisions are made and to encourage potentially interested and promising persons to apply. In this way, every person who is admitted will already have a history of communication with a faculty member. Continued communication builds trust and the sense of belonging that encourages young people to join the project. Having a diverse faculty helps; however every faculty member, regardless of race, ethnicity, or gender, pitched in, and this united effort clearly paid off.

Build a welcoming culture. We encouraged all admitted students to visit before deciding what university to attend. We mobilized University funds to support travel and lodging. We encouraged the prospective fellows to meet each other and to meet our current doctoral students during these visits. The key is to convey to each student a true sense of belonging. We created lots of opportunity for small group discussions and social engagement to foster colleagueship and promote respect for the diversity of perspective. Our fellows run our weekly Education Workshop, which often showcases the work of minority scholars. Making this happen for our first cohort helped recruit our second cohort.