IES Blog

By Ed Metz, NCER Program Officer

In this inaugural Where Are They Now? feature, we take a look back at a 2008 grant to researchers at Harvard University for the development of EcoMUVE.

EcoMUVE uses Multi-User Virtual Environments (MUVEs), which have the look and feel of video games, to help middle school students gain a deeper understanding of ecosystems, scientific inquiry, and causal patterns. The MUVEs recreate authentic ecological settings within which students explore and collect information. Students work individually at their computers and collaborate in teams within the virtual world. EcoMUVE includes two modules, Pond and Forest; each module is a two-week inquiry-based ecosystems curriculum. EcoMUVE received the First Place award in the Interactive and Immersive Learning Category at the 2011 Association for Educational Communications and Technology conference, and has received follow-on support from the National Science Foundation and Qualcomm Wireless. 

In this blog, we catch up with two of the researchers who led the development of EcoMUVE, Chris Dede and Shari Metcalf, to look back at their IES project and to learn about recent developments.

How and when did the idea to develop a virtual environment for science learning come about?

Chris Dede’s prior research with the River City project looked at supporting student inquiry using immersive exploration in a virtual world. Meanwhile, Harvard Professor Tina Grotzer was developing ways to support students in understanding complex causality in ecosystems. They worked together on a grant proposal to IES to combine their interests.

How does a virtual environment provide meaningful learning opportunities that otherwise might not be possible?

Ecosystems are complex systems shaped by relationships that often happen at microscopic levels, at a distance, and over long periods of time. Immersion in virtual environments can transform the learning experience by situating the learner in a rich simulated context in which new visualization opportunities are possible – e.g., zooming in to the microscopic level, or traveling to different points in time.

Students start to get a feel for the ecosystem and its relationships through tacit sensory clues. It is an uphill walk from the pond to the housing development, and students can walk down along a drainage ditch and through the pipe where runoff flows into the pond. The pond becomes noticeably greenish during the algae bloom. 

Students can experience turbidity directly by walking under the water of the pond and seeing how murky it looks on different days.

What was an unexpected outcome of the development process?

The types of “big data” about motivation and learning for each student that EcoMUVE can generate include: time-stamped logfiles of movements and interactions in the virtual world, chat-logs of utterances, and tables of data collected and shared. Other digital tools can provide data from concept maps that chart the flow of energy through the ecosystem and that document each student team’s assertions about its systemic causal relationships, with adduced supporting evidence. Using Go-Pro cameras, students’ collaborative behaviors outside of digital media can be documented. We would like to use this data to provide near-real time feedback to students and teacher, through various forms of visualization.

What were your main research findings from the IES development project?

After using EcoMUVE, students showed gains in learning of science content, and also improvements in their attitudes towards science, particularly in the beliefs they were capable and interested in being scientists. Teachers felt that the curriculum was feasible, well-aligned with standards, and supported student engagement and learning of science content, complex causality, and inquiry, and had multiple advantages over a similar non-MUVE curriculum. A study that looked at student motivation found that, while at first students were most enthusiastic about the 3D virtual world and game-like environment, over time their engagement centered on the inquiry-based pedagogy and the collaborative problem-solving.  Gains were also found in students’ complex causal reasoning about non-obvious causes; distant drivers of ecosystems dynamics and the system parameters; and processes, steady states and change over time.

How has the EcoMUVE project proceeded in recent years since the IES research project ended?  

Beginning in May, 2012, we’ve been pleased to be able to offer a standalone version of the EcoMUVE software for download through a free license from Harvard University. As of January, 2015, over 1,200 users have registered with the website. The EcoMUVE project receives e-mail inquiries almost every week from educators who are interested in the curriculum. In some cases, whole districts have adopted the EcoMUVE curriculum, including Cambridge, MA, and Peoria, AZ.

Internationally, researchers at the University of Hong Kong have been working with Harvard University to use EcoMUVE for professional development, to help teachers understand how to use scientific investigations as learning activities for students. Other collaborators include Sydney University, and Aalborg University in Copenhagen.

Looking ahead, what does the future hold for EcoMUVE?

We continue to make EcoMUVE available for download from our new website, http://ecolearn.gse.harvard.edu. We have been extending our research to develop EcoMOBILE, an extension of the EcoMUVE curriculum that blends immersive virtual environments with the use of mobile technologies during field trips to real ecosystems for observations and data collection. EcoMOBILE is funded by the National Science Foundation (NSF) and Qualcomm’s Wireless Reach Initiative. We have also just started a new research project, EcoXPT, also funded through NSF, designed to work alongside EcoMUVE to support experiment-based inquiry in immersive virtual environments.

Questions? Comments? Please send them to us at IESResearch@ed.gov.

About the Interviewees

Shari J. Metcalf is Project Director of the EcoMUVE project at the Harvard Graduate School of Education. She holds SB and SM degrees from MIT, and a PhD from the University of Michigan, where she designed and developed Model-It, a software tool for students building models of dynamic systems. Her professional focus is the design of educational software tools, and in particular on using modeling, simulation, and virtual immersive environments to support inquiry-based science learning.

Chris Dede is the Timothy E. Wirth Professor in Learning Technologies at Harvard’s Graduate School of Education.  Chris was the Principal Investigator of the EcoMUVE project. His fields of scholarship include emerging technologies, policy, and leadership.  His research includes grants from NSF, IES, and the Gates Foundation to design and study immersive simulations, transformed social interactions, and online professional development.  

By Becky McGill-Wilkinson, NCER Program Officer

Gone are the days of library card catalogs and having to consult the 26-volume hardbound encyclopedia gathering dust on your parents’ bookshelf. Students these days have seemingly infinite information at the tips of their fingers. Most households in the U.S. have a computer, and most teachers report at least one computer in their classrooms. Research shows that the majority of high school students use the Internet to complete school assignments, and 71 percent of students use their laptop computers for school. In this changing world, it becomes more and more important to understand how reading and researching on the Internet are different from performing those tasks with books and other paper texts.

Don Leu and his team at the University of Connecticut have been examining this topic for several years. First on their agenda was studying whether reading online is the same as reading on paper. They discovered that students who are poor readers on paper may be good readers online, and students who are good readers on paper are not necessarily good readers online, suggesting that reading online requires some unique skills. Leu and his collaborators argue that reading online requires that students be able to: (1) use search engines; (2) choose appropriate search result; (3) judge whether the source can be trusted to be accurate and unbiased; and (4) consolidate information across multiple websites or online texts.

Of course, it’s not enough to understand the process of reading and researching online. As with any skill, some students are better at it than others, and as computers, tablets, and smart phones become more common, it becomes more and more necessary for students to hone their online reading and research skills if they are to succeed in college and career. Teachers need to be able to teach these skills, and teachers need to be able to identify when their students need extra help or practice. In 2005, Leu received a grant from NCER to study Internet use in adolescents at risk for dropping out of school, and developed an intervention to help teach seventh-grade students specific strategies to locate, evaluate, synthesize, and communicate information on the Internet.

Building on this earlier work, in a 2009 grant from NCER, Leu and his team set out to develop measures of online reading comprehension. The end result of this project is a set of Online Research and Comprehension Assessments (ORCAs) for use with seventh grade students. The team developed both a multiple choice version and a version that allows students to work in a simulated internet environment. In both versions, the student is tasked with answering a research question posed by a simulated peer, and must use a search engine, choose the appropriate search result, determine whether a source is trustworthy, and then tell their simulated peer about what they found. The ORCAs were tested with 2,700 students in two different states, and the researchers surveyed teachers and other practitioners to determine whether the ORCAs were usable.

Leu has been especially interested in thinking about how changing ideas about literacy may impact low-income students differently from middle- and high-income students. In a recently published paper, Leu shows that students who came from families earning approximately $100,000 per year were more than a year ahead of students whose families earn approximately $60,000 per year on online reading abilities as measured by the ORCAs. This study highlights the importance of considering the achievement gaps between high- and low-income students on a variety of domains, including those not typically measured by standardized tests, such as online reading comprehension.

The ORCAs are available online for free, as is a professional development module to help teachers learn to use it. 

Questions? Comments? Please email us at IESResearch@ed.gov.

By Liz Albro, NCER Associate Commissioner of Teaching and Learning

Good Luck to Applicants!

Application deadlines for our main NCER and NCSER competitions have come and gone this month. We accepted applications for 5 competitions on August 6^th and 3 competitions on August 20^th. Now it’s time for us to begin screening applications and moving them into the peer review process!

NCER Staff Were Out and About

NCER staff had the opportunity to learn from experts in several meetings during the month of August.

Liz Albro attended the CRESST Conference 2015, where she participated in a session titled: Is There a Role for Evidence in the Future of K-16 Technology? The short answer was yes! She was joined at the meeting by Russ Shilling, the Executive Director of STEM Education at the Department, researchers with expertise in educational data mining, cognitive science, learning analytics, and assessment, and developers of education technology from around the world.

On August 20, NCER convened a technical working group (TWG) meeting on Researching the Influence of School Leaders on Student Outcomes. Nine researchers and practitioners who study education leadership met with ED staff to discuss the lessons learned from research that explicitly connects school leadership to student outcomes and the challenges to conducting such research. Department staff, including NCER’s Katina Stapleton, also presented information about education leadership studies funded by the National Center for Education Research, the National Center for Education Evaluation and Regional Assistance, and the Office of Innovation and Improvement. A meeting summary will be available soon on our TWG page.

In the final week of August, Meredith Larson, who oversees our research program on adult education, and Daphne Greenberg, the principal investigator of our National R&D Center, the Center for the Study of Adult Literacy, attended the 2015 National Meeting for Adult Education State Directors hosted by the Department’s Office of Career, Technical, and Adult Education.

Between Parents and Kids: IES-Funded Research in the News

Two publications from IES-funded research hit the national news this month … and both highlighted the critical role that parent-child interactions play in children’s learning outcomes. In one article, featured on WebMD, Paul Morgan and his colleagues reported that 2-year-old children with larger oral vocabularies demonstrated better academic achievement and behavior at kindergarten entry. The team also discussed child and family characteristics that are related to vocabulary size at age 2, which may help identify which groups of children are at risk for needing early language intervention.

In the other, discussed in the New York Times, Sian Beilock, Susan Levine, and their colleagues reported that parents’ math anxiety is related to their young children’s math achievement – and seems to emerge when math-anxious parents try to help their kids with their math homework.

We Said Farewell to Our Interns

As August ended, our summer interns went back to school. We were sad to see them go, but excited for them as the new school year begins. Think you might be interested in interning at IES? Read an interview with one of our interns, and learn how to apply to the internship program at the Department.

Questions? Comments? Please send them to IESResearch@ed.gov. 

By Liz Albro, NCER Associate Commissioner of Teaching and Learning

Welcome to our second “Month in Review” post! In addition to writing blogs, both NCER and NCSER have been busy making new awards this month, and preparing abstracts describing our newly funded projects published on our website. 

New Research Awards

Across the two research centers, IES awarded 148 new discretionary grants to support research and research training activities. I hope that you will take the time to dip into our abstracts describing the individual projects. From early childhood to postsecondary, from basic cognitive science to system-level analysis, from exploration to impact, the projects reflect the wide scope of education research questions that the IES research centers support. To learn more about the awards, click here to read about the new NCSER awards, and here for information about the new NCER awards. Be sure to check back on Monday, July 6^th, to read a new blog from Commissioner Brock discussing the 2015 awards and the forecast for 2016.

IES Funded Research in the News

Research findings from the Cognition and Student Learning portfolio were featured in two EdWeek articles in June. These articles describe some of the exciting work being done to address long-standing questions of transferring knowledge learned in one class or context to support new learning in mathematics  and science.

The ED/IES Small Business Innovation Research (SBIR) portfolio was featured in three different articles in June! Read more about how games developed with SBIR funding are being used to teach students about a wide variety of topics, like algebra, environmental science, and social skills.

IES Staff Presentations

On June 16-17, NCSER co-sponsored a Technical Working Group Meeting with the Department of Education’s Office of Special Education Programs (OSEP) and Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) on Evidence-Based and Emerging Practices: State of Science and Practice for Children with Disabilities.  The meeting was an important opportunity for leaders in the field of special education to share what has been learned across a number of pivotal areas in research and practice and also to identify some promising next steps. A synthesis of the meeting is underway and will be available later this year.

ED/IES SBIR program officer Ed Metz participated in the National SBIR Conference, and led a panel on games for learning.

Applying for IES Research Funding This Summer? Missed Our Webinars?

No problem. PowerPoint presentations and transcripts from the webinars led by our program officers are available on our website. Click here to access information about preparing grant applications for IES. 

By Edward Metz, ED/IES SBIR Program Manager

Did you know that IES provides funding to develop computer games and other applications to support teaching and learning?

The U.S. Department of Education’s Small Business Innovation Research program, operated out of the Institute of Education Sciences (IES), funds projects to develop education technology products designed to support student learning and teacher practice in general or special education. The program emphasizes rigorous and relevant research, used both to inform iterative development and to evaluate whether fully developed products show promise for leading to the intended outcomes. The program also focuses on the commercialization once the award period ends so that products can reach students and teachers, and be sustained over time.

Recently, ED/IES SBIR announced its 2015 awards. There are 21 awards in all, covering a range of topics and forms of technology. For example, Zaption is designing a mobile app to help teachers integrate video into science instruction; Speak Agent is building an app to help students with speech disabilities to communicate; and Lingo Jingo is developing a platform to help teachers guide English learners. (To view short video demos of the eight new Phase II projects, see this playlist.)

The 2015 awards highlight two trends that have emerged in the ED/IES SBIR portfolio in recent years –games for learning and bridging the research-to-practice gap in education.

Trend #1: Games for Learning

For the fourth straight year, about half of the new 2015 ED/IES SBIR awards focus on the development of game-based learning products. New projects include awards to:

• Strange Loop Games to build a virtual world to engage students in learning about ecosystems,
• Kiko Labs to develop mini games to strengthen young children’s thinking and memory skills, and
• Schell Games to create a futuristic “ball and stick” molecular modeling kit and app to augment chemistry learning.

For a playlist including videos of these games and 19 others out of the ED/IES SBIR program, see here.

The games for learning trend echoes the movement surrounding games in the field, and is highlighted by recent ED sponsored events including ED Games Week in Washington, DC, last September and the Games for Learning Summit in New York City, in April. Both events convened stakeholders to showcase games and discuss the potential barriers and opportunities for collaboration necessary to accelerate the creation of highly effective games for learning. Stay tuned for more information and initiatives on games for learning out of ED’s Office of Technology.

Trend #2: Bridging the Research-to-Practice Gap

While ED/IES SBIR is known for making awards to start-ups such as Filament Games, Sokikom, and Handhold Adaptive, the program has also made awards to firms best described as university spin-offs. These firms are designed to transfer findings from federally funded research into learning products that can be used at scale. University researchers often do not have viable pathways or capacity to transfer research-based interventions for real world use.

But with the support of the ED/IES SBIR program, we have firms bridging the research-to-practice gap.  Examples include:

• Mindset Works, which built on results from prior research including a 2002 IES research grant, to successfully propose a 2010 ED/IES SBIR project to develop SchoolKit. This multimedia platform enables broad distribution of the growth mindset intervention which teaches students to understand that intelligence can be developed through effort and learning. SchoolKit is now in use in more than 500 schools across the country, including half the middle schools in Washington, DC.
• Teachley, which received a 2013 ED/IES SBIR award to develop math game apps and a teacher implementation dashboard building on findings from prior research including a 2010 IES research grant. The intervention is now used in hundreds of schools around the country, and the apps have been downloaded more than 500,000 times.
• Learning Ovations is building on two prior IES research grants in their 2014 ED/IES SBIR project. The prior IES funding supported the research team as they developed and evaluated an intervention to improve children’s reading outcomes,. This award is supporting the development of an implementation platform to enable large-scale use of this evidence-based intervention across settings. The project is scheduled to end in 2016, after which the platform will be launched.

The new ED/IES SBIR 2015 awards continue the research-to-practice trend. An award to Foundations in Learning furthers basic research from a 2013 National Science Foundation grant (NSF); an award to SimInsights builds on 2005 and 2008 IES research projects and a 2011 Defense Advanced Research Project Agency (DARPA) research project; and an award to Apprendris advances a prior 2012 IES research project and  prior 2010 and 2013 NSF research projects.

Stay tuned for updates on Twitter @IESResearch and @OfficeofEdTech as ED/IES SBIR projects drive innovative forms of technology, such as games for learning, and enable the scale-up of research-based interventions for wide-scale use.

______________

Please send your comments and questions to IESResearch@ed.gov.