A groundbreaking new experimental study with more than 12,000 ninth grade students in the United States confirmed that a low-cost online program that takes less than an hour to complete can help students develop a growth mindset — the belief that intellectual abilities are not fixed but can be developed. This is important because student motivation often suffers when students have been exposed to the idea that their intellectual abilities can't change.
David Yeager, associate professor of psychology at University of Texas at Austin, led a multi-disciplinary team of researchers including Maithreyi Gopalan, assistant professor of education (educational theory and policy) in the Penn State College of Education Department of Education Policy Studies, to conduct the National Study of Learning Mindsets (NSLM), the largest-ever randomized controlled trial of a growth mindset program in the U.S. in K-12 settings. Other researchers on the study team include internationally-recognized experts from the fields of education, psychology, sociology, economics and statistics, many of whom are members of the Mindset Scholars Network.
"The National Study is the most important study we've ever done," Yeager said. "Not only did it confirm the effects of the growth mindset in the most rigorous way we could think of, it also showed us how much more there is to learn. It marks the beginning of the next phase of mindset research — a phase that will focus on how to make growth mindset truly come alive in learning environments."
The results of the growth mindset intervention are summarized in a new paper published today (Aug. 7) in the journal Nature.
"This research collaboration has been a highlight in my professional development as a scholar, because as a policy scholar I am interested in bringing psychological insights to bear on education policy. I am so delighted to have played a role in one of the most ambitious projects I know," said Gopalan, who also is a Social Science Research Institute (SSRI) co-funded faculty member.
Her role was to analyze the representativeness of the NSLM analytical sample by comparing it to national data of all high schools in the United States across several key school- and district-level characteristics.
"While the sampling design was thoughtfully constructed at the school recruitment stage, my analysis of the representativeness of the final 65 schools included in the study gave us more confidence that the results from the NSLM are generalizable to the nation," Gopalan said.
"Her contributions to the NSLM provided confirmation of an essential claim of the study, which is that the results of the study can be reasonably generalized to the population as a whole," Yeager said. "This was the first time that a such an analysis has been conducted for a national, random sample of schools in an education experiment, and it was deeply important to our research report."
Gopalan also did an important analysis that looked at compliance.
"A chronic problem in education research is that people don't implement the treatment with fidelity. Dr. Gopalan's analysis shows that the same conclusions held even when you account for the very small levels of non-compliance," said Yeager.
Each year, nearly 20% of students in the United States do not finish high school on time. These students are at high risk for poverty, poor health and early mortality.
The transition to high school in ninth grade represents an important point in adolescents' paths toward high school completion and long-term success. The study examined what can be done at this time to improve their outcomes.
Psychological "interventions" like the one tested in the NSLM do not change the curriculum or teachers, but rather change how adolescents think or feel about themselves or their schoolwork in ways that encourage them to stay motivated when school is challenging and take advantage of the learning opportunities available in their school environment. Prior research had found that such interventions can improve academic outcomes in smaller samples, but it was not yet clear if these interventions could work on a national level and the conditions under which such interventions might be most effective.
Both lower- and higher-achieving students benefited academically from the program. On average, lower-achieving students who took the program earned significantly higher grades in ninth grade, and both higher- and lower-achieving students selected more challenging math courses in 10th grade.
The research also revealed important insights about how school context can affect the impact of the growth mindset program.
Lower-achieving students who attended schools in which the peer climate (the "norms") supported the pursuit of challenging work registered the largest improvements in grades as a result of receiving the program.
A Milestone for Mindset Science
The pioneering work of Stanford University psychology professor Carol Dweck revealed a critical insight about education: Students who believe they can grow their intellectual ability tend to perform better academically than students who believe intelligence is simply a fixed trait, like height or eye color. Since Dweck's early work in the 1990s, many carefully done studies have observed a link between growth mindset and academic performance and shown that students can be taught a growth mindset.
Many exciting questions grew out of this work: Under what conditions can students be taught a growth mindset most effectively? Can a brief growth mindset program have an impact on students' longer-term success? These are questions tackled by the research team in this study.
The NSLM used a nationally-representative probability sample of U.S. high schools to evaluate a carefully developed and extensively pilot-tested online growth mindset program. Like most high-quality educational evaluations, this study was able to isolate the causal impact of the program through use of a randomized experiment.
Unlike most other educational evaluations, however, this study took place in a sample of schools that was selected randomly, thus ensuring that generalizations from the sample to the U.S. population of high schools could be made. This use of random sampling in the NSLM therefore gives greater confidence that the results can be applied to the nation than any other past study.
"The National Study of Learning Mindsets is a major milestone for science," said Yeager. "The research cemented a striking finding from multiple earlier studies: A short intervention can have an unlikely outcome — it can change adolescents' grades many months later. The study also showed us something new. Students who already get high grades don't get higher grades when they get the treatment, but they are more likely to take harder mathematics classes that can set them up for long-term success.
"Additionally," Yeager continued, "the National Study offered a novel way to understand what is called 'treatment-effect heterogeneity,' or the tendency for an intervention to be more or less effective in certain contexts or with different populations. This is important because in the past researchers have been happy to say that their effects were good, overall, in the particular sample they studied and move on. We went the next step to identify schools where effects were stronger or weaker so that we could begin to assess changes schools could make to magnify growth mindset effects on student outcomes."
"I am absolutely delighted to see how far mindset science has come," said Dweck. "The early research showed that helping students develop a growth mindset could be a new way to help more students succeed. Now, as a field we are starting to understand how to do this at scale — and we are understanding the role of supportive learning environments that can maximize the benefits of a growth mindset. I am proud to be part of the team that designed and carried out this new and important study," she said.
"The most exciting aspect of being part of this research team is that this paper in Nature is the first of many more papers to come from the NSLM," said Gopalan, who last year was selected as an early career fellow by the Mindset Scholars Network after submitting a competitive research proposal to analyze the NSLM.
"In that project we hope to further tease out some of the mechanisms through which growth mindset interventions might be promoting the positive academic outcomes using econometric techniques. I am working on that project independently with the lead researcher of the NSLM, with generous funding from the Bezos Family Foundation and support from the Mindset Scholars Network and the University of Texas, Austin Population Research Center. So, stay tuned," she said.
Funding for this first phase of the National Study of Learning Mindsets was provided by the Bezos Family Foundation, Character Lab, Houston Endowment, The Eunice Kennedy Shriver National Institute of Child Health and Human Development, National Institutes of Health, National Science Foundation, Raikes Foundation, Spencer Foundation, the Center for Advanced Study in the Behavioral Sciences and the President and Dean of Humanities and Social Sciences at Stanford University, and William T. Grant Foundation.
The Growth Mindset for Ninth Graders intervention tested in the study is now freely available to schools in the U.S. and Canada at https://www.perts.net/orientation/hg online.
More information about the National Study of Learning Mindsets and the intervention is available on the Mindset Scholars Network website at http://mindsetscholarsnetwork.org/about-the-network/current-initatives/national-mindset-study/