Opinion
Assessment Opinion

Can Standardized Tests Predict Adult Success? What the Research Says

By Dan Goldhaber & Umut Ozek — October 06, 2019 5 min read
BRIC ARCHIVE
  • Save to favorites
  • Print

The use of standardized tests as a measure of student success and progress in school goes back decades, with federal policies and programs that mandated yearly assessments as part of state accountability systems significantly accelerating this trend in the past 20 years. But the tide has turned sharply in recent years.

Parents, advocates, and researchers have increasingly raised concerns about the role of testing in education. The shift in people’s attitudes about the use of tests and about the consequences of relying (or possibly over-relying) on test scores for the purposes of both school and teacher accountability raises the question: What can tests tell us about the contributions of schools and teachers to student success in the future?

We think it is important to ask this foundational question: How much do we know about whether there is a causal link between higher test scores and success later in life? After all, that is the purpose of education—preparing students to be successful in the future. We explored this question and the role of tests in a recently published article in Educational Researcher. We conclude that any debate about the use of test scores in educational accountability should: (1) consider the significant evidence connecting test scores to later life outcomes; (2) take into account the difficulty of establishing causality between test achievement and later life outcomes; and (3) consider what alternative measures of success are out there and how reliable they are.

What can tests tell us about the contributions of schools and teachers to student success in the future?"

It is certainly reasonable to argue that we should hold schools and teachers accountable for the test performance of their students, but we likely care a whole lot more about tests if they reflect increased learning in school that translates into future success.

There is a vast research literature linking test scores and later life outcomes, such as educational attainment, health, and earnings. These observed correlations, however, do not necessarily reflect causal effects of schools or teachers on later life outcomes. Maybe students who do well on tests are the same students who wake up early in the morning, go to work on time, and work hard, and that’s the reason for their success, not necessarily what they learned in school. Also, differences in test scores could reflect differences in learning opportunities outside of school, including the supportiveness of families or the communities in which students live.

What we do know more definitively about the causality of this relationship comes from a limited number of studies that examine the effects of different educational inputs (for example, schools, teachers, classroom peers, special programs) on both student test scores and later life outcomes. For instance, if a study finds test-score impacts and adult-outcome impacts that are in the same direction, this could be regarded as evidence that test scores (and the learning they represent) have an impact on later life outcomes.

Our view is that studies that might be considered causal do tend to find alignment between effects on test scores and later life outcomes. Perhaps the most influential studies in this strand were published in 2014 by Raj Chetty, John Friedman, and Jonah Rockoff, who found that students who were assigned to teachers deemed highly effective learned more as measured by tests and also were more likely to have better adult outcomes, such as attending college and earning higher salaries.

Another study by Chetty and co-authors examines the long-term effects of peer quality in kindergarten (once again, as indicated by test scores) using the Tennessee Student/Teacher Achievement Ratio experiment. The 2011 study finds that students who are assigned to classrooms with higher achieving peers have higher college attendance rates and adult earnings. Similarly, using that same Tennessee STAR experiment, a study by Susan Dynarski and colleagues that same year looks at the effects of smaller classes in primary school and finds that the test-score effects at the time of the experiment are an excellent predictor of long-term improvements in postsecondary outcomes.

It is also important to recognize that we might not always expect test-score effects of educational interventions to align with adult outcomes. It is easy to make the case that interventions can improve later life outcomes without affecting the cognitive skills of children. Choice schools may, for instance, have stronger pipelines into college, leading to better college-going results while not affecting learning and test results, but we don’t know this conclusively.

Irrespective of one’s views on the degree to which tests predict later life outcomes, we need to think carefully about what abandoning the use of test scores altogether might mean for education policy and practice. From a practical perspective, we can’t wait many years to get long-term measures of what schools are contributing to students. This does not mean that test scores ought to be the exclusive or even primary short-term measures, but if one believes in some form of educational accountability, it is important to consider what alternative measures of success are out there and how reliable they are.

Lessening the weight of tests in accountability calculations is consistent with ESSA, but there are concerns about how “gameable” many of the alternative measures might be. And there is no doubt that we know less empirically about the causal connections between many of these alternative measures and long-term student prospects.

For example, are students assigned to teachers who get good classroom observation ratings likely to have better future prospects? Perhaps, but there is less evidence about this type of measure than there is about test-based measures. And if we do not use test scores in teacher evaluations at all, are we going back to the era of teacher accountability when 99 percent of all teachers across the country were rated satisfactory or better?

People clearly have strong feelings about the worth of—and the harm done by—testing. But whatever our personal feelings, we need to evaluate the power of test scores to predict the outcomes we want for our students and consider what the alternatives might be.

Follow the Education Week Opinion section on Twitter.

Sign up to get the latest Education Week Opinion in your email inbox.
A version of this article appeared in the October 09, 2019 edition of Education Week as How Predictive Are Tests?


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Ensuring Continuity of Learning: How to Prepare for the Next Disruption
Across the country, K-12 schools and districts are, again, considering how to ensure effective continuity of learning in the face of emerging COVID variants, politicized debates, and more. Learn from Alexandria City Public Schools superintendent
Content provided by Class
Teaching Profession Live Online Discussion What Have We Learned From Teachers During the Pandemic?
University of California, Santa Cruz, researcher Lora Bartlett and her colleagues spent months studying how the pandemic affected classroom teachers. We will discuss the takeaways from her research not only for teachers, but also for

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Proven Techniques for Assessing Students with Technology
Dr. Doug Fisher’s proven assessment techniques help your students become active learners and increase their chances for higher learning g...
Content provided by Achieve3000
Assessment Long a Testing Bastion, Florida Plans to End 'Outdated' Year-End Exams
Florida Gov. Ron DeSantis said the state will shift to "progress monitoring" starting in the 2022-23 school year.
5 min read
Florida Governor Ron DeSantis speaks at the opening of a monoclonal antibody site in Pembroke Pines, Fla., on Aug. 18, 2021.
Florida Gov. Ron DeSantis said he believes a new testing regimen is needed to replace the Florida Standards Assessment, which has been given since 2015.
Marta Lavandier/AP
Assessment Spotlight Spotlight on Assessment in 2021
In this Spotlight, review newest assessment scores, see how districts will catch up with their supports for disabled students, plus more.
Assessment 'Nation's Report Card' Has a New Reading Framework, After a Drawn-Out Battle Over Equity
The new framework for the National Assessment of Educational Progress will guide development of the 2026 reading test.
10 min read
results 925693186 02
iStock/Getty