Opinion
Education Commentary

Standardized Achievement Tests: Misnamed and Misleading

By W. James Popham — September 19, 2001 3 min read

During the past decade, the educators who operate America’s public schools have been increasingly preoccupied with students’ scores on standardized achievement tests. That’s because schools whose students score high on such tests are thought to be effective, while schools whose students score low are thought to be ineffective. Both thoughts about school effectiveness, however, are often mistaken. The wrong tests are being used.

Concerns about students’ test scores will escalate dramatically, of course, if Congress requires states to give standardized achievement tests each year to all students in grades 3-8. We should take a harder look at these tests and their uses.

Many misperceptions about traditional standardized achievement tests stem from the misleading label achievement pinned on those tests.

To accurately evaluate a school staff’s instructional success, it is almost self-evident that we should determine how much students have learned in that school. Most Americans believe this is what’s being measured by standardized achievement tests such as the Iowa Tests of Basic Skills or the Stanford Achievement Tests. That belief, however, is also mistaken.

Many of the misperceptions that Americans have about traditional standardized achievement tests stem from the misleading label pinned on those tests. Achievement conveys the idea that these tests, as Webster’s Dictionary puts it, measure “knowledge or proficiency in something that can be learned or taught.” In other words, an achievement test would seem to be measuring what students have learned in school.

But this is not the measurement function of traditional standardized achievement tests. Ever since such tests arrived on the scene in the early 1920s, their overriding function has been to permit comparisons among test-takers. Indeed, today’s standardized achievement tests are patterned directly after the Army Alpha, a group-administered intelligence test used in World War I to identify potential officers.

To provide accurate comparisons among test-takers, the Army Alpha and its descendants must make sure that examinees’ scores are widely spread out. If there’s plenty of score-spread, then a test can determine (in relationship to a norm group of previous test-takers) that Chris, for example, scored at the 87th percentile, and Lee scored at the 83rd percentile. Score-spread is imperative if these tests are going to do their job, namely, identifying an examinee’s relative performance.

But to make certain that standardized achievement tests provide accurate comparisons, the developers of these tests include many items that have nothing to do with what’s supposed to be taught in school. Remember, that’s not the measurement mission of these tests.

If you were to review the actual items in a typical standardized achievement test, you'd find many items whose correct answer depends heavily on the socioeconomic status of a child's family.

So, if you were to review the actual items in a typical standardized achievement test, you’d find many items whose correct answer depends heavily on the socioeconomic status of a child’s family. There are also many items that measure the verbal, quantitative, or spatial aptitudes that children inherit at birth. Such items are better suited to intelligence tests. Clearly, items dependent either on the affluence of a student’s family or on a child’s genetic inheritance are not suitable for evaluating schools.

In short, “achievement” tests really aren’t. And because many of their items measure what students bring to school, not what they learn there, traditional standardized achievement tests should have no role in evaluating our schools.

Is it possible to build standardized tests that accurately measure what’s been taught in school? Absolutely. But those tests must be built with that specific role in mind. We need to evaluate a school based on how much students have learned in that school. But we’ll never do so if, because of misunderstandings about the role of traditional standardized achievement tests, we continue to use the wrong tests when judging our schools.

W. James Popham, a University of California, Los Angeles, emeritus professor, is the author of more than 20 books, many of which deal with educational testing.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Future of Work Webinar
Digital Literacy Strategies to Promote Equity
Our new world has only increased our students’ dependence on technology. This makes digital literacy no longer a “nice to have” but a “need to have.” How do we ensure that every student can navigate
Content provided by Learning.com
Mathematics Online Summit Teaching Math in a Pandemic
Attend this online summit to ask questions about how COVID-19 has affected achievement, instruction, assessment, and engagement in math.
School & District Management Webinar Examining the Evidence: Catching Kids Up at a Distance
As districts, schools, and families navigate a new normal following the abrupt end of in-person schooling this spring, students’ learning opportunities vary enormously across the nation. Access to devices and broadband internet and a secure

EdWeek Top School Jobs

Speech Therapists
Lancaster, PA, US
Lancaster Lebanon IU 13
Elementary Teacher
Madison, Wisconsin
One City Schools

Read Next

Education Briefly Stated Briefly Stated: January 13, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Obituary In Memory of Michele Molnar, EdWeek Market Brief Writer and Editor
EdWeek Market Brief Associate Editor Michele Molnar, who was instrumental in launching the publication, succumbed to cancer.
5 min read
Education Briefly Stated Briefly Stated: December 9, 2020
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated Briefly Stated: Stories You May Have Missed
A collection of articles from the previous week that you may have missed.
8 min read