Opinion
Education Opinion

Standardized Achievement Tests: Misnamed and Misleading

By W. James Popham — September 19, 2001 3 min read
  • Save to favorites
  • Print

During the past decade, the educators who operate America’s public schools have been increasingly preoccupied with students’ scores on standardized achievement tests. That’s because schools whose students score high on such tests are thought to be effective, while schools whose students score low are thought to be ineffective. Both thoughts about school effectiveness, however, are often mistaken. The wrong tests are being used.

Concerns about students’ test scores will escalate dramatically, of course, if Congress requires states to give standardized achievement tests each year to all students in grades 3-8. We should take a harder look at these tests and their uses.

Many misperceptions about traditional standardized achievement tests stem from the misleading label achievement pinned on those tests.

To accurately evaluate a school staff’s instructional success, it is almost self-evident that we should determine how much students have learned in that school. Most Americans believe this is what’s being measured by standardized achievement tests such as the Iowa Tests of Basic Skills or the Stanford Achievement Tests. That belief, however, is also mistaken.

Many of the misperceptions that Americans have about traditional standardized achievement tests stem from the misleading label pinned on those tests. Achievement conveys the idea that these tests, as Webster’s Dictionary puts it, measure “knowledge or proficiency in something that can be learned or taught.” In other words, an achievement test would seem to be measuring what students have learned in school.

But this is not the measurement function of traditional standardized achievement tests. Ever since such tests arrived on the scene in the early 1920s, their overriding function has been to permit comparisons among test-takers. Indeed, today’s standardized achievement tests are patterned directly after the Army Alpha, a group-administered intelligence test used in World War I to identify potential officers.

To provide accurate comparisons among test-takers, the Army Alpha and its descendants must make sure that examinees’ scores are widely spread out. If there’s plenty of score-spread, then a test can determine (in relationship to a norm group of previous test-takers) that Chris, for example, scored at the 87th percentile, and Lee scored at the 83rd percentile. Score-spread is imperative if these tests are going to do their job, namely, identifying an examinee’s relative performance.

But to make certain that standardized achievement tests provide accurate comparisons, the developers of these tests include many items that have nothing to do with what’s supposed to be taught in school. Remember, that’s not the measurement mission of these tests.

If you were to review the actual items in a typical standardized achievement test, you'd find many items whose correct answer depends heavily on the socioeconomic status of a child's family.

So, if you were to review the actual items in a typical standardized achievement test, you’d find many items whose correct answer depends heavily on the socioeconomic status of a child’s family. There are also many items that measure the verbal, quantitative, or spatial aptitudes that children inherit at birth. Such items are better suited to intelligence tests. Clearly, items dependent either on the affluence of a student’s family or on a child’s genetic inheritance are not suitable for evaluating schools.

In short, “achievement” tests really aren’t. And because many of their items measure what students bring to school, not what they learn there, traditional standardized achievement tests should have no role in evaluating our schools.

Is it possible to build standardized tests that accurately measure what’s been taught in school? Absolutely. But those tests must be built with that specific role in mind. We need to evaluate a school based on how much students have learned in that school. But we’ll never do so if, because of misunderstandings about the role of traditional standardized achievement tests, we continue to use the wrong tests when judging our schools.

W. James Popham, a University of California, Los Angeles, emeritus professor, is the author of more than 20 books, many of which deal with educational testing.

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and K-12 education jubs at the EdWeek Top School Jobs virtual career fair.
Student Well-Being K-12 Essentials Forum Social-Emotional Learning 2025: Examining Priorities and Practices
Join this free virtual event to learn about SEL strategies, skills, and to hear from experts on the use and expansion of SEL programs.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Professional Development Webinar
Inside PLCs: Proven Strategies from K-12 Leaders
Join an expert panel to explore strategies for building collaborative PLCs, overcoming common challenges, and using data effectively.
Content provided by Otus

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: February 5, 2025
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Quiz News Quiz: Jan. 30, 2025: Interim Ed. Dept. Leader | Navigating Immigration Policies | Teacher Evaluations | And More
Test your knowledge on the latest news and trends in education.
1 min read
President Donald Trump speaks in Emancipation Hall after the 60th Presidential Inauguration on Monday, Jan. 20, 2025, at the U.S. Capitol in Washington. His administration's order to pause potentially trillions of dollars in federal spending this week sent school districts scrambling to figure out which funds might be halted.
President Donald Trump speaks in Emancipation Hall after the 60th Presidential Inauguration on Monday, Jan. 20, 2025, at the U.S. Capitol in Washington. His administration's order to pause potentially trillions of dollars in federal spending this week sent school districts scrambling to figure out which funds might be halted.
Al Drago/AP
Education Briefly Stated: January 29, 2025
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Quiz Education Week News Quiz: Jan. 23, 2025
Test your knowledge on the latest news and trends in education.
1 min read
President Donald Trump speaks in Emancipation Hall after the 60th Presidential Inauguration on Monday, Jan. 20, 2025, at the U.S. Capitol in Washington. His administration's order to pause potentially trillions of dollars in federal spending this week sent school districts scrambling to figure out which funds might be halted.
President Donald Trump speaks in Emancipation Hall after the 60th Presidential Inauguration on Monday, Jan. 20, 2025, at the U.S. Capitol in Washington. His administration's order to pause potentially trillions of dollars in federal spending this week sent school districts scrambling to figure out which funds might be halted.
Al Drago/AP