Education Opinion

The Truth About Test Scores

By Walt Gardner — July 14, 2014 2 min read

If there’s one thing that is sure to turn off most editors, it’s essays about standardized test scores. Whether it’s because they assume that all tests are created equal or that the subject intrinsically lacks sex appeal, attempts to clarify matters usually fall on deaf ears. One exception is “Test Scores Are No Sure Guide to What Students Know” (The Wall Street Journal, Jul. 12).

The takeaway line is that standardized tests “reveal less about what children know than about the way the test makers decide to measure that knowledge.” This encompasses two key elements that are poorly understood by taxpayers. The first refers to the design of standardized tests, and the second refers to the validity of inferences drawn about test results.

It’s not hard to design a test that has a high likelihood of producing just about any outcome desired. Let’s not forget that a test cannot possibly measure all that is taught. Therefore, designers rely on sampling what they believe are the most important concepts in any given subject. But suppose the mission is to sort out students (e.g., the SAT). If the test were heavily loaded up with items assessing only the most important material that was well taught, scores would likely be clumped together, making comparisons unsatisfactory. In that case, the testing company would not remain in business very long because it had not delivered on its promise.

To avoid that possibility, designers deliberately include some items that have a low probability of being taught. This is not at all fair, but it is extremely useful. As a result, the public will draw invalid inferences about the effectiveness of instruction in the schools they support with their taxes. The same invalid inferences can be drawn by the arbitrary way that cut scores are determined. The public demands to know how many students are “proficient” in any given subject. By manipulating the scale changes, designers can help mold judgments about how many students fall into that category.

As unpopular as it is, assessment is an indispensable part of the teaching-learning process. Without feedback, it’s extremely difficult to know what’s working. I realize that experienced teachers can tell whether their students are getting what is taught by strategies other than traditional tests. But the accountability movement demands hard data. And nothing seems to satisfy reformers like standardized tests. That’s unfortunate because these instruments hardly tell the whole story.

The opinions expressed in Walt Gardner’s Reality Check are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Let us know what you think!

We’re looking for feedback on our new site to make sure we continue to provide you the best experience.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Future of Work Webinar
Digital Literacy Strategies to Promote Equity
Our new world has only increased our students’ dependence on technology. This makes digital literacy no longer a “nice to have” but a “need to have.” How do we ensure that every student can navigate
Content provided by Learning.com
Mathematics Online Summit Teaching Math in a Pandemic
Attend this online summit to ask questions about how COVID-19 has affected achievement, instruction, assessment, and engagement in math.
School & District Management Webinar Examining the Evidence: Catching Kids Up at a Distance
As districts, schools, and families navigate a new normal following the abrupt end of in-person schooling this spring, students’ learning opportunities vary enormously across the nation. Access to devices and broadband internet and a secure

EdWeek Top School Jobs

Speech Therapists
Lancaster, PA, US
Lancaster Lebanon IU 13
Elementary Teacher
Madison, Wisconsin
One City Schools
Elementary Teacher - Scholars Academy
Madison, Wisconsin
One City Schools

Read Next

Education Obituary In Memory of Michele Molnar, EdWeek Market Brief Writer and Editor
EdWeek Market Brief Associate Editor Michele Molnar, who was instrumental in launching the publication, succumbed to cancer.
5 min read
Education Briefly Stated Briefly Stated: December 9, 2020
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated Briefly Stated: Stories You May Have Missed
A collection of articles from the previous week that you may have missed.
8 min read
Education Briefly Stated Briefly Stated: Stories You May Have Missed
A collection of stories from the previous week that you may have missed.
8 min read