Opinion
Assessment Opinion

We All Need to Get Smarter About Testing

By W. James Popham — July 31, 2018 3 min read
BRIC ARCHIVE
  • Save to favorites
  • Print

There are several big-budget fixes we could make to improve America’s schools. We could substantially reduce the number of students each teacher must teach. Similarly, we could boost the talent level in our teaching force by seriously increasing teachers’ salaries to attract our brightest graduates. Sadly, both of these suggestions cost more money than our nation is currently willing to expend.

There is, however, a far less costly strategy already available and ready to be installed: assessment literacy.

By enhancing the assessment literacy of those among us who have a stake in public education, we could bring about dramatic improvements in U.S. schools. And we could do so for a relative pittance.

So, what is “assessment literacy”? Well, although minor definitional differences exist among its proponents, assessment literacy describes a person’s understanding of what education tests can do—and what they can’t. To be assessment literate, one needs to comprehend the basic concepts and procedures of education testing likely to influence education decisions.

Assessment literacy describes a person’s understanding of what education tests can do—and what they can’t."

It isn’t just necessary for the teachers and administrators involved in the day-to-day operations of our schools to be better informed about education testing. In addition, education policymakers—including legislators and school board members—also need to become assessment literate. Nor dare we forget parents of school-age children and, indeed, all citizens whose society tomorrow will be shaped by the quality of schools today. Today’s students also deserve to understand high-stakes education tests that are increasingly determining their in-school and out-of-school successes.

But how can assessment literacy definitively improve our schools all by its lonesome? The answer is simple: As matters stand, well-intentioned people who, sadly, know squat about education testing are making too many decisions that dramatically diminish the effectiveness of our schools.

One of the most serious errors stemming from decisionmakers’ assessment ignorance takes place when we evaluate the quality of instruction chiefly according to students’ scores on annually administered standardized tests. If students’ test scores are high, instruction is regarded as successful. If students’ scores are low, the opposite judgment is reached. In the United States, we have a century-long history of using standardized tests to compare test-takers. However, scant evidence is available attesting to the ability of today’s standardized tests to do an accurate job in evaluating schools or teachers. The very testing techniques that best compare students often turn out to reduce the evaluative accuracy of such tests, leading to serious and sometimes irrevocable mistakes.

For example, truly skilled educators are mistakenly evaluated as ineffective and called on to change their “weak” instructional approaches. Unskilled educators, mistakenly evaluated as being effective, are not thought to need instructional assistance. Both mistakes result in a worse education experience for students.

Procedures do exist to improve the evaluative accuracy of today’s standardized tests, but decisionmakers rarely implement them because of insufficient assessment literacy. You don’t demand a fix of something you don’t know needs fixing.

Another serious mistake caused by insufficient assessment literacy is the current underutilization of formative assessment. Formative assessment, in which evidence from informal classroom tests is used by teachers to adjust their ongoing instructional procedures—or by students to adjust their current learning tactics—is firmly supported by research. If implemented successfully, formative assessment can actually double the speed of students’ learning, according to researcher Dylan Wiliam.

To reiterate, increased assessment literacy could diminish our reliance on the wrong standardized tests to evaluate teachers—and it could also spur teachers’ increased classroom use of the formative-assessment process. Making either of those changes separately could bring about meaningful improvements in our schools. Making both changes at the same time would lead to whopping improvements in the quality of American schooling. Happily, our nation’s education leaders could pull off this twin-win for mere peanuts. It’s a bargain.

Events

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment ETS Acquires ACT, Signaling Potential Changes for College-Admissions Testing
ETS will acquire ACT, the assessment company known for its college-entrance exam.
3 min read
Group spreads college gospelAlex Lucas, right, a college adviser at Dalton L. McMichael High School in Mayodan, N.C., works with junior Chloe Lester during an ACT Prep session after school, March 11, 2014.
Alex Lucas, right, a college adviser at Dalton L. McMichael High School in Mayodan, N.C., works with junior Chloe Lester during an ACT prep session after school on March 11, 2014. ETS, another assessment organization, is acquiring ACT—though nothing will immediately change for students taking the ACT's college-entrance exam.
Ethan Hyman/Raleigh News &amp; Observer/Tribune News Service via Getty <br/>
Assessment Spotlight From Data to Decisions: How Data Should Shape Instruction, Not Just Measure It
Find out how educators are shifting to real-time, strengths-based data to guide teaching, differentiation, and support.
Assessment NAEP Civics Tests Could Expand to Offer State-by-State Results
The first-ever state-by-state civics results are on the table, as is a new framework for the exam.
6 min read
An American flag decorates the door of the first-grade classroom at North Valley Academy, a patriotic-themed charter school, in Gooding, Idaho on May 7, 2012.
An American flag decorates the door of the first-grade classroom at North Valley Academy, a patriotic-themed charter school, in Gooding, Idaho on May 7, 2012.
Jessie L. Bonner/AP
Assessment Opinion We Need to Stop Overrelying on Student Test Scores
These four educator strategies offer approaches for improving how we evaluate achievement.
6 min read
Conceptual illustration of classroom conversations and fragmented education elements coming together to form a cohesive picture of a book of classroom knowledge.
Sonia Pulido for Education Week