Opinion
Teaching Profession Opinion

When Test Scores Become a Commodity

By Jonathan F. Keiler — December 05, 2011 4 min read
  • Save to favorites
  • Print

The recent spate of cheating scandals in cities like Atlanta, Chicago, Los Angeles, and Washington presents an interesting conundrum. Those opposed to education reform schemes tied to the evaluation of student test scores and teacher compensation, or “value added” evaluation, claim that the teachers and administrators who were caught cheating were the victims, compelled to cheat out of fear for their livelihoods. On the other hand, value-added advocates solemnly pronounce that there is no excuse for cheating and that, moreover, cheating teachers and administrators provide the very evidence that reform is necessary. Both positions are valid. Can we work our way out?

The best way to resolve a conundrum, short of dramatically cutting the knot, Alexander-style (which requires chutzpah and a certain genius), is to clarify what the knot is, how it is tied, and then figure out how to undo it. And the reason this particular problem is so knotty—to overuse the metaphor—is that value-added reform systems create one of the most unpredictable and complex artifacts of human societies: a market.

Value-added evaluations both directly and indirectly monetize student performance, and because money is a basic commodity, the process then turns student scores into a commodity. Of course, that performance is not monetized for the students; it is monetized for the teachers and administrators. By making student scores the basis for evaluation, the students and their scores create a market for the teachers and administrators whose livelihoods depend upon the results. And in systems, such as the District of Columbia’s, where scores are not only the basis for teacher retention but also for direct incentives tied to bonus schemes, the market can be even more difficult and complex.

Within a market economy, commodities can be unpredictable and volatile. Investing in commodities, for most people, is tantamount to just plain gambling. In fact, the average commodity investor would have a better chance at blackjack or craps than in the commodity market. Simply put, commodity markets encourage cheating. And when cheating occurs, it occurs because market players view the risk of getting caught worth the reward of greater wealth. And even if direct cheating doesn’t take place, these markets reward questionable practices that, while not technically cheating, are close to the edge.

Value-added evaluations both directly and indirectly monetize student performance, and because money is a basic commodity, the process then turns student scores into a commodity."

A good example of this would be the commodity markets that don’t actually reward excellence in production. In some cases, as farms overproduce and prices drop, the government must step in to stabilize the free-fall, often through schemes that pay farmers not to grow crops. By essentially monetizing student test scores, we do the same thing to education. We are rewarding teachers for turning out kids with good test scores, even if they are not necessarily well educated.

In the first cheating scandals, we already saw some of this dynamic occurring. The cheating was organized and carried out by numerous teachers and administrators working in concert, the same way less productive farmers might attempt to pressure more successful colleagues, through social and political pressure first, but then, in desperation, sometimes through active protest or sabotage. It’s not right, but it happens.

When student scores become like orange juice, pork bellies, or yen, the people with the greatest incentive to cheat are the weakest teachers and administrators. These people might be weak, but that doesn’t mean they are stupid. Weak but clever educators will inevitably find ways to game the system, sometimes by cheating, but more often by coming close, but not stepping over the line: Educators could turn their courses into nothing but test-prep machines; they could refuse to collaborate with colleagues; they could curry favor with students to encourage better results; or take other steps we can’t imagine. Many of these weaker teachers, even short of cheating, might well end up with excellent “value added” scores, while stronger teachers who are honest and don’t play the sharp game end up looking bad.

This is not just a possible bad outcome, it is inevitable. It is inevitable because markets generate such behavior and dislocations, and the more volatile the market, the greater the undesirable behavior and dislocations will be.

So when we speak about value-added evaluations, let’s be clear about what kind of knot we’ve tied. It is a system that turns student scores into a market and, as such, creates cheating, disreputable practices, and dislocations. On the flip side, let’s also talk straight about the cheaters. Like dishonest or corrupt traders, the educators are not the victims, but rather sophisticated, savvy players. Many will get away with it and be honored for their work, as some cheating administrators and teachers were before they were caught. And many teachers and administrators who don’t technically cheat, but find ways to game the market “legally” will also be duly honored. Where could this lead? Schools could become little more than test-preparation institutes, ignoring subjects and skills that are not assessed, with faculty members who resent and distrust one another. Meanwhile, many honest and dutiful teachers will go down in flames.

If this is the kind of public school system the American people want, then fine. Let’s just be honest about it.

Related Tags:

A version of this article appeared in the December 07, 2011 edition of Education Week as When Test Scores Become a Commodity

Events

Special Education Webinar Reading, Dyslexia, and Equity: Best Practices for Addressing a Threefold Challenge
Learn about proven strategies for instruction and intervention that support students with dyslexia.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Personalized Learning Webinar
No Time to Waste: Individualized Instruction Will Drive Change
Targeted support and intervention can boost student achievement. Join us to explore tutoring’s role in accelerating the turnaround. 
Content provided by Varsity Tutors for Schools
Student Well-Being K-12 Essentials Forum Social-Emotional Learning: Making It Meaningful
Join us for this event with educators and experts on the damage the pandemic did to academic and social and emotional well-being.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession Opinion 11 Critical Issues Facing Educators in 2023
From health and safety to labor shortages, the coming year is rife with challenges for school leaders and teachers.
5 min read
shutterstock 513761242
Shutterstock
Teaching Profession 'Gaslighting' Is the Word of the Year. Did It Haunt Schools, Too?
The Merriam-Webster word of the year often intersected with schools and teachers in 2022.
3 min read
The highlighted word "Gaslighting" and showing part of its definition to include the word "manipulation" on a computer screen.
iStock/Getty Images Plus
Teaching Profession It's a Nasty Cold and Flu Season, But Some Educators Are Reluctant to Take Sick Days
Many cite the pile of work—and lost learning—that accumulates when they take time off.
6 min read
Sick woman holding tissues and drinking from a mug while working
iStock/Getty Images Plus
Teaching Profession In Their Own Words 'I Just Want to Get Better': A Teacher With Long COVID Retires Earlier Than She'd Hoped
A former Massachusetts teacher shares how long COVID damaged her cognitive abilities and accelerated her retirement.
5 min read
Betsy Peterson, a former K-5 technology teacher who was forced to retire early due to symptoms of long Covid, pictured in her home in Maynard, Mass., on November 21, 2022.
Betsy Peterson, a former K-5 technology teacher in Massachusetts, has been struggling with bureaucratic hurdles and debilitating symptom since contracting COVID at the start of the year.
Angela Rowlings for Education Week