Opinion
Teaching Profession Opinion

When Test Scores Become a Commodity

By Jonathan F. Keiler — December 05, 2011 4 min read
  • Save to favorites
  • Print

The recent spate of cheating scandals in cities like Atlanta, Chicago, Los Angeles, and Washington presents an interesting conundrum. Those opposed to education reform schemes tied to the evaluation of student test scores and teacher compensation, or “value added” evaluation, claim that the teachers and administrators who were caught cheating were the victims, compelled to cheat out of fear for their livelihoods. On the other hand, value-added advocates solemnly pronounce that there is no excuse for cheating and that, moreover, cheating teachers and administrators provide the very evidence that reform is necessary. Both positions are valid. Can we work our way out?

The best way to resolve a conundrum, short of dramatically cutting the knot, Alexander-style (which requires chutzpah and a certain genius), is to clarify what the knot is, how it is tied, and then figure out how to undo it. And the reason this particular problem is so knotty—to overuse the metaphor—is that value-added reform systems create one of the most unpredictable and complex artifacts of human societies: a market.

Value-added evaluations both directly and indirectly monetize student performance, and because money is a basic commodity, the process then turns student scores into a commodity. Of course, that performance is not monetized for the students; it is monetized for the teachers and administrators. By making student scores the basis for evaluation, the students and their scores create a market for the teachers and administrators whose livelihoods depend upon the results. And in systems, such as the District of Columbia’s, where scores are not only the basis for teacher retention but also for direct incentives tied to bonus schemes, the market can be even more difficult and complex.

Within a market economy, commodities can be unpredictable and volatile. Investing in commodities, for most people, is tantamount to just plain gambling. In fact, the average commodity investor would have a better chance at blackjack or craps than in the commodity market. Simply put, commodity markets encourage cheating. And when cheating occurs, it occurs because market players view the risk of getting caught worth the reward of greater wealth. And even if direct cheating doesn’t take place, these markets reward questionable practices that, while not technically cheating, are close to the edge.

Value-added evaluations both directly and indirectly monetize student performance, and because money is a basic commodity, the process then turns student scores into a commodity."

A good example of this would be the commodity markets that don’t actually reward excellence in production. In some cases, as farms overproduce and prices drop, the government must step in to stabilize the free-fall, often through schemes that pay farmers not to grow crops. By essentially monetizing student test scores, we do the same thing to education. We are rewarding teachers for turning out kids with good test scores, even if they are not necessarily well educated.

In the first cheating scandals, we already saw some of this dynamic occurring. The cheating was organized and carried out by numerous teachers and administrators working in concert, the same way less productive farmers might attempt to pressure more successful colleagues, through social and political pressure first, but then, in desperation, sometimes through active protest or sabotage. It’s not right, but it happens.

When student scores become like orange juice, pork bellies, or yen, the people with the greatest incentive to cheat are the weakest teachers and administrators. These people might be weak, but that doesn’t mean they are stupid. Weak but clever educators will inevitably find ways to game the system, sometimes by cheating, but more often by coming close, but not stepping over the line: Educators could turn their courses into nothing but test-prep machines; they could refuse to collaborate with colleagues; they could curry favor with students to encourage better results; or take other steps we can’t imagine. Many of these weaker teachers, even short of cheating, might well end up with excellent “value added” scores, while stronger teachers who are honest and don’t play the sharp game end up looking bad.

This is not just a possible bad outcome, it is inevitable. It is inevitable because markets generate such behavior and dislocations, and the more volatile the market, the greater the undesirable behavior and dislocations will be.

So when we speak about value-added evaluations, let’s be clear about what kind of knot we’ve tied. It is a system that turns student scores into a market and, as such, creates cheating, disreputable practices, and dislocations. On the flip side, let’s also talk straight about the cheaters. Like dishonest or corrupt traders, the educators are not the victims, but rather sophisticated, savvy players. Many will get away with it and be honored for their work, as some cheating administrators and teachers were before they were caught. And many teachers and administrators who don’t technically cheat, but find ways to game the market “legally” will also be duly honored. Where could this lead? Schools could become little more than test-preparation institutes, ignoring subjects and skills that are not assessed, with faculty members who resent and distrust one another. Meanwhile, many honest and dutiful teachers will go down in flames.

If this is the kind of public school system the American people want, then fine. Let’s just be honest about it.

Related Tags:

A version of this article appeared in the December 07, 2011 edition of Education Week as When Test Scores Become a Commodity

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession Forget the Free Food and Gift Cards. Here's the Kind of Recognition Teachers Really Want
New survey results reveal what teachers and administrators find to be the most meaningful type of acknowledgment from a supervisor.
4 min read
Thank you card inside a brown envelope left on desk
iStock / Getty Images Plus
Teaching Profession The State of Teaching 'You Don't Know Teacher Tired': Educators Sound Off on Misconceptions
Hear what teachers featured in EdWeek's The State of Teaching Project say makes their jobs more difficult.
Frank Rivera teaches 7th grade ELA at Chaparral Star Academy in Austin, Texas, on Nov. 15, 2023.
Frank Rivera teaches 7th grade ELA at Chaparral Star Academy in Austin, Texas, on Nov. 15, 2023.
Montinique Monroe for Education Week
Teaching Profession Opinion Why I’m Happy Being ‘Just a Teacher’
Not every teacher is an aspiring administrator. That’s a good thing.
Amanda Myers
3 min read
Abstract vector illustration depicting the process of teaching and learning.
DigitalVision Vectors/Getty
Teaching Profession What the Research Says Do Teachers Really Earn More After Leaving the Classroom? Not Necessarily
Nearly a decade after leaving a big urban district, many teachers have yet to recoup income, a study finds.
4 min read
Illustration of woman and steps made of cash.
Getty