Opinion
Teaching Profession Opinion

How and Why Rankings Matter

By Karen Hunter Quartz, Kenneth T. Kishida, Dongni Yang, Steven R. Quartz & P. Read Montague — April 03, 2012 5 min read
  • Save to favorites
  • Print

Jane takes off her jewelry and prepares to have her brain scanned by a very strong magnet in the Human Neuroimaging Lab at the Baylor College of Medicine in Houston. Inside the scanner, gazing at a screen above her head, Jane uses a hand-held controller to solve the first set of standardized-test items. Then the experiment in social neuroscience begins. Today, Jane is taking an IQ test with five others, all connected in an online environment. Alongside the test questions, Jane and the other group members start to see how their performance on the last 10 items compares—where they rank in the group. What do you think happens to Jane’s performance as the experiment continues?

Social neuroscience is an emerging discipline that is discovering how extraordinarily tuned our brain is for social life. The feedback about social rank in our experiment was intended to mimic the real-life status cues we consciously and unconsciously infer from everyday social settings. Is our cognitive brain an island unto itself, as traditionally conceived, or can social cues influence something as impermeable-seeming as IQ? Our study of Jane and 69 other subjects was designed to probe these questions. Its findings reveal the profound role status cues play in shaping our cognitive performance and suggest that the sharp distinction between the social and cognitive brain is artificial.

These findings have implications for how and why rankings matter in all human social endeavors and provide a new empirical perspective to inform the current debate about whether and how to rank teachers.

Our study identified the brain regions involved in processing reputation or social status and watched how these processes shape cognitive performance. Two people in each small group of five were randomly selected to take the test while undergoing a technique called functional magnetic resonance imaging, or fMRI, so we could watch how their brains responded to this ranking feedback.

For Jane and all the other subjects, the “how do I rank?” feedback mattered. It caused stress and anxiety and depressed their performance. In the scanned subjects, we saw a significant effect in the amygdala, a brain region associated with fear, anxiety, and emotional arousal, which was associated with a reduction of activity in areas involved in problem-solving. What happened after the initial round of feedback, however, was fascinating. One group of subjects regained their footing, while the performance of another group that included Jane continued to spiral downward—an average of 17 points on the IQ test, more than a standard deviation. The take-away message is that ranking feedback can affect performance on cognitive tasks, with negative consequences for particular groups.

Other researchers, such as the social psychologist Claude Steele, have conducted experiments showing that stereotypes—society-level signals about social status—can also be harmful to individuals’ intellectual performance. Significant research has demonstrated that we are very sensitive and responsive to information, whether objective rankings or social stereotypes, about how we stack up in a group. In our brains, a positive change in social rank or status is comparable to other motivators of animal and human behavior such as food and money. On the flip side, negative rankings, stereotypes, and low status can derail our learning and potential. So, in the context of schools as workplaces, what exactly will we be selecting for if we measure teachers using ranked results based on standardized tests? And how might this ranking feedback interact with teachers’ performance in the classroom?

The take-away message is that ranking feedback can affect performance on cognitive tasks, with negative consequences for particular groups."

Ranking teachers according to the value they add to their students’ standardized-test scores is a practice that seems to be gaining steam. A recent study for the National Bureau of Economic Research by Harvard’s Raj Chetty and his colleagues found that there are far-reaching benefits for students of having high “value added” teachers, such as higher college-going rates and future incomes. These findings almost sound like the promises of the early IQ-test developers. Although the researchers caution that this study was conducted in a low-stakes environment, their findings provide fodder for the growing policy community that seeks to evaluate, promote, and fire teachers based on competitive value-added rankings. How much these rankings should count or be weighted is the subject of much debate, but how are the debaters accounting for the effects of the rankings themselves?

Two summers ago, when hundreds of teachers logged on to the Los Angeles Timespublic database to view their rankings, how did they experience the feedback? From the public accounts and conversations with teachers, shame and humiliation for the lowest-ranking teachers seemed to eclipse any potential benefits and further crippled morale in a district plagued by financial woes and layoffs. As a result, the term “value added” seemed to recede in the district’s lexicon, replaced by a new, branded value-added model called “academic growth over time,” or AGT. Last fall, teachers received confidential “AGT Reports” about their relative rankings. The district intends to use these reports as one of several measures to evaluate teachers, but more importantly, to advance their development as professionals. In Los Angeles, as in many districts throughout the nation, educators are struggling to figure out how to make value-added-ranking feedback educational.

Well-designed studies are now needed to figure out how teachers will experience the ranking feedback that districts and think tanks are preparing for them. Highly polished output and graphs of where teachers stand on a number of measures are in production. How will schools and districts ensure that this ranking feedback doesn’t depress teacher performance and reward only those individuals predisposed to bounce back from “how do I stack up” feedback? In our IQ study, we found that women’s cognitive performance was more likely to be derailed by ranking feedback than men’s. Although this finding is limited by our small sample size, it does support the commonly held view that women are more sensitive than men to social feedback.

In a profession where women outnumber men three to one, school systems must ensure that teacher rankings are used responsibly and communicated in sensitive, professional ways that lead to growth—not shame, fear, and humiliation.

A version of this article appeared in the April 04, 2012 edition of Education Week as How and Why Rankings Matter

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
AI and Educational Leadership: Driving Innovation and Equity
Discover how to leverage AI to transform teaching, leadership, and administration. Network with experts and learn practical strategies.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
Investing in Success: Leading a Culture of Safety and Support
Content provided by Boys Town
Assessment K-12 Essentials Forum Making Competency-Based Learning a Reality
Join this free virtual event to hear from educators and experts working to implement competency-based education.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession New Findings on Teacher Morale Highlight Ways to Make It Better
A new College Board survey on teacher morale echoes some previous findings. But it also highlights opportunities for schools to improve it.
4 min read
A student raises her hand to share her work with her teacher.
A student raises her hand to share her work with her teacher.
Allison Shelley for All4Ed
Teaching Profession Opinion Teacher Contracts Need to Change. And It’s Not Just About Money
If we want to retain effective teaches, we should increase teacher compensation—but we need to do it strategically.
Karen Hawley Miles & David Rosenberg
4 min read
Final Piece Of The Puzzle. Two people about to shake hands over trading a jigsaw puzzle piece needed for the solution.
iStock/Getty Images + Education Week
Teaching Profession The State of Teaching Teachers Say the Public Views Them Negatively
The perception coincides with teachers' low levels of job satisfaction.
2 min read
survey teachers static
via Canva
Teaching Profession Download Play Teacher TV Bingo and Spot All the Teacher Tropes
It's trope bingo; spot the common (and often annoying) mischaracterizations.
Image of bingo cards, a remote control, and a television.
via Canva