Opinion
Federal Opinion

Rating the Rankings

By Marty Elkins — December 01, 2008 5 min read
  • Save to favorites
  • Print

Last year, the national organization I lead joined a growing list of critics decrying the dubious and hurtful practice of ranking colleges and universities for prospective students. So we were heartened to learn from an item in Inside Higher Ed this summer that the percentage of colleges responding to U.S. News & World Report’s “reputational” survey, the largest piece in its school-ratings equation, declined, in just one year, from 51 percent to 46 percent. It’s fine with us if U.S. News feels anxiety similar to what it causes in others.

That’s because we who work as high schools’ college counselors are tired of publications putting profit ahead of the personal experiences of the young people in our care. We work hard, in partnership with parents, to help adolescents make the first major decision of their adult lives. These are different kids with different abilities, affinities, backgrounds, resources, and many other considerations to take into account. Given the remarkable range of difference among them, we know that it’s simply nonsense, and damaging nonsense, to believe that there exists one and only one No. 1 college, even within the same category of institution, to meet their needs.

Moreover, we know that colleges’ boards of trustees too often use rankings as an easy, inexpensive, and totally inappropriate way to judge the performances of their presidents and deans of admissions, leading those professionals to spend time on misleading measurements, rather than classroom quality.

Also troubling—and for us the “déjà vu all over again” factor—is the copycat syndrome wherein other media players decide it’s easier to do a simple survey and a set of rankings than to do real reporting and writing on the subtle but profound differences that exist for different young people having different educational experiences at different institutions.

Forgoing the complex in favor of the simple-minded, The Wall Street Journal last year committed its own flawed college-ratings fiasco, which we protested. More recently, Forbes magazine has boldly gone where others have gone before—a place where no quality publication needs to tread. Indeed, we wish more would join The Atlantic in realizing its own rankings issues just weren’t the direction for a great magazine to take, a realization that led it to stop.

The Forbes venture, however, begs for greater scrutiny.

In its misguided attempt to sell more magazines, Forbes decided that its criteria for ranking colleges would be the following: alumni appearing in Who’s Who listings, student Web site evaluations, four-year graduation rates, enrollment-adjusted numbers of students and faculty members receiving major competitive awards, and average four-year accumulated student debt of those borrowing money.

These criteria are all subject to a variety of critiques, but before engaging in itemized scrutiny, let’s ask one basic question that goes to an error of omission: Does Forbes care if anyone has learned anything at these colleges and universities? Is there any measurement of what students knew when they entered, in relation to what they knew when they graduated? To engage in a bit of business jargon that might be familiar to readers of Forbes: Where’s the value-added? Such measurements exist, and it’s odd that one doesn’t see a business publication using them.

In the terms Forbes does employ, Who’s Who in America may be a better publication than Who’s Who Among American High School Students, but we wonder if those who have taken the time to fill out its form have also purchased the expensive hard-bound book that includes their self-reported achievements. The exercise in publishing narcissism is one thing; another is the probability that, if a college accepts high-octane, achievement-oriented students, it will probably graduate high-octane, achievement-oriented students. For what, precisely, would the college claim institutional credit? Elite in; elite out. What difference has it made? That might be worth knowing.

Student evaluations are closer to our hearts, because we spend most of our days trying to understand and help young people. But we’ve been around long enough to know that students aren’t always the best judges of what they need. We know they know what they want, and we work between wants and needs most of our days. Thus, we wonder about the usefulness of the Rate My Professors Web site, when its categories for rating are “Easiness,” “Helpfulness,” “Clarity,” and “Hotness.” Yes, we see that Forbes does some numerical inversions to reverse-credit institutions where professors appear to be academically “Hard.” And we note that the magazine does not include the chili-pepper symbol for whether or not a professor is especially attractive—or, in paparazzi parlance, “hot.” Even so, did anyone ask students what they learned from these teachers? That might be worth knowing.

Moving on, four-year graduation rates seem quite reasonable. There is far too much emphasis on where one gets in, and not nearly enough on where one stays, thrives, grows, and graduates. So, fair enough. National awards for students and faculty members also appear, at least at first, to be worthy enough. But on reflection, we wonder if those student awards are simply the result of the “elite in, elite out” syndrome mentioned above, as well as the different institutional commitments made to advising, preparing, and recommending potential candidates. Some colleges groom as well as teach. Others just teach.

And that leads us to wonder about those faculty awards. How many of them are given for the recipient’s ability to teach? Is there a Nobel Prize in classroom teaching? What did these “helpful,” “clear,” and award-winning professors impart to their students? Is it valuable knowledge? That might be worth knowing.

Finally, we find the concern over accumulated debt for those not fortunate enough to be “full pays” highly ironic, for two reasons. First, our experience suggests most readers of Forbes aren’t in the accumulated-debt category, because the folks we meet who have time and interest to read about money and business tend not to need much borrowing in the first place. Second, we would expect that anyone who would take these rankings seriously would be more than willing to borrow whatever it takes to climb this rickety ladder—thereby contributing to lowering the standing of the institution and thus reducing the value of the “investment.” Now we’re talking free market!

So, in addition to experiencing that feeling of déjà vu all over again, we note that our baseball sage, Yogi Berra, also said, “You can observe a lot by watching.” What Forbes observed is that U.S. News makes a profit this way. Leave it to magazines to make money hyping the anxieties of students and parents. Those of us not trying to sell anyone anything will do our best to clean up another media mess.

Related Tags:

A version of this article appeared in the December 03, 2008 edition of Education Week as Rating the Rankings

Events

English Learners Webinar How Can School Districts Better Support English Learners With Disabilities?
Join this webinar to hear recent findings from the EdWeek Research Center and discover practical strategies for improvement.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Classroom Technology Webinar
Better Tools, Not More: What Educators Say About Teaching and Technology
Optimism is up. AI use is rising. Coherence is the next challenge. Hear what the 2026 Educator Confidence Report reveals about the field.
Content provided by HMH
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Achievement Webinar
The Relationship Advantage for Attendance, Engagement, and Achievement
Relationship-building goes beyond back-to-school. Get practical ideas from district leaders and educators to strengthen student connections.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Opinion Margaret Spellings and Arne Duncan: The Ed. Agenda We Can Agree On
We need to get education back on track, write the former Ed. Secretaries. Let’s start at the top.
Margaret Spellings & Arne Duncan
•
5 min read
Government research, State budgets, public education, back on track, Education Agenda
Vanessa Solis/Education Week + Getty
Federal Q&A A Top Democrat Breaks Down His Party's Plans for K-12 in a House Majority
If Democrats retake the House, Rep. Bobby Scott may be in a position to set his chamber’s K-12 agenda.
5 min read
Rep. Bobby Scott, D-Va., speaks during a prayer vigil held by the Chesapeake Coalition of Black Pastors at The Mount (Mount Lebanon Baptist Church) in Chesapeake, Va., Sunday, Nov. 27, 2022, for the six people killed at a Walmart in Chesapeake, Va., when a manager opened fire with a handgun before an employee meeting Tuesday night.
Rep. Bobby Scott, D-Va., speaks during a prayer vigil in Chesapeake, Va., on Nov. 27, 2022. Scott is the ranking Democrat on the U.S. House of Representatives' education committee and will seek the panel's chairmanship if Democrats win a House majority in next month's elections.
Carolyn Kaster/AP
Federal What a Democratic Congress Could Mean for Trump's K-12 Agenda
They may try to reverse—or at least investigate—the Trump admin.'s efforts to dismantle the Ed. Dept.
9 min read
House Minority Leader Hakeem Jeffries, D-N.Y., the top Democrat in the Republican-majority House, is joined by Rep. Pete Aguilar, D-Calif., chair of the House Democratic Caucus, as they criticize President Donald Trump and his policies while talking to reporters about the approaching midterm election, at the Capitol in Washington, Thursday, Sept. 17, 2026.
House Democratic Leader Hakeem Jeffries speaks at the U.S. Capitol on Sept. 17, 2026. He's joined by Rep. Pete Aguilar, D-Calif., who chairs the House Democratic Caucus. If Democrats gain a majority of either chamber of Congress after next month's elections, they'll be able to hold oversight hearings on and launch investigations into the dismantling of the U.S. Department of Education.
J. Scott Applewhite/AP
Federal The Future of Education Research: More Partisan and Largely Left to States?
As Trump administration works to change federal grants, outside researchers try to regroup.
6 min read
Image of file folders with tabs called "funding" "grants" "projects" and a blank note paper paperclipped to the outside.
Collage by Laura Baker/Education Week + Getty