Find your next job fast at the Jan. 28 Virtual Career Fair. Register now.
Opinion Blog

Rick Hess Straight Up

Education policy maven Rick Hess of the American Enterprise Institute think tank offers straight talk on matters of policy, politics, research, and reform.

Education Opinion

Stop! Using Research as a Weapon (sung in the style of Pat Benatar)

By Heather Harding — April 22, 2011 3 min read

Note: Heather Harding, vice president for research and public affairs at Teach For America, is guest-posting this week.

First, let me thank Rick Hess for lending me his space while he’s vacationing. It’s been a lot of fun to get these things off my chest and an interesting experience to be so publicly vocal and visible (thinking back to my first post). As I said in a comment responding to the hotly debated TFA as a residency post, my role at Teach For America blends facilitating research on the impact of Teach For America with a responsibility to engage various stakeholders that care about empirical evidence, teacher education and development, and a few stray policy issues. Today, I’d like to say a few brief words about the standards of quality regarding research in the policy debates and the constant questioning of methodology.

Having been trained as a qualitative researcher, the current state of policy research often troubles me. It’s not that I don’t appreciate a good statistical model as much as the next guy; it’s just that when I was in graduate school I learned that the question should define the methodology. Currently, it feels like the narrow focus on test scores has created a context where the tail is often wagging the dog. As we all engage in the what-intervention-has-the-greatest-effect-size game, we forget to consider the more comprehensive impact of our efforts. A lot of research that is actively pursued is about impact on student test score gains--and while this is an important indicator, most of us would agree that it’s only one piece of the puzzle. Secondarily, because this is the currency of policy influence, we are worried about research that doesn’t have this focus. If you are a program in this environment, it behooves you to facilitate a robust body of evidence of your positive impact. This makes sense to me. As a vice president of research, I want to know every way that TFA is impacting the closing of the achievement gap. I want to promote measurement of that impact and I want to aid my internal colleagues in their cycles of continuous improvement for our admissions process, our teacher training, our teacher development, and our alumni support.

Unfortunately, the larger public discourse is out of sync with this goal because there is a fair amount of defense being played. The back and forth nature of the debate obscures our ability to consider what was learned in any given study--especially if it is perceived as negative. It cripples our desire to be collaborative in research. It also exposes the lack of trust that has developed between practitioners and researchers. We have all suffered at the hands of a political think tank research culture that has manufactured findings as opposed to seeking truth.

To make matters worse, programs are then compelled to engage in a defensive strategy, especially in the current media world, that I’ll call ‘attack the methodology.’ See KIPP’s response to Gary Miron’s study. I point to the KIPP example not to begrudge KIPP’s right to have a fair and accurate accounting of their work, but to highlight the difficulty of having a critical discussion regarding impact in an environment where a single bad result means a challenge to one’s existence. We also must acknowledge that all research isn’t equal and that despite the imperfect ways we rank and assess the quality of studies, we must aspire to something that reviews the match between question and methodology and reveals the underlying motives and biases of research instruments--whether that is methods or people.

I strongly believe that in education, it’s important to understand our impact broadly. That student learning and the learning environment are important factors for realizing the day when educational inequity is not so prevalent. But if we don’t stop using research as a weapon, we will continue to learn what we already know and be doomed to have the same arguments over and over with little advancement.

--Heather Harding

The opinions expressed in Rick Hess Straight Up are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
Branding Matters. Learn From the Pros Why and How
Learn directly from the pros why K-12 branding and marketing matters, and how to do it effectively.
Content provided by EdWeek Top School Jobs
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
How to Make Learning More Interactive From Anywhere
Join experts from Samsung and Boxlight to learn how to make learning more interactive from anywhere.
Content provided by Samsung
Teaching Live Online Discussion A Seat at the Table With Education Week: How Educators Can Respond to a Post-Truth Era
How do educators break through the noise of disinformation to teach lessons grounded in objective truth? Join to find out.

EdWeek Top School Jobs

BASE Program Site Director
Thornton, CO, US
Adams 12 Five Star Schools
Director of Information Technology
Montpelier, Vermont
Washington Central UUSD
Great Oaks AmeriCorps Fellow August 2021 - June 2022
New York City, New York (US)
Great Oaks Charter Schools
Director of Athletics
Farmington, Connecticut
Farmington Public Schools

Read Next

Education Briefly Stated Briefly Stated: January 13, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Obituary In Memory of Michele Molnar, EdWeek Market Brief Writer and Editor
EdWeek Market Brief Associate Editor Michele Molnar, who was instrumental in launching the publication, succumbed to cancer.
5 min read
Education Briefly Stated Briefly Stated: December 9, 2020
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated Briefly Stated: Stories You May Have Missed
A collection of articles from the previous week that you may have missed.
8 min read