Opinion
School & District Management Letter to the Editor

‘No Effects’ Research and the Realities of Learning

April 21, 2009 3 min read
  • Save to favorites
  • Print

To the Editor:

I read with considerable interest your article “‘No Effects’ Studies Raising Eyebrows” (April 1, 2009), which reported on a recent lack of findings from research sponsored by the Institute of Education Sciences. As befitting the story’s suggestive April Fools’ Day publication, it seemed to obscure the fact that any research design, including randomized controlled trials, has the potential to be poorly executed or misinterpreted in a way that arches eyebrows.

The relative prevalence of “no effects” findings in such trials, moreover, is hardly a compelling indictment on the increased use of this methodology. Rather, it is exactly what we should expect when undertaking credible assessments of interventions focused on the difficult challenges of helping students and teachers achieve their potential.

Nonetheless, there are still ways in which the institute’s research might be improved. Most notably, we could reasonably expect fewer “no effects” findings if the IES were to direct research agendas with the same political and budgetary autonomy that characterizes the National Science Foundation and the National Institutes of Health.

Analogies to medical research and practice can be particularly apt as the mix of methodologies used in education research continues its transition toward those used in other professional and scientific fields. We all want doctors and nurses who practice a craft that is wise, nuanced, responsive, and compassionate in ways that cannot easily be evaluated by randomized controlled trials. But we can and do rightfully insist that the training and practice of this craft also be informed by extensive bodies of rigorous evidence that only these trials can generate.

Thomas S. Dee

Associate Professor of Economics

Director, Public Policy Program

Swarthmore College

Swarthmore, Pa.

To the Editor:

Ah, the futility of it all. So much money, so much time spent, and so little to show for it.

Despite several valiant responses by supporters to the disappointing results of “scientifically based” education research studies, I have to question the apparently overly structured methodology applied to some messy education questions. Advocates quoted in your article say it’s “in the nature of evaluation science to find more inconclusive findings than positive findings, and that’s informative,” and others are expecting “more luck with the next cohort of studies.” Will evaluation science improve prior to the next cohort, or will future studies perhaps not be based on “fairly weakly supported ideas”?

We just cannot get over ourselves trying to make teaching and learning into a science. Teaching is an art for those born with the talent, and a craft for those inspired to acquire it. Learning is a life process that will never be captured conclusively for replication. But those of us who love learning will try and try again to impart a love for it in students whose innate desire to learn has been starved or poorly nourished.

We need to be careful what theses we attempt to prove, what causation we attempt to claim. We are arrogant in our overreaching for “truth,” and we forget what we have already learned and observed over time. I recommend that readers note Peter Berger’s Commentary “Predicting the Past,” in the same issue. Unlike our hapless researchers who have turned up with “no effects,” Mr. Berger reminds us that we already know them, yet we ignore much of our knowledge of teaching and learning. That is why we are, as he says, in the 21st century without mastering the skills of the 20th century and before.

Gillian B. Thorne

Executive Director, Office of Early College Programs

Director, UConn Early College Experience Program

University of Connecticut

Storrs, Conn.

Related Tags:

A version of this article appeared in the April 22, 2009 edition of Education Week as ‘No Effects’ Research and The Realities of Learning

Events

School Climate & Safety K-12 Essentials Forum Strengthen Students’ Connections to School
Join this free event to learn how schools are creating the space for students to form strong bonds with each other and trusted adults.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Reframing Behavior: Neuroscience-Based Practices for Positive Support
Reframing Behavior helps teachers see the “why” of behavior through a neuroscience lens and provides practices that fit into a school day.
Content provided by Crisis Prevention Institute
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Math for All: Strategies for Inclusive Instruction and Student Success
Looking for ways to make math matter for all your students? Gain strategies that help them make the connection as well as the grade.
Content provided by NMSI

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management 6 Ways Schools Are Managing Students’ Cellphone Use
Students' cellphone use has been a major source of headaches for teachers and principals.
5 min read
A cell phone sits on a student's desk during a 9th grade honors English class at Bel Air High School in Bel Air, Md., on Jan. 25, 2024.
A cellphone sits on a student's desk during a 9th grade honors English class at Bel Air High School in Bel Air, Md., on Jan. 25, 2024. The policies that districts and schools use to manage the use of cellphones during the school day vary widely.
Jaclyn Borowski/Education Week
School & District Management What the Research Says What Districts With the Worst Attendance Have in Common
Districts often lack a systemic approach to coping with the spike in chronic attendance problems, a Michigan study suggests.
4 min read
Scarce classroom of students taking exams at their desks with empty desks in the foreground.
iStock/Getty Images Plus
School & District Management More School Workers Qualify for Overtime Under New Rule. Teachers Remain Exempt
Nurses, paraprofessionals, and librarians could get paid more under the federal rule, but the change won't apply to teachers.
3 min read
Image of a clock on supplies.
Laura Baker/Education Week via Canva<br/>
School & District Management Opinion Principals, You Aren't the Only Leader in Your School
What I learned about supporting teachers in my first week as an assistant principal started with just one question: “How would I know?”
Shayla Ewing
4 min read
Collaged illustration of a woman climbing a ladder to get a better perspective in a landscape of ladders.
Vanessa Solis/Education Week via Canva