Education Opinion

Understanding Educational Research

By Walt Gardner — January 31, 2014 1 min read

Taxpayers are entitled to know if public schools are doing their job, but it’s hard for them to evaluate the empirical research that is published (“New Truths That Only One Can See,” The New York Times, Jan. 20). Opinions, no matter how deeply felt, are no substitute for expertise (“The Death of Expertise,” The Federalist, Jan. 17).

Let’s begin with replication, which is the sine qua non of science. Especially in education, researchers are wont to see what they want to see. It’s typically an unconscious bias that causes them to interpret data to support their hypothesis. For example, critics contend that past studies showing the benefits of preschool couldn’t be duplicated on a large scale (“California should give all kids the pre-K advantage,” Los Angeles Times, Jan. 24). That’s not surprising because successful pilot programs generally have low external validity. In plain English, it means they often don’t generalize well to other persons, settings and times.

Sometimes, however, the bias is quite conscious. That’s why it’s imperative to ask who is funding the studies. They are often financed by philanthropic foundations. But unless the foundations have been willing in the past to back research that does not advance their agendas, I advise extreme skepticism. For example, the Walton Family Foundation a few years ago made headlines for the largest single donation in history to a public university. In exchange, the University of Arkansas established the Department of School Reform within its school of education. How likely is it that research emanating from the new department is not tainted by ideology?

But let’s assume that a study passes muster on its backing. What next? I’d want to know if there were a control group, random assignment of students, peer review, cherry picking, or bottom fishing (“A Reader’s Guide to Scientifically Based Research,” Educational Leadership, Feb. 2003). However, even when these factors are taken into consideration, educational research does not involve chemicals in a laboratory. It involves students in real life. That alone should be cause for pause. Yet I remain skeptical that most taxpayers will put aside their deeply rooted opinions. That view doesn’t bode well for public schools.

The opinions expressed in Walt Gardner’s Reality Check are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Let us know what you think!

We’re looking for feedback on our new site to make sure we continue to provide you the best experience.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Future of Work Webinar
Digital Literacy Strategies to Promote Equity
Our new world has only increased our students’ dependence on technology. This makes digital literacy no longer a “nice to have” but a “need to have.” How do we ensure that every student can navigate
Content provided by Learning.com
Mathematics Online Summit Teaching Math in a Pandemic
Attend this online summit to ask questions about how COVID-19 has affected achievement, instruction, assessment, and engagement in math.
School & District Management Webinar Examining the Evidence: Catching Kids Up at a Distance
As districts, schools, and families navigate a new normal following the abrupt end of in-person schooling this spring, students’ learning opportunities vary enormously across the nation. Access to devices and broadband internet and a secure

EdWeek Top School Jobs

Special Education Teachers
Lancaster, PA, US
Lancaster Lebanon IU 13
Speech Therapists
Lancaster, PA, US
Lancaster Lebanon IU 13
Elementary Teacher
Madison, Wisconsin
One City Schools
Elementary Teacher - Scholars Academy
Madison, Wisconsin
One City Schools

Read Next

Education Obituary In Memory of Michele Molnar, EdWeek Market Brief Writer and Editor
EdWeek Market Brief Associate Editor Michele Molnar, who was instrumental in launching the publication, succumbed to cancer.
5 min read
Education Briefly Stated Briefly Stated: December 9, 2020
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated Briefly Stated: Stories You May Have Missed
A collection of articles from the previous week that you may have missed.
8 min read
Education Briefly Stated Briefly Stated: Stories You May Have Missed
A collection of stories from the previous week that you may have missed.
8 min read