Opinion
School & District Management Letter to the Editor

John Hattie Is Still ‘Wrong’

July 17, 2018 1 min read

To the Editor:

Peter DeWitt recently responded to a blog post I wrote in which I criticized the work of John Hattie (“John Hattie Isn’t Wrong. You Are Misusing His Research,” Peter DeWitt’s Finding Common Ground blog, edweek.org, June 26, 2018). DeWitt claimed that I am “misreading [Hattie’s] research.” DeWitt linked to my post, and readers can easily resolve this question for themselves.

My whole point in the post was to note that Hattie’s error is in accepting meta-analyses without examining the nature of the underlying studies. I offered examples of the meta-analyses that Hattie included in his own meta-meta-analysis of feedback. They are full of tiny, brief lab studies, studies with no control groups, studies that fail to control for initial achievement, and studies that use measures made up by the researchers.

These examples are not cherry-picked; they are at the core of Hattie’s review. In it, Hattie cites only 12 meta-analyses. I looked at the individual studies making up every one of those meta-analyses I could find that had an average effect size above +0.40.

In DeWitt’s critique, he has a telling quote from Hattie himself, who explains that he does not have to worry about the nature or quality of the individual studies in the meta-analyses he includes in his own meta-meta-analyses, because his purpose was only to review meta-analyses, not individual studies. This makes no sense. A meta-analysis (or a meta-meta-analysis) cannot be any better than the studies it contains.

If Hattie wants to express opinions about how teachers should teach, that is his right. But if he claims that these opinions are based on evidence from meta-analyses, he has to defend these meta-analyses by showing that the individual studies that go into them meet modern standards of evidence and have bearing on actual classroom practice.

Robert E. Slavin

Director

Center for Research and Reform in Education

School of Education

Johns Hopkins University

Baltimore, Md.

Related Tags:

A version of this article appeared in the July 18, 2018 edition of Education Week as John Hattie Is Still ‘Wrong’

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Classroom Technology Webinar
Educator-Driven EdTech Design: Help Shape the Future of Classroom Technology
Join us for a collaborative workshop where you will get a live demo of GoGuardian Teacher, including seamless new integrations with Google Classroom, and participate in an interactive design exercise building a feature based on
Content provided by GoGuardian
School & District Management Live Online Discussion A Seat at the Table With Education Week: What Did We Learn About Schooling Models This Year?
After a year of living with the pandemic, what schooling models might we turn to as we look ahead to improve the student learning experience? Could year-round schooling be one of them? What about online
School & District Management Webinar What's Ahead for Hybrid Learning: Putting Best Practices in Motion
It’s safe to say hybrid learning—a mix of in-person and remote instruction that evolved quickly during the pandemic—is probably here to stay in K-12 education to some extent. That is the case even though increasing

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management From Our Research Center How the Pandemic Is Shaping K-12 Education (in Charts)
Surveys by the EdWeek Research Center show how schools have changed during the pandemic and what adjustments are likely to stick.
Eric DiVito gives breathing instructions as he teaches a remote music class at the Osborn School on Oct. 6, 2020, in Rye, N.Y.
Eric DiVito gives breathing instructions as he teaches a remote music class at the Osborn School in Rye, N.Y., last fall.
Mary Altaffer/AP
School & District Management 'You Can’t Follow CDC Guidelines': What Schools Really Look Like During COVID-19
All year, some teachers have said that enforcing precautions to slow the spread of the virus in classrooms can be nearly impossible.
13 min read
Guntown Middle School eighth graders walk the halls to their next class as others wait in their assigned spots against the wall before moving into their next class during the first day back to school for the Lee County District in Guntown, Miss on Aug. 6, 2020.
Eight graders walk the halls on the first day back to school in Guntown, Miss., on Aug. 6, 2020. Teachers in several states told Education Week that since the beginning of the school year, enforcing precautions such as social distancing to slow the spread of the coronavirus has been nearly impossible.<br/>
Adam Robison/The Northeast Mississippi Daily Journal via AP
School & District Management Opinion School Reopening Requires More Than Just Following the Science
Educators can only “follow the science” so far. Professional expertise matters too, writes Susan Moore Johnson.
Susan Moore Johnson
5 min read
Illustration of school and bus
Getty
School & District Management Why Teacher Vaccinations Are So Hard to Track
Teachers can now get the COVID-19 vaccine, but there’s no way of knowing how many are currently inoculated against the virus.
6 min read
Image of a needle and vaccine bottle.
iStock/Getty