Opinion
School & District Management Letter to the Editor

John Hattie Is Still ‘Wrong’

July 17, 2018 1 min read
  • Save to favorites
  • Print

To the Editor:

Peter DeWitt recently responded to a blog post I wrote in which I criticized the work of John Hattie (“John Hattie Isn’t Wrong. You Are Misusing His Research,” Peter DeWitt’s Finding Common Ground blog, edweek.org, June 26, 2018). DeWitt claimed that I am “misreading [Hattie’s] research.” DeWitt linked to my post, and readers can easily resolve this question for themselves.

My whole point in the post was to note that Hattie’s error is in accepting meta-analyses without examining the nature of the underlying studies. I offered examples of the meta-analyses that Hattie included in his own meta-meta-analysis of feedback. They are full of tiny, brief lab studies, studies with no control groups, studies that fail to control for initial achievement, and studies that use measures made up by the researchers.

These examples are not cherry-picked; they are at the core of Hattie’s review. In it, Hattie cites only 12 meta-analyses. I looked at the individual studies making up every one of those meta-analyses I could find that had an average effect size above +0.40.

In DeWitt’s critique, he has a telling quote from Hattie himself, who explains that he does not have to worry about the nature or quality of the individual studies in the meta-analyses he includes in his own meta-meta-analyses, because his purpose was only to review meta-analyses, not individual studies. This makes no sense. A meta-analysis (or a meta-meta-analysis) cannot be any better than the studies it contains.

If Hattie wants to express opinions about how teachers should teach, that is his right. But if he claims that these opinions are based on evidence from meta-analyses, he has to defend these meta-analyses by showing that the individual studies that go into them meet modern standards of evidence and have bearing on actual classroom practice.

Robert E. Slavin

Director

Center for Research and Reform in Education

School of Education

Johns Hopkins University

Baltimore, Md.

Related Tags:

A version of this article appeared in the July 18, 2018 edition of Education Week as John Hattie Is Still ‘Wrong’

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
The Future of the Science of Reading
Join us for a discussion on the future of the Science of Reading and how to support every student’s path to literacy.
Content provided by HMH
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
College & Workforce Readiness Webinar
From Classrooms to Careers: How Schools and Districts Can Prepare Students for a Changing Workforce
Real careers start in school. Learn how Alton High built student-centered, job-aligned pathways.
Content provided by TNTP
Student Well-Being Live Online Discussion A Seat at the Table: The Power of Emotion Regulation to Drive K-12 Academic Performance and Wellbeing
Wish you could handle emotions better? Learn practical strategies with researcher Marc Brackett and host Peter DeWitt.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Celebrate Five Years of The Savvy Principal—A Newsletter Just for School Leaders
The Savvy Principal is full of news, insights, and actionable tips on school leadership.
1 min read
Close cropped photo of a laptop, planner and phone with ear phones attached to it. The phone is displaying an edition of Education Week's The Savvy Principal enewsletter.
Liz Yap/Education Week + Adobe Stock
School & District Management Worried About Withheld Education Funding? Here's How Leaders Can Speak Up
Education leaders must communicate the consequences of withheld K-12 funding to Congress and their own communities.
6 min read
Superintendents Dr. Alex Marrero, Alberto Carvalho, and Joe Gothard
Denver Superintendent Alex Marrero, left, Madison Superintendent Joe Gothard, and Los Angeles Superintendent Alberto Carvalho are among district leaders who've pushed for the release of withheld federal K-12 funding. The three have also sought to explain the consequences to their own communities.
David Zalubowski/AP, Andy Clayton-King/AP, Anthony Behar/AP
School & District Management Opinion ‘You’re Woke’: A Former Superintendent Responds to Intense Backlash
My critics hurled “woke” at me like a verbal grenade—but we need education leaders who are wide awake.
Robert Sokolowski
4 min read
Diverse group of multiethnic multicultural people silhouette. The weaponization of woke.
iStock/Getty Images
School & District Management Women, People of Color Still Underrepresented in Superintendent Ranks
Superintendents are getting younger, earning slightly more, and working longer hours, yet their pay still lags behind inflation, AASA found.
4 min read
Illustration of a Black woman professional carrying a briefcase and dressed in red and walking alongside an oversized male dressed in blue pants with his white hand also carrying a briefcase.
DigitalVision Vectors/Getty