Opinion
School & District Management Letter to the Editor

John Hattie Is Still ‘Wrong’

July 17, 2018 1 min read
  • Save to favorites
  • Print

To the Editor:

Peter DeWitt recently responded to a blog post I wrote in which I criticized the work of John Hattie (“John Hattie Isn’t Wrong. You Are Misusing His Research,” Peter DeWitt’s Finding Common Ground blog, edweek.org, June 26, 2018). DeWitt claimed that I am “misreading [Hattie’s] research.” DeWitt linked to my post, and readers can easily resolve this question for themselves.

My whole point in the post was to note that Hattie’s error is in accepting meta-analyses without examining the nature of the underlying studies. I offered examples of the meta-analyses that Hattie included in his own meta-meta-analysis of feedback. They are full of tiny, brief lab studies, studies with no control groups, studies that fail to control for initial achievement, and studies that use measures made up by the researchers.

These examples are not cherry-picked; they are at the core of Hattie’s review. In it, Hattie cites only 12 meta-analyses. I looked at the individual studies making up every one of those meta-analyses I could find that had an average effect size above +0.40.

In DeWitt’s critique, he has a telling quote from Hattie himself, who explains that he does not have to worry about the nature or quality of the individual studies in the meta-analyses he includes in his own meta-meta-analyses, because his purpose was only to review meta-analyses, not individual studies. This makes no sense. A meta-analysis (or a meta-meta-analysis) cannot be any better than the studies it contains.

If Hattie wants to express opinions about how teachers should teach, that is his right. But if he claims that these opinions are based on evidence from meta-analyses, he has to defend these meta-analyses by showing that the individual studies that go into them meet modern standards of evidence and have bearing on actual classroom practice.

Robert E. Slavin

Director

Center for Research and Reform in Education

School of Education

Johns Hopkins University

Baltimore, Md.

Related Tags:

A version of this article appeared in the July 18, 2018 edition of Education Week as John Hattie Is Still ‘Wrong’

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Special Education Webinar
Big Goals, Small Start: Building MTSS to Scale
MTSS is a powerful framework for supporting student success, but implementation can be challenging. Learn from districts about their MTSS success stories and challenges.
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Recruitment & Retention Webinar
Exploring Staff Shortage Impact on Education
Learn about the impact of staff shortages, changing roles of educators, and how technology supports teachers & students.
Content provided by Promethean
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Webinar
Improving Outcomes on State Assessments with Data-Driven Strategies
State testing is around the corner! Join us as we discuss how teachers can use formative data to drive improved outcomes on state assessments.
Content provided by Instructure

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management MAP: Where School Employees Can and Can't Strike
See which states do and don't allow public school employees to go on strike.
2 min read
Amy Chapman and her daughter, first grader Corinne Anderson, pose for a photo while they support teachers on strike outside Whetstone High School in Columbus, Ohio, on Wednesday, Aug. 24, 2022.
Amy Chapman and her daughter, 1st grader Corinne Anderson, show support for teachers on strike outside Whetstone High School in Columbus, Ohio, on Aug. 24, 2022.
Samantha Hendrickson/AP
School & District Management Opinion How to Build a More Effective School Board
Board members are well-intentioned, but they've been mis-trained into focusing on adult inputs rather than student needs.
5 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
School & District Management What's Behind Texas' Takeover of Houston Schools
State takeovers of districts began in the 1980s but have waned recently following limited evidence of academic benefit.
5 min read
People stand in a row outside while holding signs that say "stop takeover," "hands off our schools," and "no HISD take over."
People hold up signs at a March news conference in Houston while protesting the planned takeover of the city's school district by the Texas Education Agency.
Juan A. Lozano/AP
School & District Management Superintendents' Salaries and Their Plans for Next Year, in Charts
A new survey offers a glimpse into the state of the superintendency, as some reports suggest turnover is on the rise.
1 min read
Close up of Benjamin Franklin's face on the one hundred dollar bill peeking out from behind a white curled up paper
iStock/Getty Images Plus