Opinion
Curriculum Letter to the Editor

Finding Flaws in a Study and Its Front-Page Report

April 06, 2009 1 min read
  • Save to favorites
  • Print

To the Editor:

Your front-page article “Study Gives Edge to 2 Math Programs” (March 4, 2009) represents both how difficult it is to measure educational phenomena and the dangers of a certain type of journalism.

The article begins by declaring two winners among four popular commercial math curricula. After a brief acknowledgment that this may not end the “so-called ‘math wars’ anytime soon,” it goes on to rank the programs and report the findings of the federal experiment, commissioned by the Institute of Education Sciences.

Only later in the article do we learn that these results were from just the first year of a three-year study involving a nonrepresentative sample of U.S. 1st graders, that one of the programs had students spending an additional hour a day on mathematics instruction, and that one of the programs had significantly less coaching support than the others.

In my opinion, these variables significantly skew the outcomes of this project. This is even before we take into account variability among students, teachers, teacher training, and the like. Ultimately, even if the measurement comparing these programs was accurate (and I have serious doubts about this assertion), it is less important to know where students are after one year than to know how they emerge once the programs are complete.

It is hard to believe that any solid conclusions can be drawn in terms of these math curricula based on this research project, and I shudder to think how much this study is costing. Frankly, to give it front-page attention and then to reveal the major limitations of the research toward the end of the article sets a dangerous precedent that a newspaper dedicated to educational coverage should avoid.

G. Putnam Goodwin-Boyd

Florence, Mass.

A version of this article appeared in the April 08, 2009 edition of Education Week as Finding Flaws in a Study And Its Front-Page Report

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in Schools
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Science Webinar
Spark Minds, Reignite Students & Teachers: STEM’s Role in Supporting Presence and Engagement
Is your district struggling with chronic absenteeism? Discover how STEM can reignite students' and teachers' passion for learning.
Content provided by Project Lead The Way
Recruitment & Retention Webinar EdRecruiter 2025 Survey Results: The Outlook for Recruitment and Retention
See exclusive findings from EdWeek’s nationwide survey of K-12 job seekers and district HR professionals on recruitment, retention, and job satisfaction. 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Curriculum Inside a Class Teaching Teens to Stop Scrolling and Think Critically
The course helps students learn to determine what’s true online so they can be more informed citizens.
9 min read
Teacher Brie Wattier leads a 7th and 8th grade social studies class at the Inspired Teaching Demonstration School for a classroom discussion on the credibility of social media posts and AI-generated imagery on Nov. 19, 2024 in Washington, D.C.
Teacher Brie Wattier leads an 8th grade social studies class at the Inspired Teaching Demonstration School for a classroom discussion on the credibility of social media posts and AI-generated imagery on Nov. 19, 2024, in Washington, D.C.
Courtesy of Dylan Singleton/University of Maryland
Curriculum Inside the Effort to Shed Light on Districts' Curriculum Choices
Few states make the information easily searchable.
4 min read
Image of a U.S. map with conceptual data points.
iStock/Getty
Curriculum Texas Students May Soon Be Reading Bible Stories in English Classes
The state has advanced a controversial curriculum that includes Christian teachings in K-5 lessons.
5 min read
A Texas flag is displayed in an elementary school in Murphy, Texas, Thursday, Dec. 3, 2020.
A Texas flag is displayed in an elementary school in Murphy, Texas, in 2020.
LM Otero/AP
Curriculum Holy Excrement! How Poop and Other Kid Fascinations Can Ignite a Passion for STEM
Here's how teachers can incorporate students' existing interests into the curriculum.
6 min read
STEM
Collage by Laura Baker/Education Week via Canva