Opinion
Curriculum Letter to the Editor

Finding Flaws in a Study and Its Front-Page Report

April 06, 2009 1 min read
  • Save to favorites
  • Print

To the Editor:

Your front-page article “Study Gives Edge to 2 Math Programs” (March 4, 2009) represents both how difficult it is to measure educational phenomena and the dangers of a certain type of journalism.

The article begins by declaring two winners among four popular commercial math curricula. After a brief acknowledgment that this may not end the “so-called ‘math wars’ anytime soon,” it goes on to rank the programs and report the findings of the federal experiment, commissioned by the Institute of Education Sciences.

Only later in the article do we learn that these results were from just the first year of a three-year study involving a nonrepresentative sample of U.S. 1st graders, that one of the programs had students spending an additional hour a day on mathematics instruction, and that one of the programs had significantly less coaching support than the others.

In my opinion, these variables significantly skew the outcomes of this project. This is even before we take into account variability among students, teachers, teacher training, and the like. Ultimately, even if the measurement comparing these programs was accurate (and I have serious doubts about this assertion), it is less important to know where students are after one year than to know how they emerge once the programs are complete.

It is hard to believe that any solid conclusions can be drawn in terms of these math curricula based on this research project, and I shudder to think how much this study is costing. Frankly, to give it front-page attention and then to reveal the major limitations of the research toward the end of the article sets a dangerous precedent that a newspaper dedicated to educational coverage should avoid.

G. Putnam Goodwin-Boyd

Florence, Mass.

A version of this article appeared in the April 08, 2009 edition of Education Week as Finding Flaws in a Study And Its Front-Page Report

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
College & Workforce Readiness Webinar
From Exposure to Experience: Designing Accessible Work-Based Learning
Learn how schools can create meaningful experiences that help every student build skills, connections, and a clearer path to their future.
Content provided by Project Lead The Way
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
A Tale of Two School Districts: Forecasting Enrollment
Forecasting enrollment is hard. Here’s how two different districts are navigating times of change with data that considers the whole picture.
Content provided by Zonda Education
Reading & Literacy K-12 Essentials Forum Strategies to Create a Culture of Reading in Schools
Join this free virtual event to learn how teachers and school district leaders ensure students are reading enough.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Curriculum Spotlight Spotlight on Opening Doors to Advanced Learning: Expanding Access, Opportunity, and Pathways for Every Student
Explore how schools are expanding access to rigorous coursework and creating new pathways to college, careers, and future success.
Curriculum Q&A Should State Boards Have More Oversight of Curricula?
A more active role would help schools select strong, research-based curricula, an expert argues.
•
5 min read
Conceptual image of gears drawn in flowing line art being tethered together and a lasso bounding box.
Laura Baker/Education Week + Getty
Curriculum High Costs Keep 12.6 Million Kids Out of Summer Programs, Report Finds
The Afterschool Alliance report recommends greater public and private funding of summer programs.
3 min read
Michelle Ayala, 18, plays with building blocks with campers at LASOS summer camp at Bel Air High School in Bel Air, Md., on July 24, 2025.
An 18-year-old plays with building blocks with campers at LASOS summer camp at Bel Air High School in Bel Air, Md., on July 24, 2025. High costs prevent nearly half of children whose parents want them in summer programs from attending.
KT Kanazawich/AP
Curriculum Q&A Leader Says EdReports Is 'Evolving' and Still Critical for Curriculum Review
Lewis Ferebee says EdReports has responded to criticisms and is a useful tool in a sea of curriculum choices.
5 min read
DC Public Schools Chancellor Lewis Ferebee speaks during a ribbon-cutting ceremony for a new addition at Raymond Elementary School on the first day of school, on Aug. 28, 2023, in Washington.
Lewis Ferebee, the then-chancellor of the District of Columbia public schools, during a ribbon-cutting ceremony at Raymond Elementary School on the first day of school, on Aug. 28, 2023, in Washington. Ferebee was announced as EdReports’ new chief executive officer in May.
Mark Schiefelbein/AP