Opinion
Curriculum Letter to the Editor

Finding Flaws in a Study and Its Front-Page Report

April 06, 2009 1 min read
  • Save to favorites
  • Print

To the Editor:

Your front-page article “Study Gives Edge to 2 Math Programs” (March 4, 2009) represents both how difficult it is to measure educational phenomena and the dangers of a certain type of journalism.

The article begins by declaring two winners among four popular commercial math curricula. After a brief acknowledgment that this may not end the “so-called ‘math wars’ anytime soon,” it goes on to rank the programs and report the findings of the federal experiment, commissioned by the Institute of Education Sciences.

Only later in the article do we learn that these results were from just the first year of a three-year study involving a nonrepresentative sample of U.S. 1st graders, that one of the programs had students spending an additional hour a day on mathematics instruction, and that one of the programs had significantly less coaching support than the others.

In my opinion, these variables significantly skew the outcomes of this project. This is even before we take into account variability among students, teachers, teacher training, and the like. Ultimately, even if the measurement comparing these programs was accurate (and I have serious doubts about this assertion), it is less important to know where students are after one year than to know how they emerge once the programs are complete.

It is hard to believe that any solid conclusions can be drawn in terms of these math curricula based on this research project, and I shudder to think how much this study is costing. Frankly, to give it front-page attention and then to reveal the major limitations of the research toward the end of the article sets a dangerous precedent that a newspaper dedicated to educational coverage should avoid.

G. Putnam Goodwin-Boyd

Florence, Mass.

Related Tags:
Opinion

A version of this article appeared in the April 08, 2009 edition of Education Week as Finding Flaws in a Study And Its Front-Page Report

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Webinar
Reflections on Evidence-Based Grading Practices: What We Learned for Next Year
Get real insights on evidence-based grading from K-12 leaders.
Content provided by Otus
Artificial Intelligence K-12 Essentials Forum How AI Use Is Expanding in K-12 Schools
Join this free virtual event to explore how AI technology is—and is not—improving K-12 teaching and learning.
Student Achievement K-12 Essentials Forum How to Build and Scale Effective K-12 State & District Tutoring Programs
Join this free virtual summit to learn from education leaders, policymakers, and industry experts on the topic of high-impact tutoring.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Curriculum How to Teach Tariffs: 8 Resources and Lessons
Wondering how to broach tariffs with your students? Check out these resources and lesson plans we've gathered.
2 min read
Image of shipping boxes from different countries.
iStock/Getty
Curriculum What Makes Curriculum 'High-Quality'?
Only 1 in 4 school and districts leaders say their administration has an official definition of "high-quality instructional materials."
4 min read
Blurred photo of a math formula with a vector illustration of a woman holding a clipboard and a man holding a notepad. Both appear to be examining the math equation.
iStock/Getty
Curriculum Gulf of America or Gulf of Mexico? How Teachers Are Handling Trump's Name Change
Educators share their views on the Gulf of America name change.
Riley Griffin, of Sedalia, Mo., gets help from teacher Cara Cairer as he works on a paper mâché globe at Heber Hunt Elementary School in Sedalia, Mo., on Feb. 29, 2012.
Riley Griffin, of Sedalia, Mo., gets help from teacher Cara Cairer as he works on a paper mâché globe at Heber Hunt Elementary School in Sedalia, Mo., on Feb. 29, 2012.
Sydney Brink/Sedalia Democrat via AP
Curriculum What Teachers Are Saying About the Lawsuit Against Lucy Calkins and Fountas and Pinnell
Educators on social media had lots to say about the lawsuit filed against the creators of popular reading programs.
1 min read
Photo of children and teacher with books on floor for reading, learning and teaching. Study, school and woman with kids for storytelling, help and fantasy, language and skill development.
iStock/Getty