Opinion
Curriculum Letter to the Editor

Finding Flaws in a Study and Its Front-Page Report

April 06, 2009 1 min read
  • Save to favorites
  • Print

To the Editor:

Your front-page article “Study Gives Edge to 2 Math Programs” (March 4, 2009) represents both how difficult it is to measure educational phenomena and the dangers of a certain type of journalism.

The article begins by declaring two winners among four popular commercial math curricula. After a brief acknowledgment that this may not end the “so-called ‘math wars’ anytime soon,” it goes on to rank the programs and report the findings of the federal experiment, commissioned by the Institute of Education Sciences.

Only later in the article do we learn that these results were from just the first year of a three-year study involving a nonrepresentative sample of U.S. 1st graders, that one of the programs had students spending an additional hour a day on mathematics instruction, and that one of the programs had significantly less coaching support than the others.

In my opinion, these variables significantly skew the outcomes of this project. This is even before we take into account variability among students, teachers, teacher training, and the like. Ultimately, even if the measurement comparing these programs was accurate (and I have serious doubts about this assertion), it is less important to know where students are after one year than to know how they emerge once the programs are complete.

It is hard to believe that any solid conclusions can be drawn in terms of these math curricula based on this research project, and I shudder to think how much this study is costing. Frankly, to give it front-page attention and then to reveal the major limitations of the research toward the end of the article sets a dangerous precedent that a newspaper dedicated to educational coverage should avoid.

G. Putnam Goodwin-Boyd

Florence, Mass.

A version of this article appeared in the April 08, 2009 edition of Education Week as Finding Flaws in a Study And Its Front-Page Report

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Unlocking Success for Struggling Adolescent Readers
The Science of Reading transformed K-3 literacy. Now it's time to extend that focus to students in grades 6 through 12.
Content provided by STARI
Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and K-12 education jubs at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
College & Workforce Readiness Webinar
Portrait of a Learner: From Vision to Districtwide Practice
Learn how one district turned Portrait of a Learner into an aligned, systemwide practice that sticks.
Content provided by Otus

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Curriculum Opinion What Policymakers Get Wrong About 'High-Quality' Curriculum
Schools can't fix instruction without fixing curriculum, Doug Lemov warns.
10 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
Curriculum Cursive is Making a Comeback. It Won’t Be Without Challenges
A growing number of states are requiring schools to return to cursive writing instruction.
5 min read
A third-grader practices his cursive handwriting at a school in the Queens borough of New York.
A third-grader practices his cursive handwriting at a school in the Queens borough of New York. At least half of the nation’s states have adopted cursive writing instruction in recent years, reversing a sharp decline in teaching of that skill after the Common Core, launched in 2010, omitted it from its standards.
Mary Altaffer/AP
Curriculum Why Media Literacy Efforts Are Failing to Keep Up With Misinformation
Classroom educators need support from district and school leaders in addressing flashpoint topics.
5 min read
Ballard High School students work together to solve an exercise at MisinfoDay, an event hosted by the University of Washington to help high school students identify and avoid misinformation, Tuesday, March 14, 2023, in Seattle. Educators around the country are pushing for greater digital media literacy education.
Students at Ballard High School in Washington state work to solve an exercise at MisinfoDay, a March 2023 event hosted by the University of Washington to help high school students identify and avoid misinformation.
Manuel Valdes/AP
Curriculum Opinion Kim Kardashian Says the Moon Landing Was Fake. There's a Lesson Here for Schools
Teachers can use popular conspiracies to help students scrutinize what they see online.
Sam Wineburg & Nadav Ziv
5 min read
Halftone collage banner with two smartphones and mouth speaks into ear and strip with text - fake news. Halftone collage poster. Concept of fake news, disinformation or propaganda.
iStock/Getty + Education Week