Curriculum Letter to the Editor

Finding Flaws in a Study and Its Front-Page Report

April 06, 2009 1 min read

To the Editor:

Your front-page article “Study Gives Edge to 2 Math Programs” (March 4, 2009) represents both how difficult it is to measure educational phenomena and the dangers of a certain type of journalism.

The article begins by declaring two winners among four popular commercial math curricula. After a brief acknowledgment that this may not end the “so-called ‘math wars’ anytime soon,” it goes on to rank the programs and report the findings of the federal experiment, commissioned by the Institute of Education Sciences.

Only later in the article do we learn that these results were from just the first year of a three-year study involving a nonrepresentative sample of U.S. 1st graders, that one of the programs had students spending an additional hour a day on mathematics instruction, and that one of the programs had significantly less coaching support than the others.

In my opinion, these variables significantly skew the outcomes of this project. This is even before we take into account variability among students, teachers, teacher training, and the like. Ultimately, even if the measurement comparing these programs was accurate (and I have serious doubts about this assertion), it is less important to know where students are after one year than to know how they emerge once the programs are complete.

It is hard to believe that any solid conclusions can be drawn in terms of these math curricula based on this research project, and I shudder to think how much this study is costing. Frankly, to give it front-page attention and then to reveal the major limitations of the research toward the end of the article sets a dangerous precedent that a newspaper dedicated to educational coverage should avoid.

G. Putnam Goodwin-Boyd

Florence, Mass.

A version of this article appeared in the April 08, 2009 edition of Education Week as Finding Flaws in a Study And Its Front-Page Report


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Future of Work Webinar
Digital Literacy Strategies to Promote Equity
Our new world has only increased our students’ dependence on technology. This makes digital literacy no longer a “nice to have” but a “need to have.” How do we ensure that every student can navigate
Content provided by Learning.com
Mathematics Online Summit Teaching Math in a Pandemic
Attend this online summit to ask questions about how COVID-19 has affected achievement, instruction, assessment, and engagement in math.
School & District Management Webinar Examining the Evidence: Catching Kids Up at a Distance
As districts, schools, and families navigate a new normal following the abrupt end of in-person schooling this spring, students’ learning opportunities vary enormously across the nation. Access to devices and broadband internet and a secure

EdWeek Top School Jobs

Speech Therapists
Lancaster, PA, US
Lancaster Lebanon IU 13
Elementary Teacher
Madison, Wisconsin
One City Schools

Read Next

Curriculum 6 Ways to Help Students Make Sense of the Capitol Siege
A week after the attack on the U.S. Capitol, teachers are helping students figure out how the country got to this point.
15 min read
Image of the Capitol building shown in a rearview mirror.
Macrocosm Photography/E+
Curriculum Theater Educators Struggle to Keep Shows Going Amid COVID-19
Convinced that the show must go on, high school theater troupes are turning to livestreamed shows, outdoor performances, and radio plays.
8 min read
Wearing masks to prevent the spread of COVID-19, students from New Albany (Ind.) High School perform the musical “Bright Star” earlier this year.
Wearing masks to prevent the spread of COVID-19, students from New Albany (Ind.) High School perform the musical “Bright Star” earlier this year.
Photo courtesy of Crit Fisher
Curriculum Letter to the Editor Curriculum as a Lever for Racial Equity
To the Editor:
The special report "Big Ideas for Confronting Racism in Education" (Sept. 23, 2020) highlighted essential ingredients for creating anti-racist schools, including better teacher preparation, expanded anti-bias training, and universal internet access, among others.
1 min read
Curriculum What Should Students Learn in Sex Education? In This State, Voters Will Decide
Washington voters will consider a statewide mandate for comprehensive sex education.
6 min read
sex ed SOC 2