Opinion
Curriculum Letter to the Editor

Finding Flaws in a Study and Its Front-Page Report

April 06, 2009 1 min read
  • Save to favorites
  • Print

To the Editor:

Your front-page article “Study Gives Edge to 2 Math Programs” (March 4, 2009) represents both how difficult it is to measure educational phenomena and the dangers of a certain type of journalism.

The article begins by declaring two winners among four popular commercial math curricula. After a brief acknowledgment that this may not end the “so-called ‘math wars’ anytime soon,” it goes on to rank the programs and report the findings of the federal experiment, commissioned by the Institute of Education Sciences.

Only later in the article do we learn that these results were from just the first year of a three-year study involving a nonrepresentative sample of U.S. 1st graders, that one of the programs had students spending an additional hour a day on mathematics instruction, and that one of the programs had significantly less coaching support than the others.

In my opinion, these variables significantly skew the outcomes of this project. This is even before we take into account variability among students, teachers, teacher training, and the like. Ultimately, even if the measurement comparing these programs was accurate (and I have serious doubts about this assertion), it is less important to know where students are after one year than to know how they emerge once the programs are complete.

It is hard to believe that any solid conclusions can be drawn in terms of these math curricula based on this research project, and I shudder to think how much this study is costing. Frankly, to give it front-page attention and then to reveal the major limitations of the research toward the end of the article sets a dangerous precedent that a newspaper dedicated to educational coverage should avoid.

G. Putnam Goodwin-Boyd

Florence, Mass.

A version of this article appeared in the April 08, 2009 edition of Education Week as Finding Flaws in a Study And Its Front-Page Report

Events

School Climate & Safety K-12 Essentials Forum Strengthen Students’ Connections to School
Join this free event to learn how schools are creating the space for students to form strong bonds with each other and trusted adults.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Reframing Behavior: Neuroscience-Based Practices for Positive Support
Reframing Behavior helps teachers see the “why” of behavior through a neuroscience lens and provides practices that fit into a school day.
Content provided by Crisis Prevention Institute
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Math for All: Strategies for Inclusive Instruction and Student Success
Looking for ways to make math matter for all your students? Gain strategies that help them make the connection as well as the grade.
Content provided by NMSI

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Curriculum Photos PHOTOS: Inside an AP African American Studies Class
The AP African American studies course has sparked national debate since the pilot kicked off in 2022. Here's a look inside the classroom.
Students listen to a lesson on Black fraternities and sororities during Ahenewa El-Amin’s AP African American Studies class at Henry Clay High School in Lexington, Ky., on March 19, 2024.
Students listen to a lesson on Black fraternities and sororities during Ahenewa El-Amin’s AP African American Studies class at Henry Clay High School in Lexington, Ky., on March 19, 2024.
Jaclyn Borowski/Education Week
Curriculum Video VIDEO: What AP African American Studies Looks Like in Practice
The AP African American studies course has sparked national debate since the pilot kicked off in 2022. A look inside the classroom.
Ahenewa El-Amin leads a conversation with students during her AP African American Studies class at Henry Clay High School in Lexington, Ky., on March 19, 2024.
Ahenewa El-Amin leads a conversation with students during her AP African American Studies class at Henry Clay High School in Lexington, Ky., on March 19, 2024.
Jaclyn Borowski/Education Week
Curriculum Anti-Critical-Race-Theory Laws Are Slowing Down. Here Are 3 Things to Know
After a wave of bills limiting class discussions on race and gender, an Education Week analysis shows the policies have slowed.
5 min read
A man holds up a sign during a protest against Critical Race Theory outside a Washoe County School District board meeting on May 25, 2021, in Reno, Nev.
A man holds up a sign during a protest against critical race theory outside a Washoe County School District board meeting on May 25, 2021, in Reno, Nev. This year, the numbers of bills being proposed to restrict what schools can teach and discuss about race and racism have slowed down from prior years.
Andy Barron/Reno Gazette-Journal via AP
Curriculum History Group Finds Little Evidence of K-12 'Indoctrination'
Most social science educators say they keep politics out of the classroom, but need help identifying good curriculum resources
6 min read
Photo of U.S. flag in classroom.
iStock / Getty Images Plus