Teaching

Study Gives Edge to 2 Math Programs

By Debra Viadero — March 02, 2009 5 min read
  • Save to favorites
  • Print

Two programs for teaching mathematics in the early grades—Math Expressions and Saxon Math—emerge as winners in early findings released last week from a large-scale federal experiment that pits four popular, and philosophically distinct, math curricula against one another.

But the results don’t promise to end the so-called “math wars” anytime soon, according to experts. That’s because the two most successful programs embody different approaches to teaching math in grades K-2.

The Saxon curriculum, published by Harcourt Achieve of Austin, Texas, is a more traditional, scripted program in which teachers offer explicit instruction on effective mathematics procedures.

Effect of Math Programs on Students’ Scores

A study compared test scores of students taught using four math curricula used in the early grades.

BRIC ARCHIVE

NOTE: Scores for Investigations and SFAW are statistically different by a significant amount from those of Saxon and Math Expressions, researchers say.

SOURCE: Mathematica Policy Research Inc.

The Boston-based Houghton Mifflin Co.’s Math Expressions curriculum, in comparison, integrates a more reform-oriented emphasis on student reasoning with direct teaching that is aimed at moving students to more-advanced mathematical strategies. “One of the things this says to me is that we’re not going to find a unique curriculum that all teachers can use with the same degree of effectiveness,” said Hank Kepner, the president of the National Council of Teachers of Mathematics, in Reston, Va.

Involving 1,309 1st graders in 39 elementary schools, the four-state study is considered the largest experiment to test some of the nation’s most widely used commercial math programs. It was commissioned by the Institute of Education Sciences, the primary research arm for the U.S. Department of Education. Mathematica Policy Research Inc. of Princeton, N.J., headed up the project.

The eagerly awaited results, which were posted online Feb. 24, come from the first of three reports on the 3-year-long study. It has since enlisted 71 more schools.

Besides Saxon Math and Math Expression, the researchers also tested Investigations in Number, Data, and Space as well as Scott Foresman-Addison Wesley Mathematics, both published by Pearson Scott Foresman, based in Glenview, Ill.

In all, publishers submitted eight programs for the study, said Audrey Pendleton, the ies project officer for the study. An expert panel chose the four programs based on their popularity, publishers’ capacity to provide teacher training, and the diversity of teaching approaches they represent as a group.

The Investigations program, for example, is considered the most student-centered of the four curricula, while Scott Foresman-Addison Wesley Mathematics is a basic-skills curriculum that combines teacher-led instruction with a variety of different materials and teaching strategies.

Researchers randomly assigned each of the programs to 10 different schools for use over the 2006-07 school year, and teachers later reported that the assigned curricula served as the backbone of their math instruction that year.

To determine how much math the students learned, the researchers used a nationally normed exam that was developed for the federal Early Childhood Longitudinal Study. Roberto Agodini, Mathematica’s lead investigator on the project, said researchers chose that test because children could take it individually, and because it adapts questions to children’s abilities by adjusting questions’ level of difficulty. “Asking young kids to take a paper-and-pencil test would probably not be a good idea,” Mr. Agodini said, “and we wanted to capture the wide range of students’ abilities.”

At the end of 1st grade, investigators found, children in classes using the Saxon and Math Expressions curricula scored 9 percentile points to 12 percentile points higher on those tests than their counterparts in other classrooms.

Publishers were quick to note that students in the study were not nationally representative. Among the reasons: By design, the testing population included a high number of high-poverty schools.

While experts cautioned against drawing sweeping conclusions, several said the results seem to validate the National Mathematics Advisory Panel’s call last year for integrating a focus on promoting students’ conceptual understandings of the subject with instruction on simple procedures.

“The math panel said it’s no longer at all sensible to talk about teacher-directed versus student-directed approaches; that quality infers both,” said Steven J. Leinwand, a principal research analyst for the American Institutes for Research, a Washington research group not connected with the study. “This confirms that,” he added.

Yellow Flags Raised

Mr. Leinwand and others also raised possible caveats. For one, the teachers using the Saxon Math program reported spending an average of an hour more per week teaching math than their counterparts in the other curriculum groups. The question is: Were Saxon pupils’ gains due to the extra time on task or the program itself?

Mr. Agodini said the study did not adjust for those differences: “We wanted teachers to use the assigned curricula in the way that the publishers wanted them to.”

Also, while all the teachers received similar amounts of training to teach the programs to which they were assigned, only 53 percent in the Investigations group had access to math coaches in their schools, Mr. Leinwand noted. By contrast, 78 percent of the Saxon teachers and 86 percent of the Math Expressions teachers could rely on coaches, the report says.

“You have what is singularly the hardest of the four programs to implement with the least amount of support,” Mr. Leinwand added, referring to Investigations.

Also, differences in teaching approaches among the four curricula may be narrower in the early grades than in the upper-elementary or middle school grades. Experts said the Saxon program, in particular, is less drill-oriented in the early grades than is widely believed.

“From what I’ve seen, there is much more support for promoting children’s understanding in there than there are in the upper-grade materials,” said Karen C. Fuson, the Northwestern University researcher who developed the Math Expressions curricula.

There are differences among programs and districts, however, in the grades at which particular math skills are tackled, noted the nctm’s Mr. Kepner, who is also a mathematics education professor at the University of Wisconsin-Milwaukee. “What’s going to be really interesting is looking at the results at the end of 3rd grade,” he said. “Are curricula that look poor now going to look different then?”

A version of this article appeared in the March 04, 2009 edition of Education Week as Study Gives Edge to 2 Math Programs

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Opinion Student Laziness Is a Myth. Here's Why
Holding fast to the idea that students are lazy leaves no room for understanding what got in the way of their success.
Kyle Coppes
4 min read
Screen Shot 2024 03 12 at 6.45.38 AM
Canva
Teaching Opinion 4 Ways to Present STEM Role Models Girls Will Find Inspiring
Merely exposing students to female scientists isn’t enough to get them to pursue careers in STEM.
Lisa M.P. Munoz & Eva Pietri
4 min read
Images shows a stylized artistic landscape with soothing colors.
Getty
Teaching Opinion What Teachers Can Learn From Students
Group work can help students make friends and provide a foundation for building future collaborations and relationships.
9 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty
Teaching Opinion Try These Simple Shifts in Teaching for a Big Payoff
A complimentary call at week's end to a student's family strengthens relationships and reminds teachers of the good in every week.
11 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty