School & District Management

RAND Report Tracks State NAEP Gains

By Debra Viadero — August 02, 2000 5 min read
  • Save to favorites
  • Print

The schooling improvements that states undertook in the 1980s and early 1990s are translating to higher test scores, particularly for students in poor communities, according to a national study released last week.

For More Information

The full text of the study, “Improving Student Achievement: What NAEP State Test Scores Tell Us,” is available online.

The state-by-state analysis by the RAND Corp. also shows that some states and strategies are better than others in raising scores. Smaller class sizes, better resources for teachers, and preschool programs are linked to higher achievement, the report says, while the academic payoff from having higher-paid, more experienced, or more educated teachers appears less certain.

Texas, North Carolina, and Michigan are spotlighted by the study for producing higher-than-average annual gains in their students’ math scores on the National Assessment of Educational Progress.

David W. Grissmer

“The main message of this report is that public education is reformable,” said David W. Grissmer, the lead researcher for the report from RAND, a Santa Monica, Calif.-based think tank.

“Five years ago, I think there was genuine uncertainty across the nation [about] whether public schools could be improved,” Mr. Grissmer said. “We now know that spending money, if it’s well targeted, can increase achievement scores.”

Political Implications

The study also provides grist for the debates over education that are taking place in the national presidential campaign. The prospective nominees of both major parties highlighted the findings on their Internet sites last week.

“I am proud of the results we have achieved in education in Texas,” Gov. George W. Bush of Texas, the presumptive Republican nominee, said in his statement. Compared with students from similar socioeconomic backgrounds in other states, Texas students rank near the top on national math tests in the RAND analysis.

But, as the researchers point out, most of the policy changes credited with Texas’ achievement gains came about long before Mr. Bush became governor in 1995.

Vice President Al Gore, the presumptive Democratic nominee, also cited the report on his Web site for its support of smaller classes and expanded access to preschools—two remedies that he advocates.

The RAND team analyzed scores from seven NAEP tests in reading and math taken by 4th and 8th graders in 44 states between 1990 and 1996. Seen as a national barometer of student achievement, the federally sponsored tests are given periodically to representative samples of 2,500 students in participating states.

Nationwide, the report shows, students’ scores in math improved during that period by an average of 1 percentile point a year. Scores shot up fastest in Texas, North Carolina, and Michigan, where the gains averaged 2 to 2.5 percentile points a year.

The highest average scorers, however, tended to be in Northern, mostly rural states, such as Maine, North Dakota, New Hampshire, and Montana. The lowest-scoring states included eight Southern states, California, and New Mexico. Researchers attributed most of differences among states to demographics.

To put states on a more level playing field, the researchers adjusted the scores to account for socioeconomic differences in their student populations.

By that “value added” measure, a student in top-ranked Texas still scored an average of 11 percentile points higher in math than a student from a family with similar education, income levels, and other characteristics in last-ranked California.

Those differences, Mr. Grissmer said, were due to the kinds of educational investments states made in the ‘80s and early ‘90s.

Like most of the states scoring high on that index, Texas in those years had smaller-than-average classes, higher rates of participation in prekindergarten, and greater percentages of teachers who reported being satisfied with their teaching resources.

Resource Targeting Urged

California schools, in comparison, were still reeling from the effects of Proposition 13, the 1978 ballot initiative that curtailed property-tax revenue. The tax reductions, combined with a poor state economy, led to ballooning class sizes across the state, according to Mr. Grissmer.

Where the
States Stand

The Rand Corp. report looked at average gains of 4th and 8th graders in 44 states on the National Assessment of Education Progress.

Average Annual Gain 1990-1996

Highest Gains

State

Percentile
Points

North Carolina

2.45

Texas

2.01

Michigan

1.97

Indiana

1.67

Maryland

1.63

West Virginia

1.46

Kentucky

1.36

Rhode Island

1.36

Minnesota

1.36

Colorado

1.36

Lowest Gains

State

Percentile
Points

Massachusetts

.78

Iowa

.75

Missouri

.71

Maine

.68

North Dakota

.61

Utah

.61

Delaware

.54

Georgia

.41

Wyoming

-.20

Source: Rand Corp.

“That’s probably the premier example of what happens when resources get pretty frayed,” he said. California has since launched a program to cut the number of pupils in K-3 classes from 29 to 20.

What didn’t make an impact on a state’s student performance, the researchers found, were teachers’ salary levels, their years of experience, or the percentage of teachers with a master’s degree.

That finding runs counter to some state-level studies suggesting that effective teachers have a lasting effect on students’ academic achievement.

And Mr. Grissmer himself appeared to be skeptical of those conclusions. He noted, for example, that the data were collected when teachers were in ample supply—a contrast with current shortage conditions in many places and certain subject areas.

What’s more, he said, teachers’ impact could be “partly buried in family effects.” That’s because schools with more affluent school populations tend to have better-paid and better-qualified teachers.

In fact, a central theme of the research is that all of the improvement efforts states tried—including class-size reductions as well as increases in teacher salaries—had more of an impact on disadvantaged or minority students.

That’s why Mr. Grissmer suggests that states can leverage their education dollars by targeting funds to those groups.

“The issue is: How do you ensure that people spend money well and target money well?” said Eric A. Hanushek, an economist who criticized the report last week.

“Everybody believes there are some schools that use resources well, just as there are some schools that don’t,” added Mr. Hanushek, a senior fellow at Stanford University’s Hoover Institute. “So if the policy is to put more resources in schools, you get an average gain which isn’t very much.”

Related Tags:

A version of this article appeared in the August 02, 2000 edition of Education Week as RAND Report Tracks State NAEP Gains

Events

Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Privacy & Security Webinar
Navigating Cybersecurity: Securing District Documents and Data
Learn how K-12 districts are addressing the challenges of maintaining a secure tech environment, managing documents and data, automating critical processes, and doing it all with limited resources.
Content provided by Softdocs

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Opinion A Good Principal Knows When It's Time to Leave
I didn’t leave my job because of burnout; I stepped away from being a school leader because it was in everybody’s best interest.
Matthew Ebert
4 min read
Conceptual illustration of someone handing off a baton to someone else over a completed puzzle.
Vanessa Solis/Education Week via Canva
School & District Management Principals Tell Politicians on Capitol Hill: We’re Burning Out
Students' mental health top principals' growing list of concerns.
6 min read
People walk outside the U.S Capitol building in Washington, June 9, 2022.
Visitors walk outside the U.S Capitol building in Washington on June 9, 2022.
Patrick Semansky/AP
School & District Management Women Superintendents Experience Bias on the Climb to Leadership
Interpersonal slights and inequities make it hard for women to land the job and stay in it.
3 min read
Woman stands in front of a staircase in different colors. She is about to walk up the stairs. Concept of standing in front of a challenge and finding the right solution and courage to move on.
mikkelwilliam/E+
School & District Management Fewer of Today's Superintendents Are at Retirement Age
A new survey of superintendents adds to what we know about the people who lead the nation's school districts.
4 min read
Conceptual illustration of money, salaries and data.
iStock/Getty