Opinion
Assessment Opinion

What Did the NAEP Scores Mean?

By Diane Ravitch — October 23, 2007 5 min read

Hi Deb,

Welcome home from Russia! Hope you got your 36 hours of sleep. Given the sad history of Russia over the past century, it will be difficult for them to shake off the burden of so many decades of authoritarianism and totalitarianism. For sure, one can find dissidents under Czarism and under Soviet rule, yet not much of a democratic tradition. Even today, the idea of a free press or the checks and balances that we associate with a healthy democracy seem to be waning, and the forces of authoritarianism appear to be gaining ground.

I have learned over these many weeks of communicating with you that it is hopeless to try to persuade you that a national curriculum is not synonymous with totalitarianism. Many democratic nations in Europe and in Asia have a national curriculum and have not forsworn their democratic institutions or their freedom. A few years ago, researchers at the American Institutes for Research compared achievement on international tests in a dozen nations that participated in both TIMSS and PISA, and only two of them—Australia and the United States—did not have a national curriculum or national testing.

It is interesting and not surprising that you met democratic educators who are turning to private schooling. I had the same experience when I was in Poland in 1991. Some of the most ambitious reformers were opposed altogether to government-controlled education, what we call public education. In their experience, it was nothing more than a conduit for propaganda and mind control by the state. Even now, in this country, I have heard conservatives and libertarians refer to public education as “government schooling,” which they do not mean as a compliment. Indeed, they use the phrase as a way to validate their belief in vouchers and any other funding mechanisms that allow children to escape the clutches of the government education system.

Your anecdote serves to bring home something that we have often discussed. Is public education in the United States still a cornerstone of our democracy? Would it be more or less democratic if there were common academic standards for the nation? Is it more democratic to promote public education or to promote alternatives to public education? Who should control the schools that educate the public’s children?

These are questions that we will continue to debate and discuss, I am sure. Meanwhile, let me catch you up on what happened in your absence.

On Sept. 25, the National Assessment Governing Board released NAEP scores for 2007 in reading and math. The report was mixed, with scores up a bit in both subjects in fourth and eighth grades. As you can well imagine, the U.S. Department of Education trumpeted the gains and attributed them to No Child Left Behind, but the gains were really very modest. The report can be viewed here.

I read the reports, which I highly recommend, and this is what I found:

* Fourth grade reading scores were up by a modest 2 points from 2005 to 2007, from 219 to 221. Actually, scores for this grade on NAEP had been 219 in 2002. The biggest increase in reading scores occurred between 2000 and 2002, when the scores went up by six points. In other words, the gains since NCLB was enacted do not equal the gains recorded on NAEP in the years prior to NCLB.
* Eighth grade reading scores were up by only one point. The trend line for this grade in reading from 1998 to 2007 is a flat line. The score was 263 in 1998 and it is 263 in 2007.
* Fourth grade mathematics scores increased by two points, from 238 in 2005 to 240 in 2007. The trend line in this grade points steadily upward. The biggest gains occurred in the pre-NCLB period, when scores rose from 226 in 2000 to 235 in 2003.
* Eighth grade mathematics scores were up by two points, from 279 in 2005 to 281 in 2007. Again, the pre-NCLB gains were larger, when scores increased from 273 in 2000 to 278 in 2003.

After I read the NAEP reports, I wrote two articles. I referred to NAEP to debunk New York state‘s claims of historic eighth grade gains on its state tests in May and June 2007. On NAEP, the scores for eighth graders in New York state in both subjects were flat. The state assessment director wrote a letter saying that tests that sample students, like NAEP, are less accurate than those that test every single student. I suppose if the scores on NAEP had been good for New York state, the state Education Department would have been satisfied with its methodology.

Then on Oct. 3, I published an article in The New York Times arguing that NCLB was “fundamentally flawed” and should be radically overhauled. I pointed out in the opening paragraph that the test score gains before NCLB, as I showed above, were larger than those that have followed the implementation of NCLB. I also said that “the main goal of the law—that all children in the United States will be proficient in reading and mathematics by 2014—is simply unattainable,” and that this had never been accomplished in any district, state, or nation. My article prompted a response from Secretary of Education Margaret Spellings. Her letter cleverly elided my first point that the gains in achievement were larger before NCLB by stating that “students have reached all-time highs” in achievement (which is untrue for eighth grade reading, which is exactly the same in 2007 as it was in 1998). She also cleverly revised the goal of NCLB: Instead of universal “proficiency,” which is what the law calls for, she writes that the goal is to have “every child at grade level by 2014.” Of course, if grade level is identified by a normed test, then by definition only half the children can possibly meet that goal!

I have been reading the debates in the press and on the blogs about what NAEP really says and what the scores really mean. I have been struck most forcefully by the fact that so many people who argue these questions have not read the NAEP reports, which are written in plain English, and have not seen the graphs, which are intelligible. Instead, they repeat what they read and what they heard. I would feel much better about the state of our democracy if everyone who opines made a point of reviewing the facts first before uttering an opinion about them. Commentators should be ashamed to recycle what they heard, instead of checking the source for themselves.

Diane

The opinions expressed in Bridging Differences are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.