Standards

Analysis Finds States Strengthening Rigor of Student Exams

By Stephen Sawchuk — August 23, 2011 6 min read
  • Save to favorites
  • Print

A handful of states have increased the rigor of their state assessments since 2007, an analysis released this month by the statistical wing of the U.S. Department of Education concludes.

The finding stands in contrast to earlier studies by the federal agency, which have painted a picture of states often lowering their reading and mathematics test-proficiency standards, often referred to as “cutoff scores.”

According to the new data, “we’re actually seeing [states] increase the rigor of their cut scores, at least between 2007 and 2009,” Jack Buckley, the commissioner of the National Center for Education Statistics, said during a conference call with reporters. “That doesn’t fit into the narrative of states’ lowering their bars” in response to the pressures of the No Child Left Behind Act, which requires schools to hit annual performance targets.

Using the National Assessment of Educational Progress as a common yardstick, the analysis finds that during the 2007 to 2009 time period, eight states raised the cutoff score, or percentage of questions students must answer correctly to be deemed “proficient,” on one or more exams. Two states lowered them. Other states made no changes during that time, or made changes that were too small to be significant.

Test Modification

BRIC ARCHIVE

Since 2007, states have tended to make their tests harder for students to pass, by increasing the proficiency standard.

BRIC ARCHIVE

SOURCE: National Center for Education Statistics

Even with the higher standards, however, states’ expectations continue to fall far below those on the prominent national exam. And the range of state proficiency standards continues to be vast, with as many as 71 points on the NAEP scale separating the states with the weakest and strongest expectations.

“This mapping study shows low expectations are the norm in way too many states in this country,” said Joanne Weiss, the chief of staff to U.S. Secretary of Education Arne Duncan, adding that the practice of having each state set its own proficiency standards is “tremendously problematic.”

“It’s lying to parents, lying to children, lying to teachers and principals about the work they’re doing,” she said.

The analysis also found no clear relationship between the rigor of the standards and performance on NAEP, and that states often reported gains on their own state tests that did not appear on NAEP.

Benchmarked to NAEP

The analysis translates each state’s cutoff scores for four exams onto the NAEP scale, using it as a common metric to compare state proficiency expectations. It is the fourth report released by the NCES to use that methodology.

The analysis looks only at the relative stringency of state proficiency criteria. It does not address the differing content of the assessments or the varying purposes for which the tests are used. Some researchers have questioned the appropriateness of using NAEP as a common yardstick because of such limitations.

The results cover 49 states and the District of Columbia. One state, Nebraska, was not included in the results. Until recently, that state used a patchwork of local assessments to meet the nclb law’s annual testing requirements, rather than statewide exams.

Past NCES studies have, in general, highlighted disparities among state definitions of proficiency, a phenomenon some observers credit with accelerating efforts to create common academic content standards. A study of proficiency standards between 2005 and 2007, for instance, found some two dozen instances in which states had lowered their cut scores.

The phenomenon of lowered standards was widely attributed to the pressure of the nclb law, which requires states to test students annually in reading and math and to increase the percentage of students scoring at the proficient level over a 12-year period.

It emerged as a core criticism of the 9-year-old law by Secretary Duncan, who has spent much time this year, so far unsuccessfully, pressuring Congress to revise it.

But the new findings show that between 2007 and 2009, the states of Indiana, Mississippi, Michigan, North Carolina, New Jersey, Oklahoma, South Dakota, and West Virginia raised the bar in one or more grade levels or subjects. Only New Jersey and South Carolina decreased student expectations.

Ms. Weiss of the Education Department credited the NCES’ reports on state cutoff scores as one possible impetus behind the higher expectations.

“Data, I think we’re seeing, has moved policymakers to change their behavior and has helped policymakers to raise the bar in the last couple of years,” she said.

Mississippi, long criticized for expecting too little of its students, raised the bar for all four subject-grade combinations over that time period. Its reading expectations for both 4th and 8th graders now outpace those of most other states, while its math expectations now fall in the middle of the pack.

In contrast, South Carolina ratcheted down its expectations in all four subject-grade combinations during that time period. In both math and reading at grade 4, its standards now trail those of many other states.

“From what we know talking to South Carolina [officials], they fully intended to set their bar lower,” Mr. Buckley said. “For whatever reason, they felt they had set their standard too high.”

A South Carolina education department official noted that the changes occurred before state Superintendent Mick Zais took office in January. Further, an independent body, not the state education department, sets cutoff scores in the state, he said.

“Dr. Zais has consistently called for strong accountability and high proficiency standards for students,” said spokesman Jay W. Ragley. “The NAEP report confirms his concerns that the education establishment worked to lower South Carolina proficiency standards under the guise of developing a new statewide accountability test in 2008 to comply with No Child Left Behind.”

Former South Carolina Superintendent Jim Rex could not be reached for comment.

Overall, states’ proficiency standards continue to fall well below those of the NAEP.

The largest disparities exist for 4th grade reading, where 35 states’ proficiency criteria fell below the “basic” level on NAEP. In the other three subject-grade combinations—4th grade math and 8th grade math and reading—a majority of states’ proficiency standards fell between the basic and the proficient levels on the national exams.

The report also analyzes changes in student achievement for those states which did not alter their cutoff scores or tests over the time period studied. It found that, in most cases, gains on state exams were not corroborated by NAEP.

Common-Core Link?

A spokeswoman for the Washington-based Education Trust praised states for beginning to address disparities in performance between state tests and NAEP, but added, “we’re still nowhere near where we need to be.”

Several observers argued that the move to common standards, which 46 states have now adopted, could give additional momentum to the effort for raising standards.

Education Department officials said they would allow states to waive portions of the NCLB law in exchange for adopting various reforms, including a set of “college and career-ready” academic-content standards.

Mitchell Chester, the commissioner of education for Massachusetts, dismissed concerns voiced by some that the Education Department’s waiver plan would co-opt what has been a state-led effort for common standards.

“It seems to me that there’s lots of precedent for federal policy building on an aggressive state policy, and this report for me made that concrete,” he said. “It’s really striking that not only was [raising standards] the rhetoric of governors and the chief state school officers several years ago, but that many of them backed it up.”

Related Tags:

A version of this article appeared in the August 24, 2011 edition of Education Week as Analysis Finds States Strengthening Rigor of Student Exams

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
Strategies for Incorporating SEL into Curriculum
Empower students to thrive. Learn how to integrate powerful social-emotional learning (SEL) strategies into the classroom.
Content provided by Be GLAD
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Leadership in Education: Building Collaborative Teams and Driving Innovation
Learn strategies to build strong teams, foster innovation, & drive student success.
Content provided by Follett Learning
School & District Management K-12 Essentials Forum Principals, Lead Stronger in the New School Year
Join this free virtual event for a deep dive on the skills and motivation you need to put your best foot forward in the new year.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Standards Explainer What’s the Purpose of Standards in Education? An Explainer
What are standards? Why are they important? What's the Common Core? Do standards improve student achievement? Our explainer has the answers.
11 min read
Photo of students taking test.
F. Sheehan for EdWeek / Getty
Standards Florida's New African American History Standards: What's Behind the Backlash
The state's new standards drew national criticism and leave teachers with questions.
9 min read
Florida Governor and Republican presidential candidate Ron DeSantis speaks during a press conference at the Celebrate Freedom Foundation Hangar in West Columbia, S.C. July 18, 2023. For DeSantis, Tuesday was supposed to mark a major moment to help reset his stagnant Republican presidential campaign. But yet again, the moment was overshadowed by Donald Trump. The former president was the overwhelming focus for much of the day as DeSantis spoke out at a press conference and sat for a highly anticipated interview designed to reassure anxious donors and primary voters that he's still well-positioned to defeat Trump.
Florida Governor and Republican presidential candidate Ron DeSantis speaks during a press conference in West Columbia, S.C., on July 18, 2023. Florida officials approved new African American history standards that drew national backlash, and which DeSantis defended.
Sean Rayford/AP
Standards Here’s What’s in Florida’s New African American History Standards
Standards were expanded in the younger grades, but critics question the framing of many of the new standards.
1 min read
Vice President Kamala Harris speaks at the historic Ritz Theatre in downtown Jacksonville, Fla., on July 21, 2023. Harris spoke out against the new standards adopted by the Florida State Board of Education in the teaching of Black history.
Vice President Kamala Harris speaks at the historic Ritz Theatre in downtown Jacksonville, Fla., on July 21, 2023. Harris spoke out against the new standards adopted by the Florida state board of education in the teaching of Black history.
Fran Ruchalski/The Florida Times-Union via AP
Standards Opinion How One State Found Common Ground to Produce New History Standards
A veteran board member discusses how the state school board pushed past partisanship to offer a richer, more inclusive history for students.
10 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty