Federal

Budget Woes Putting Squeeze on State Testing, GAO Reports

Use of multiple-choice items grows as some seek to cut costs.
October 06, 2009 6 min read
  • Save to favorites
  • Print

Includes updates and/or revisions.

Congress’ investigative arm is spotlighting the challenges states face with their testing systems, from recession-driven budget pressures to ensuring the validity and reliability of statewide student assessments.

A new, wide-ranging report by the Government Accountability Office on state testing under the No Child Left Behind Act finds that although most states today spend far more on assessments than in 2002, when the federal law was enacted, 19 reported recent cuts in their testing budgets because of fiscal constraints. Ten others expected future reductions in such spending.

The report also finds that states face a variety of hurdles in ensuring the validity and reliability of those tests, such as staff capacity, assessment security, and developing alternate assessments for students with disabilities.

In addition, the GAO says, some states are using more multiple-choice items than at the time of the NCLB law’s enactment because they can be scored inexpensively within the tight reporting time frames of the federal law.

“Cost and time pressures have influenced state decisions about assessment type … and content,” says the GAO report, issued last month.

John R. Tanner, the director of the Center for Innovative Measures at the Council of Chief State School Officers, said he sees real risks to an over-reliance on multiple-choice items.

“One of the consequences of test-based accountability is that, particularly in low-performing schools, the test becomes the curriculum, because passing that test becomes so all-important,” said Mr. Tanner. “If you don’t have items that represent the full richness of the [academic] standards, … then you put the curriculum at risk of doing the same thing.”

Meanwhile, nearly eight years after the law’s passage, a dozen states as of July still had not received final approval for their reading/language arts and mathematics assessment systems under the NCLB act by the U.S. Department of Education, according to the GAO. One key difficulty in most of those states, the report says, was ensuring the validity and reliability of their alternate assessments.

To win federal approval, states must show evidence of sufficient technical quality in their assessments and alignment with their academic standards.

The GAO report also raises concerns about the review process the Education Department has used to inform its determinations.

Federal Mandate

The No Child Left Behind Act, a reauthorization of the Elementary and Secondary Education Act, ramped up the extent of state tesing. It requires all states to test students in reading/language arts and math each year from grades 3-8, and once in high school.

Data from the assessments are used to make accountability decisions mandated under the law, including corrective actions such as replacing some school staff. The law also requires science testing once in elementary school, middle school, and high school. And, under the NCLB act, states must develop alternate assessments for students with significant cognitive disabilities.

The federal government has provided $400 million each year to help states pay for NCLB-mandated testing. But the GAO report suggests this often fails to cover the full costs.

More than half the 44 states that responded to a GAO survey question reported that the majority of their funding for tests administered to meet NCLB requirements came from state coffers.

As of January, 19 states told the GAO that they had reduced their testing budgets to comply with NCLB mandates as a result of statewide budget cuts. Another 14 states said their budgets for NCLB testing had not been reduced, but 10 of those expected future cuts.

States are taking a range of steps to trim testing budgets, both for NCLB-required tests and beyond.

“They’re cutting some of the technical staff” at state education agencies, said Scott Marion, the associate director of the Center for Assessment, a nonprofit consulting firm based in Dover, N.H. “Certainly, there is more multiple choice [material]. They’re cutting out tests that they might have included before, like social studies.”

Ohio, for one, recently suspended its social studies tests for 5th and 8th graders, and its writing tests for 4th and 7th graders. Those tests were selected because they are not required under the NCLB law, said Scott Blake, a spokesman for the Ohio education department. The test suspensions will save the state $8.2 million over two years, he said.

States also have cut costs by increasing their use of multiple-choice questions on their tests since the federal law was enacted, the GAO found. Of the 47 states that responded to a GAO question on the matter, 10 reported increasing the use of multiple-choice items on reading/language arts tests, and 11 reported an increase in math. Marland, for example, previously administered an assessment that was almost totally comprised of “open/constructed response questions,” but has since moved to an assessment that is primarily multiple choice.

Even so, the report states, “Many state officials and experts we spoke with told us that multiple-choice items limit states from assessing highly cognitively complex content. For example, Texas assessment officials told us that some aspects of state standards, such as a student’s ability to conduct scientific research, cannot be assessed using multiple choice.”

At the same time, the GAO found that some states have developed and administered assessments in collaboration with one another, allowing them to pool resources and use a greater diversity of item types. It cites as an example the New England Common Assessments Program, which involves Maine, New Hampshire, Rhode Island, and Vermont.

‘Gaps’ in Security

Meanwhile, the report finds that the capacity of state education agencies to develop and oversee testing systems varies widely.

“Greater state capacity allows states to be more thoughtful in developing their state assessment systems, and provide greater oversight of their assessment vendors, according to state officials,” the GAO says.

The report identifies several gaps in security policies for assessments. For one, experts told the GAO that many states do not conduct any statistical analyses of test results to detect indications of cheating.

The report also finds that states have faced difficulties in developing valid and reliable alternate assessments for students with disabilities. One problem, the GAO says, is that this student population is extremely diverse, with a wide range of cognitive disabilities.

Finally, the report raises concerns about the quality of communication from the federal Department of Education and the independent peer-review panels it established to scrutinize state assessment systems, suggesting it’s been decidedly mixed.

Gregory J. Cizek, a professor of educational measurement and evaluation at the University of North Carolina at Chapel Hill, said poor communication from the department and peer-review panels has been an “epidemic” problem for states.

“States were kind of groping to figure out what would be acceptable,” he said. “That has caused a lot of variability, ... where two states [may be] doing the same thing, and one gets approved and another doesn’t.”

In comments submitted to the GAO, the Education Department said it has taken recent steps to improve communication with states during the peer-review process.

A version of this article appeared in the October 14, 2009 edition of Education Week as States Face Budget Hurdles on Testing, GAO Says

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
IT Infrastructure & Management Webinar
The Reality of Change: How Embracing and Planning for Change Can Shape Your Edtech Strategy
Promethean edtech experts delve into the reality of tech change and explore how embracing and planning for it can be your most powerful strategy for maximizing ROI.
Content provided by Promethean
Reading & Literacy K-12 Essentials Forum Reading Instruction Across Content Disciplines
Join this free virtual event to hear from educators and experts implementing innovative strategies in reading across different subjects.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in Schools
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by Panorama Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Opinion No, the U.S. Ed. Dept. Won't Be Abolished. But Here's What’s Likely to Happen Instead
There are plenty of big changes ahead that could catch educators, advocates, and others by surprise.
5 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
Federal 5 Trump Education Priorities for a Second Term
With key players appointed to their cabinet positions, the scaffolding for President-elect Donald Trump's second term is taking shape.
7 min read
President-elect Donald Trump takes the stage before speaking at the FOX Nation Patriot Awards on Dec. 5, 2024, in Greenvale, N.Y.
President-elect Donald Trump takes the stage before speaking at the FOX Nation Patriot Awards on Dec. 5, 2024, in Greenvale, N.Y. With the frameworks now in place, Trump has laid priorities for education.
Heather Khalifa/AP
Federal Here's How Much Linda McMahon's Foundation Has Donated to Education Causes
The president-elect's pick for education secretary has long given to education causes through her family foundation.
5 min read
Linda McMahon, former Administrator of Small Business Administration, speaks during the Republican National Convention on July 18, 2024, in Milwaukee.
Linda McMahon, former Administrator of Small Business Administration, speaks during the Republican National Convention on July 18, 2024, in Milwaukee. McMahon, Trump's choice to lead the U.S. Department of Education in his second term, has a long history of giving to education causes through her family foundation.
J. Scott Applewhite/AP
Federal Republicans Preview Their Education Priorities in a Second Trump Term
In a hearing, Republicans called for more civics education and expressed concerns over "critical race theory" in schools.
5 min read
Rep. Aaron Bean, R-Fla., Chair of the House Subcommittee on Early Childhood, Elementary, and Secondary Education, speaks during a hearing on antisemitism in K-12 public schools, Wednesday, May 8, 2024, on Capitol Hill in Washington.
Rep. Aaron Bean, R-Fla., chair of the House Subcommittee on Early Childhood, Elementary, and Secondary Education, speaks during a hearing on antisemitism in K-12 public schools on May 8, 2024, in Washington. At a hearing on Dec. 4, 2024, the subcommittee discussed civics and government curriculum.
Jacquelyn Martin/AP