Opinion
Standards & Accountability Opinion

Could ‘Open Source’ Testing Help Resolve the Testing Impasse?

By Charles Barone — November 17, 2008 5 min read
  • Save to favorites
  • Print

While there is wide disagreement about how to revise the No Child Left Behind Act’s accountability system when the law comes up for reauthorization in the next Congress, there is virtual unanimity on one point: No one is happy with the tests currently used by states to measure student achievement.

The two leading proposals to overhaul the federal testing system are, at least at first glance, diametrically opposed.

Hard-line education reformers, such as New York City Schools Chancellor Joel I. Klein and former Assistant U.S. Secretary of Education Chester E. Finn Jr., are advocating a national test and national standards, as a response to what they see as the “dumbing down” of standards in the face of accountability pressures, and also as a logical policy for a nation trying to maintain its international competitiveness.

BRIC ARCHIVE

Progressives, most notably Stanford University’s Linda Darling-Hammond, who was a key education adviser to Barack Obama in the 2008 presidential campaign, are frustrated with the quality of existing tests and are advocating a shift in the opposite direction. They want to turn from a system of 50 state tests to one of perhaps thousands of local measures that could vary from district to district.

There is merit to the arguments being advanced by both the national test/“higher standards” side and the local measures/“better quality” side. But there are also serious obstacles that likely would prove insurmountable for either to be adopted, as proposed, as federal policy.

Strong opposition to a national test comes from both the left and the right. In 1998, the U.S. House of Representatives blocked, by a bipartisan vote of 242-174, a proposal by President Clinton to simply make available a nationally developed test to states that chose to use it. With testing now much more controversial than it was 10 years ago, any such proposal would almost certainly be even less politically viable.

Local assessments might be easier to sell politically, but would create other problems, particularly for historically disadvantaged students. These local assessments—homework, papers, and tests created by classroom teachers—of course are already employed in every school district in the country. What those advocating them want now, however, is to make such measures part of state accountability systems.

There is virtual unanimity on one point: No one is happy with the tests currently used by states to measure student achievement.

The problem here is that such measures cannot be compared against one another. Students could be held to very different standards even though they would ultimately be applying to the same colleges and competing for the same jobs.

Poor and minority students and students with disabilities, who historically have been held to lower standards, might return to a time when they repeatedly were told they were doing fine, only to graduate from high school and discover they didn’t have the skills needed to succeed in college and the workplace. Resources that are now allocated on the basis of accountability systems geared to a single and comparable set of state tests—those, for example, for after-school and summer programs, tutoring, teacher training, and new curricula—might be misdirected away from areas that actually need them most, because each district or school would then be measured by different standards and different yardsticks.

One possible way to address the concerns of both the national-test and local-measures proponents, and to avoid or minimize some of their proposals’ concomitant problems, is to create a national databank of “locally” developed test items, an “open source” testing system.

Here’s how it might work:

A nonprofit entity could empanel a group of experts to create items in line with nationally recognized standards, perhaps those used as a basis for the National Assessment of Educational Progress or for international comparisons by the Program for International Student Assessment. The panel would have to represent a broad range of stakeholders—teachers, principals, testing experts, policy wonks, higher education faculty members, college presidents, and business leaders.

Over the course of one or two years, the panel would create a pool of test items that would be piloted and subjected to the usual analyses of psychometric rigor. The goal would be to move beyond multiple-choice items to short-answer, problem-solving, essay, and other formats. A set of strict and objective standards for scoring would have to be part of the package. Items and scoring algorithms would be put into a bank with restricted access and security precautions. States could then draw from this pool in revising their own state testing regimes.

The advantages of such a system would be several:

1. It would not be a government-imposed program (though it could be subsidized in part by federal or state grants), thus avoiding some of the political pitfalls of past efforts.

2. It would be low-cost to states.

3. It would get around the testing-company monopoly, which many observers feel stifles creativity and innovation, or at the very least makes it financially prohibitive.

4. It would move the country toward a consensus on what should be assessed by promoting buy-in from a range of educational stakeholders.

5. It would allow a great deal of flexibility. Not all states would have to use the same test. They could select subsets of items as they chose. The hope would be that a core set could be agreed upon, however, which would allow comparisons between states. This could be done nationally or, if agreement could not be reached at that level, regionally.

6. It would answer the “homegrown” argument used by those who want a system of local tests, but would maintain comparability across states and districts, which would not be possible if every locality went off on its own.

7. It could be done now.

No testing system will ever be perfect. But by addressing the concerns of both those who want all children held to the same high standards so that they can compete in a global economy, and those who rightly see serious deficiencies in the tests used by most states, we could move a significant step forward to a system that reflects a more diverse range of views, has a broader base of political support, and better serves students, teachers, and the nation.

A version of this article appeared in the November 19, 2008 edition of Education Week as Could ‘Open Source’ Testing Help Resolve the Testing Impasse?

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
College & Workforce Readiness Webinar
Smarter Tools, Stronger Outcomes: Empowering CTE Educators With Future-Ready Solutions
Open doors to meaningful, hands-on careers with research-backed insights, ideas, and examples of successful CTE programs.
Content provided by Pearson
Recruitment & Retention Webinar EdRecruiter 2026 Survey Results: How School Districts are Finding and Keeping Talent
Discover the latest K-12 hiring trends from EdWeek’s nationwide survey of job seekers and district HR professionals.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Professional Development Webinar
Recalibrating PLCs for Student Growth in the New Year
Get advice from K-12 leaders on resetting your PLCs for spring by utilizing winter assessment data and aligning PLC work with MTSS cycles.
Content provided by Otus

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Standards & Accountability Here’s What’s in Florida’s New African American History Standards
Standards were expanded in the younger grades, but critics question the framing of many of the new standards.
1 min read
Vice President Kamala Harris speaks at the historic Ritz Theatre in downtown Jacksonville, Fla., on July 21, 2023. Harris spoke out against the new standards adopted by the Florida State Board of Education in the teaching of Black history.
Vice President Kamala Harris speaks at the historic Ritz Theatre in downtown Jacksonville, Fla., on July 21, 2023. Harris spoke out against the new standards adopted by the Florida state board of education in the teaching of Black history.
Fran Ruchalski/The Florida Times-Union via AP
Standards & Accountability Opinion How One State Found Common Ground to Produce New History Standards
A veteran board member discusses how the state school board pushed past partisanship to offer a richer, more inclusive history for students.
10 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards & Accountability What the Research Says What Should Schools Do to Build on 20 Years of NCLB Data?
The education law yielded a cornucopia of student information, but not scalable turnaround for schools, an analysis finds.
3 min read
Photo of magnifying glass and charts.
iStock / Getty Images Plus
Standards & Accountability Education Secretary: Standardized Tests Should No Longer Be a 'Hammer'
But states won't ease accountability requirements until federal law tells them to do so, policy experts say.
5 min read
Close up of a student holding pencil and writing the answer on a bubble sheet assessment test with blurred students at their desks in the background
iStock/Getty