Find your next job fast at the Jan. 28 Virtual Career Fair. Register now.


July 10, 2002 2 min read

Testing the Testers

The Princeton Review, a for-profit company best known for preparing students to take college-entrance exams, has ranked state testing and accountability systems.

“Testing the Testers 2002" rates state systems based on 25 indicators in four areas: the alignment of tests with the state’s academic standards; test quality, which focuses largely on the procedures used to devise the tests; openness to public scrutiny; and whether the accountability system supports school improvement.

The criteria are weighted at 20 percent, 20 percent, 30 percent, and 30 percent, respectively. The scores are based on public information provided by each state, often on state Web sites. The company relied on findings from the American Federation of Teachers on the alignment of state standards and tests.

North Carolina, Texas, New York, Massachusetts, Arizona, Mississippi, Louisiana, Kansas, Kentucky, South Carolina, and Washington state received the highest rankings. Iowa, Hawaii, West Virginia, Montana, Wyoming, South Dakota, the District of Columbia, Vermont, New Mexico, Oregon, and Tennessee were ranked lowest.

Matthew Gandal, the vice president of Achieve, a Washington-based group that promotes standards-based reform, said the study “asks a fairly good set of questions” about state tests, but “only really scratched the surface” on accountability systems.

But Daniel M. Koretz, a professor at Harvard University’s graduate school of education, said the study “doesn’t deserve any credence.” He noted, for example, that while one criterion claims to evaluate test quality, the company never reviewed the tests themselves or their psychometric properties.

Steven Hodas, the study’s author, said: “This is a version 1.0, and we’re going to do it every year, and it’s going to get better every year.”

“That said,” he added, the study never set out to be a rigorous psychometric evaluation of state tests. “The real importance of these [accountability] systems and of high-stakes testing in general, we believe, is not so much whether they represent an accurate snapshot of the one true reality with a capital T, but the ways they drive behavior.”

In a “full disclosure” footnote to the report, the Princeton Review lists its contracts with several states in 2001-02, but points out that they ranked anywhere from fourth to 50th in the study, which can be found online at

—Lynn Olson

A version of this article appeared in the July 10, 2002 edition of Education Week


Teaching Live Online Discussion A Seat at the Table With Education Week: How Educators Can Respond to a Post-Truth Era
How do educators break through the noise of disinformation to teach lessons grounded in objective truth? Join to find out.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
The 4 Biggest Challenges of MTSS During Remote Learning: How Districts Are Adapting
Leaders share ways they have overcome the biggest obstacles of adapting a MTSS or RTI framework in a hybrid or remote learning environment.
Content provided by Panorama Education
Student Well-Being Online Summit Keeping Students and Teachers Motivated and Engaged
Join experts to learn how to address teacher morale, identify students with low engagement, and share what is working in remote learning.

EdWeek Top School Jobs

Join us for our NBOE 2021 Winter Teacher Virtual Interview Fair!
Newark, New Jersey
Newark Public Schools
Special Education Teacher
Chicago, Illinois
JCFS Chicago
Assistant Director of Technical Solutions
Working from home
EdGems Math LLC

Read Next

Education Briefly Stated Briefly Stated: January 13, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Obituary In Memory of Michele Molnar, EdWeek Market Brief Writer and Editor
EdWeek Market Brief Associate Editor Michele Molnar, who was instrumental in launching the publication, succumbed to cancer.
5 min read
Education Briefly Stated Briefly Stated: December 9, 2020
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated Briefly Stated: Stories You May Have Missed
A collection of articles from the previous week that you may have missed.
8 min read