Education

Testing

July 10, 2002 2 min read
  • Save to favorites
  • Print

Testing the Testers

The Princeton Review, a for-profit company best known for preparing students to take college-entrance exams, has ranked state testing and accountability systems.

“Testing the Testers 2002" rates state systems based on 25 indicators in four areas: the alignment of tests with the state’s academic standards; test quality, which focuses largely on the procedures used to devise the tests; openness to public scrutiny; and whether the accountability system supports school improvement.

The criteria are weighted at 20 percent, 20 percent, 30 percent, and 30 percent, respectively. The scores are based on public information provided by each state, often on state Web sites. The company relied on findings from the American Federation of Teachers on the alignment of state standards and tests.

North Carolina, Texas, New York, Massachusetts, Arizona, Mississippi, Louisiana, Kansas, Kentucky, South Carolina, and Washington state received the highest rankings. Iowa, Hawaii, West Virginia, Montana, Wyoming, South Dakota, the District of Columbia, Vermont, New Mexico, Oregon, and Tennessee were ranked lowest.

Matthew Gandal, the vice president of Achieve, a Washington-based group that promotes standards-based reform, said the study “asks a fairly good set of questions” about state tests, but “only really scratched the surface” on accountability systems.

But Daniel M. Koretz, a professor at Harvard University’s graduate school of education, said the study “doesn’t deserve any credence.” He noted, for example, that while one criterion claims to evaluate test quality, the company never reviewed the tests themselves or their psychometric properties.

Steven Hodas, the study’s author, said: “This is a version 1.0, and we’re going to do it every year, and it’s going to get better every year.”

“That said,” he added, the study never set out to be a rigorous psychometric evaluation of state tests. “The real importance of these [accountability] systems and of high-stakes testing in general, we believe, is not so much whether they represent an accurate snapshot of the one true reality with a capital T, but the ways they drive behavior.”

In a “full disclosure” footnote to the report, the Princeton Review lists its contracts with several states in 2001-02, but points out that they ranked anywhere from fourth to 50th in the study, which can be found online at www.princetonreview.com/statestudy.

—Lynn Olson lolson@epe.org

A version of this article appeared in the July 10, 2002 edition of Education Week

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Deepen the Reach and Impact of Your Leadership
This webinar offers new and veteran leaders a unique opportunity to listen and interact with four of the most influential educational thinkers in North America. With their expert insights, you will learn the key elements
Content provided by Solution Tree
Science K-12 Essentials Forum Teaching Science Today: Challenges and Solutions
Join this event which will tackle handling controversy in the classroom, and making science education relevant for all students.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Stronger Together: Integrating Social and Emotional Supports in an Equity-Based MTSS
Decades of research have shown that when schools implement evidence-based social and emotional supports and programming, academic achievement increases. The impact of these supports – particularly for students of color, students from low-income communities, English
Content provided by Illuminate Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: January 12, 2022
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education School Bus Driver Retires After 48 Years Behind Wheel
Charles City school bus driver Betty Flick sat behind the wheel for the final time last week, wrapping up a 48-year career for the district.
3 min read
Charles City school bus driver Betty Flick poses with one of her farewell signs. Flick has been driving for Charles City School District for 48 years.
Betty Flick quickly fell in love with the job and with the kids, which is what has had her stay in the district for this long.
Courtesy of Abby Koch/Globe Gazette
Education Briefly Stated: December 1, 2021
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Briefly Stated: November 17, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read