Find your next job fast at the Jan. 28 Virtual Career Fair. Register now.
Blog

Your Education Road Map

Politics K-12®

ESSA. Congress. State chiefs. School spending. Elections. Education Week reporters keep watch on education policy and politics in the nation’s capital and in the states.

Education

Scoring Outliers’ Effect on Race to Top

By Michele McNeil — April 01, 2010 1 min read

Louisiana officials are complaining that one Race to the Top judge sank their entire application.

Well, you can judge for yourself, but our own quick analysis shows Louisiana was affected more than any other finalist state by scoring outliers.

With the help of Stephen Sawchuk of Teacher Beat fame, we cobbled together our own scoring spreadsheet, throwing out the lowest and the highest score for each state, and averaging the remaining three scores. This means that a really hard grader, or a really easy grader, can’t unduly influence the scores. We’ll call this the McNeil-Sawchuk scoring system, inspired by the various scoring system changes in international figure skating.

The new scoring system would not have changed the outcomes for Delaware and Tennessee, which would have still been Nos. 1 and 2, respectively.

However, this would have vaulted Louisiana by 10 points to sixth from 11th place (and higher had it not lost those easy 15 STEM points), and Georgia would have fallen by 6.6 points from third place to seventh.

It turns out, Georgia and Louisiana were most affected by outliers. Georgia benefited from an unusually high score (jump to Page 29 of the state’s comments to read why that judge thought so highly of Georgia). And Louisiana suffered because of a low one (jump to Page 31 to read that judge’s comments).

The McNeil-Sawchuk scoring system has its many flaws, especially since there might be very good reasons for such big swings in judges’ scores. But it’s important to acknowledge the power of a single peer reviewer whose unusually high or low score could have a big impact on states’ rankings.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Branding Matters. Learn From the Pros Why and How
Learn directly from the pros why K-12 branding and marketing matters, and how to do it effectively.
Content provided by EdWeek Top School Jobs
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
How to Make Learning More Interactive From Anywhere
Join experts from Samsung and Boxlight to learn how to make learning more interactive from anywhere.
Content provided by Samsung
Teaching Live Online Discussion A Seat at the Table With Education Week: How Educators Can Respond to a Post-Truth Era
How do educators break through the noise of disinformation to teach lessons grounded in objective truth? Join to find out.

EdWeek Top School Jobs

Human Resources Manager
Madison, Wisconsin
One City Schools
Elementary Teacher - Scholars Academy
Madison, Wisconsin
One City Schools
Communications Officer
Chattanooga, Tennessee
Hamilton County Department of Education
Special Education Teacher
Chicago, Illinois
JCFS Chicago

Read Next

Education Briefly Stated Briefly Stated: January 13, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Obituary In Memory of Michele Molnar, EdWeek Market Brief Writer and Editor
EdWeek Market Brief Associate Editor Michele Molnar, who was instrumental in launching the publication, succumbed to cancer.
5 min read
Education Briefly Stated Briefly Stated: December 9, 2020
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated Briefly Stated: Stories You May Have Missed
A collection of articles from the previous week that you may have missed.
8 min read