States

As Few as Three Test Responses Separate A from F Schools in Okla., Study Says

By Andrew Ujifusa — October 17, 2013 4 min read
  • Save to favorites
  • Print

UPDATED

As few as three correct responses on Oklahoma state tests can separate those schools receiving an A grade from those receiving an F under the state’s accountability system, according to a paper released by the University of Oklahoma and Oklahoma State University this month that says the system has many flaws, among them that it hides the poor performance of racial minorities and low-income students.

“Oklahoma School Grades: Hiding ‘Poor’ Achievement” examines raw scores on the state’s reading and math tests from 15,000 students in 63 urban schools in the state. The study’s authors at the Oklahoma Center for Education Policy (University of Oklahoma) and the Center for Educational Research and Evaluation (Oklahoma State University) say they chose these schools because it is crucial in those districts to differentiate high-performing from low-performing schools, and because of their relatively high concentration of low-income and minority students. In addition, the study examined science test scores from about 4,900 students.

What did the study find? According to its authors, they uncovered three glaring problems with the state’s A-F school grading system. First, and perhaps most controversially, the joint study found that on average, only about five (4.86 to be exact) correct responses on the state reading test separated A school from D schools, the biggest gap the researchers found between top-ranked schools and their lower-ranked counterparts. The gap between A schools and F schools on the reading test was 3.67 correct responses. (That means one group of students, on average, answered more questions correctly than another group of students in a different school.) When averaging scores on the math and science as well as reading tests, about three to six correct responses separated the best schools from the worst according to the A-F system.

“These are small effects on which to base significant decisions,” the authors say. “Many of the achievement differences between letter grades were likely due to chance; even when they reached statistical significance they were of questionable practical utility, generating little confidence in grade distinctions.”

Second, the study says that on the math tests, some scores from D and F schools topped those from B and C schools, and that none of the seven highest-scoring schools on the math exam were in fact A schools.

And third, the study says that when examining students receiving federally subsidized meals, they actually scored higher in D and F schools on average than they did in A and B schools, meaning that these supposedly top schools are “masking the especially low performance of poor and minority children.”

This year, state lawmakers made changes to the A-F system. These included no longer weighting “proficient” and “advanced” scores differently, and no longer making whole-school performance part of a school’s main grade calculation. What do the authors say about these changes? In short, they say the changes don’t solve the problem of relying on proficiency on tests, and failing to account for student mobility across districts.

“The fix is quite simple,” the paper concludes. “A school’s performance should be reported on multiple dimensions—a profile that includes scale scores for subject areas as well as other relevant school conditions (e.g. program coherence, social climate, and faculty and administrative stability).”

I contacted the Oklahoma Department of Education for a response to the study, and received a statement from Superintendent of Public Instruction Janet Barresi: “This analysis appears built on the wrong and dangerous presumption that minority and poverty- stricken children cannot learn. I reject that notion. Equally disturbing is that the researchers’ conclusion belies the importance and effectiveness of teachers.” (I might be getting an additional response from the Oklahoma department, and I’ll update this post if I do.) UPDATE: Oklahoma Secretary of Education and Workforce Robert Sommers also had a response to the report which focuses on what he calls the report’s incorrect diminuation of teachers when it comes to student success: “Professional educators working on the front line should be afforded the opportunity to adjust to their approaches, yet be held accountable for the results. Those who succeed well should be recognized; those who don’t should be helped in their search for better options.”

This year hasn’t been full of sweetness and light for A-F accountability systems—former Florida K-12 boss Tony Bennett resigned in August because of revelations from the Associated Press about alterations made to Indiana’s A-F system in 2012 when he was state superintendent there. Indiana is currently considering how to change that system in the wake of the story. Questions will no doubt continue to surround these systems as they have gained increasing popularity among states. How they change over the coming years is a crucial question for state education policy.

A version of this news article first appeared in the State EdWatch blog.


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Ensuring Continuity of Learning: How to Prepare for the Next Disruption
Across the country, K-12 schools and districts are, again, considering how to ensure effective continuity of learning in the face of emerging COVID variants, politicized debates, and more. Learn from Alexandria City Public Schools superintendent
Content provided by Class
Teaching Profession Live Online Discussion What Have We Learned From Teachers During the Pandemic?
University of California, Santa Cruz, researcher Lora Bartlett and her colleagues spent months studying how the pandemic affected classroom teachers. We will discuss the takeaways from her research not only for teachers, but also for

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

States During Site Visit From Cardona, Illinois Governor Defends Vaccine, Testing Policies
“The testing regimen is there in order to make sure that they’re not entering the institution where they work and spreading COVID-19.”
Karen Ann Cullotta, Chicago Tribune
3 min read
The Student Council lead the creation of “sensory hallways” at Western Branch Middle School in Chesapeake, Va.
U.S. Secretary of Education Miguel Cardona looks on as Gov. J.B. Pritzker speaks with reporters after touring Access Hawthorne Family Health Center, which is offering COVID-19 vaccines at 3040 S. Cicero Ave. in Cicero, as part of the Department of Education's "Return to School Road Trip" events in the Chicago area, Tuesday afternoon, Sept. 21, 2021.
Ashlee Rezin/Chicago Sun-Times via AP
States Kentucky Ends All Statewide Mask Mandates After Governor's Vetoes Overridden
The Republican-led legislation strips the Democratic governor's ability to issue statewide mask mandates in schools or anywhere else.
Jack Brammer and Alex Acquisto, Lexington Herald-Leader
4 min read
In this Wednesday, Sept. 23, 2020, file photo, Kentucky Governor Andy Beshear addresses the media in Frankfort, Ky. Kentucky's governor said Sunday, Oct. 11, that he will quarantine after a member of his security detail who drove with his family the day before later tested positive for COVID-19. Democratic Gov. Andy Beshear said he and his family feel fine, show no coronavirus symptoms and have tested negative for the virus.
In this Sept. 23, 2020, file photo, Kentucky Governor Andy Beshear addresses the media in Frankfort, Ky.
Timothy D. Easley/AP
States Bill to Restrict How Race and Racism Is Taught in Schools Headed to Texas Governor
If the "critical race theory" bill sounds familiar, that's because lawmakers passed a similar one during the regular legislative session.
Eleanor Dearman, Fort Worth Star-Telegram
4 min read
Texas Gov. Greg Abbott speaks at a news conference in Austin, Texas, on June 8, 2021.
Texas Gov. Greg Abbott speaks at a news conference in Austin, Texas, on June 8, 2021.
Eric Gay/AP
States Infographic Which States Are Reporting COVID-19 Cases in Schools?
Some states are reporting the number of COVID-19 cases in their schools and districts. Use this table to find your state's data.
Image shows the coronavirus along with data charts and numbers.
iStock/Getty Images Plus