Assessment

Ariz. Ranks Schools By ‘Value Added’ to Scores

By Darcia Harris Bowman — February 09, 2000 4 min read

Arizona’s Peoria United district is accustomed to doing well. The 33,000-student school system touts a fully certified teaching staff, a comprehensive K-12 curriculum, and student test scores well above state and national averages.

So when the state education department released the results of its new accountability system for schools earlier this month and not a single Peoria school appeared at the top of the list, district leaders wondered what had happened.

Lisa Graham Keegan

Arizona has joined a handful of states and some school districts that use an accountability tool called value-added assessment. Rather than simply ranking schools based on raw test scores, the education department measured academic gains this year by comparing the 1998 and 1999 standardized-test scores of about 300,000 students in 1,000 elementary and middle schools, including 45 charter schools.

“These data complete the picture of school effectiveness,” state schools Superintendent Lisa Graham Keegan said in a statement prepared for the Jan. 25 release of the department’s analysis. “This data is vital to parents as they can see the impact of instruction at their children’s schools. By looking at progress, this analysis captures the effect a school has on a student’s progress regardless of where he starts.”

Schools were given a rating of one to five stars in mathematics and reading, depending on how their academic growth over a year compared with that of other schools. The Peoria district, located in northwest Arizona in the cities of Peoria and Glendale, has no five-star schools. Most instead ended up in the middle of the pack, with three stars.

“I don’t have a great deal of confidence this is sending the right message to our communities,” said Linda R. Bromert, Peoria’s assistant administrator for elementary and academic services and K-12 assessment. “Those star ratings were assigned based on simple rank order, rather than any specific criteria set by the state. I really do applaud the state’s efforts to look at standardized-test scores to measure growth, but I disagree with their methodology.”

Method Called Fairer

But state education officials and some researchers say value-added analyses are a much fairer accountability tool than traditional means of reporting test results.

The common practice is to judge schools based on students’ average test scores, or the percent who score at or above a predetermined level. But the strong link between test scores and socioeconomic background has led some to argue that exam scores have more to do with a student’s background than how well schools are doing their jobs. ( “A Question of Value,” May 13, 1998.) Proponents of value-added assessment say a more reasonable way of determining a school’s performance is to focus on gains in the test scores of its students. That method also makes it possible to see which schools’ students are making the most academic progress—regardless of whether their test scores are higher or lower than those of other schools.

The value-added method was pioneered by University of Tennessee researcher William L. Sanders, who has tracked teacher- quality effects in Tennessee. Texas and North Carolina are using customized versions of the Sanders model, and Florida is expected to be using a similar system by next year, said Mark C. Duffy, a research analyst for the Consortium for Policy Research in Education, based at the University of Pennsylvania.

“What’s neat about this is it gives you a way to chart growth rather than setting an absolute target schools have to jump over,” Mr. Duffy said.

Arizona officials said they took an additional step to make sure the assessments were an accurate picture of each school’s performance compared with that of others. Because it may be easier to make gains in low-performing schools, the education department weighted the results to make the process fair for schools with higher test scores.

“We are not suggesting this report be taken in isolation,” said David R. Garcia, the director of research and policy for the department. “We do not want to put undue pressure on schools that started out well.”

Some Schools Pleased

Some schools find the results of Arizona’s assessment report reason to celebrate.

The Tempe Elementary School District in the Phoenix area serves 13,000 students, many of whom are poor and are struggling to learn English. But several Tempe schools got five- and four-star ratings, underscoring what district leaders say they’ve been saying for years: Test scores alone don’t tell the whole story.

“Typically when our district is compared to some of our neighboring districts, we find our scores are lower, and we take hits for it,” said Katherine Bareiss, a district spokeswoman. “This new assessment shows our students are making gains, even when we’re compared to other schools.”

Related Tags:

A version of this article appeared in the February 09, 2000 edition of Education Week as Ariz. Ranks Schools By ‘Value Added’ to Scores

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Classroom Technology Webinar
Educator-Driven EdTech Design: Help Shape the Future of Classroom Technology
Join us for a collaborative workshop where you will get a live demo of GoGuardian Teacher, including seamless new integrations with Google Classroom, and participate in an interactive design exercise building a feature based on
Content provided by GoGuardian
School & District Management Live Online Discussion A Seat at the Table With Education Week: What Did We Learn About Schooling Models This Year?
After a year of living with the pandemic, what schooling models might we turn to as we look ahead to improve the student learning experience? Could year-round schooling be one of them? What about online
School & District Management Webinar What's Ahead for Hybrid Learning: Putting Best Practices in Motion
It’s safe to say hybrid learning—a mix of in-person and remote instruction that evolved quickly during the pandemic—is probably here to stay in K-12 education to some extent. That is the case even though increasing

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Opinion AP Exams Can't Be Business as Usual This Year
The College Board seems unconcerned with the collateral damage of its pandemic approach, writes an assistant superintendent of curriculum and instruction.
Pete Bavis
5 min read
Illustration of large boat in turbulent waters with other smaller boats falling into the abyss.
iStock/Getty Images Plus
Assessment Federal Lawmakers Urge Miguel Cardona to Let States Cancel Tests, Highlighting Discord
A letter from Democratic members to the new education secretary calls for an end to the "flawed" system of annual standardized exams.
3 min read
Jamaal Bowman speaks to reporters after voting at a polling station inside Yonkers Middle/High School in Yonkers, N.Y. on June 23, 2020.
Jamaal Bowman speaks to reporters after voting at a polling station inside Yonkers Middle/High School in Yonkers, N.Y. on June 23, 2020.
John Minchillo/AP
Assessment How Two Years of Pandemic Disruption Could Shake Up the Debate Over Standardized Testing
Moves to opt out of state tests and change how they're given threaten to reignite fights over high-stakes assessments.
9 min read
Image of a student at a desk.
patat/iStock/Getty
Assessment A Plan for Standardized Test Scores During the Pandemic Has Gotten States' Attention
A testing expert says his idea would provide helpful data with key context, but said other measures about student well-being are crucial.
7 min read
HS class 1257213326
Getty