Teaching Profession

Value Added: Does It Have Merit?

By Liana Loewus — December 06, 2010 4 min read
  • Save to favorites
  • Print

Educators and researchers on both sides of the value-added debate met in Washington last week to discuss the role of student-performance data in evaluating teachers.

Speaking at a forum organized by the nonprofit Center for American Progress, Dan Goldhaber, an education researcher and professor at the University of Washington-Bothell, presented findings from his new paper, “When the Stakes Are High, Can We Rely on Value-Added?” Goldhaber began by declaring himself “an advocate of using value-added measurements carefully to inform some high-stakes decisions.” He said he understands there are downsides to value-added estimation, which measures a teacher’s impact by tracking student growth on test scores from year to year, but that “we shouldn’t let the perfect be the enemy of the good.”

Opponents of value-added initiatives cite measurement error as a concern—but that’s an inevitable part of any teacher evaluation process, said Goldhaber. In fact, the current systems for evaluating and rewarding teachers have measurement-error potential that he calls “more opaque.” For example, having a master’s degree is not a good predictor of how well an educator will teach reading or math, Goldhaber said. And classroom observations can miss the mark as well: “You can catch teachers on a good day or on a day where all the kids are sick and there’s chaos.”

Overall, he said, his research indicates that value-added estimation “does a better job of predicting achievement than a whole host of teacher characteristics,” including experience and credentials.

But panel participant Angela Minnici, an associate director at the American Federation of Teachers, said there’s a lot of confusion around value-added systems and that it’s “really a concern for teachers.”

In conversations with teachers around the country, Minnici said she often hears about “perceptions of fairness"—for instance, that tests don’t assess the breadth and depth of student learning. And, as Goldhaber himself pointed out, the potential for cheating and misclassification can cause distrust of value-added measures, too.

“Teachers don’t have a problem with being held accountable,” Minnici said, “but they want to make sure it’s fair and that it will help them improve and be successful with their students.”

Some educators’ resistance to the focus on value-added measures stems from the fear that policy changes will lead them down the test-obsessed No Child Left Behind road again, according to Minnici. Teachers are also “reform-fatigued,” she said. They’ve seen numerous reform efforts come and go, and many may be just “biding their time” until the value-added fad has passed.

Quality Control

Jennifer Steele, a policy researcher at the RAND Corporation who spoke at the event, has been studying the challenges schools face when factoring student-achievement data into teacher evaluations. She offered findings from a recent report she co-authored, “Incorporating Student Performance Measures into Teacher Evaluation Systems.” Steele’s team looked at evaluation systems used statewide in Tennessee and Delaware, and those used at the district level in Denver; Washington, D.C.; and Hillsborough County, Fla.

The paper concludes that student-performance measures need to be reliable (internally consistent and without a big margin of error), valid (aligned to the curriculum, but not so closely to require teaching to the test), and “vertically scaled” (reflecting students’ absolute growth rather than a change relative to peers) before they are used for high-stakes decision-making.

But these kinds of quality control measures aren’t cheap, Steele noted. “The challenge is finding resources [at the state and district level],” she said. “We’re advocating doing validation studies, and that demands resources.” She is hoping implementation of the common core standards, which 44 states so far have adopted, will ease the burden on state and district central offices.

The RAND report also looked at the different approaches systems take in overcoming another major challenge—measuring student growth in non-tested subjects and grades. Some systems, for example, hold all teachers accountable for schoolwide performance, said Steele. Denver and the District of Columbia allow teachers in non-tested areas to choose their own student growth targets. Hillsborough district leaders took a more laborious approach, developing several hundred end-of-course exams to use for value-added tracking. Steele’s group does not support any one method, but says states and school systems learn from one another.

The report also recommends that evaluation systems use multiple measures of teacher effectiveness, including value-added data, and consider multiple years of student achievement data in calculating value-added estimations.

Goldhaber agreed that value-added measurements should not be used in isolation for evaluating teachers—but they should “be used to identify groups of teachers we should be concerned about,” he said.

“I’m not wedded to the idea of using value-added,” Goldhaber asserted. “I am wedded to the idea that we need to do more to differentiate between teachers.”


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
What’s Next for Teaching and Learning? Key Trends for the New School Year
The past 18 months changed the face of education forever, leaving teachers, students, and families to adapt to unprecedented challenges in teaching and learning. As we enter the third school year affected by the pandemic—and
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
How Data and Digital Curriculum Can Drive Personalized Instruction
As we return from an abnormal year, it’s an educator’s top priority to make sure the lessons learned under adversity positively impact students during the new school year. Digital curriculum has emerged from the pandemic
Content provided by Kiddom
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession We Feel Your Grief: Remembering the 1,000 Plus Educators Who've Died of COVID-19
The heartbreaking tally of lives lost to the coronavirus continues to rise and take a steep toll on school communities.
3 min read
090321 1000 Educators Lost BS
Education Week
Teaching Profession Letter to the Editor Educators Have a Responsibility to Support the Common Good
A science teacher responds to another science teacher's hesitation to take the COVID-19 vaccine.
1 min read
Teaching Profession With Vaccine Mandates on the Rise, Some Teachers May Face Discipline
With a vaccine now fully FDA-approved, more states and districts will likely require school staff get vaccinated. The logistics are tricky.
9 min read
Grace John, who works at a school in San Lorenzo, gets a COVID-19 shot at a mobile vaccination clinic run by the Federal Emergency Management Agency and the state in Hayward, Calif., on Feb. 19, 2021. California will become the first state in the nation to require all teachers and school staff to get vaccinated or undergo weekly COVID-19 testing. The statewide vaccine mandate for K-12 educators comes as schools return from summer break amid growing concerns of the highly contagious delta variant.
Grace John, who works at a school in San Lorenzo, gets a COVID-19 shot at a mobile vaccination clinic in Hayward, Calif. California is among those states requiring all teachers and school staff to get vaccinated or undergo weekly COVID-19 testing.
Terry Chea/AP
Teaching Profession In Their Own Words Why This Science Teacher Doesn't Want the COVID Vaccine
Contrary to public health guidance, Davis Eidahl, an Iowa high school teacher, has no plans to get the COVID-19 vaccine.
4 min read
Davis Eidahl, a science teacher at Pekin High School in Packwood, Iowa, says he doesn't want to get the COVID-19 vaccine. He thinks social distancing and occasional masking will be sufficient to keep himself and others safe.
Davis Eidahl, a science teacher at Pekin High School in Packwood, Iowa, says he doesn't want to get the COVID-19 vaccine. He thinks social distancing and occasional masking will be sufficient to keep himself and others safe.
Rachel Mummey for Education Week