Leadership Symposium Early Bird Deadline Approaching | Join K-12 leaders nationwide for three days of empowering strategies, networking, and inspiration! Discounted pricing ends March 1. Register today.
Teaching Profession

Growth Data for Teachers Under Review

By Stephen Sawchuk — October 20, 2008 8 min read
  • Save to favorites
  • Print

As states’ information-collection systems grow more sophisticated, officials are grappling with where to draw the line on how “value added” data on teachers can be used.

Tennessee law permits the use of such data for teacher evaluation as long as the data meet certain technical requirements. The state’s Hamilton County district, with union approval, also offers bonuses based on the data.

California serves as a counterpoint: A 2006 state law establishing a new teacher-identification database prevents such data from being used for teacher pay, evaluation, or personnel decisions. Some stakeholders there say it might not even be permissible to link teacher records to student data.

“I think we’re going to see more and more state legislatures taking on this issue,” said Aimee Guidera, the executive director of the Data Quality Campaign, an Austin, Texas-based group that promotes the use of longitudinal data to improve schools.

“Yes, some of those conversations are going to talk about merit pay,” she said, “but that’s not the point to start with. Any state that only has the conversation about merit pay is denying itself the benefits of having a truly informed education system.”

Informal Evaluation

New York City is piloting informal teacher-effectiveness reports. The data below about a fictitious teacher are part of a report that might be used with the goal of improving instruction.

BRIC ARCHIVE

SOURCE: New York City Department of Education

Since the adoption of the federal No Child Left Behind Act, the task of establishing data systems for tracking students’ year-to-year achievement gains has fallen largely to the states.

Value-added techniques are one way of dissecting such data. In theory, value-added systems can isolate teachers’ contributions to students’ learning by filtering out factors outside school control, such as family-income level.

Proponents of the systems say value-added information holds promise for being integrated as one of several factors in human-capital decisions, such as evaluations.

Many states are laying the groundwork for such systems by assigning each teacher a unique identification number. According to the Data Quality Campaign, a dozen states can now link teachers to specific students’ course assignments and assessment data. Those states are Alabama, Arkansas, Delaware, Florida, Louisiana, Mississippi, New Mexico, Ohio, Tennessee, Utah, West Virginia, and Wyoming.

Few of those states have set teacher policies that incorporate the data, though—in part, observers say, because value-added systems are a political minefield. States that have progressed on value-added policies—such as Louisiana, which uses the data for teacher-preparation program accountability—typically don’t use the systems for individual teacher decisions.

Researchers note that technical factors can affect the systems’ ability to make reliable determinations of teacher performance, an issue that has raised concerns from the national teachers’ unions.

Last year, the unions condemned a draft of an NCLB reauthorization bill that contained a voluntary performance-pay program for teachers based in part on student test scores. The controversy helped stall consideration of the measure.

“The tenor of that discussion clearly indicates that this is going to be, and will be for some time, a very contentious debate going forward,” said David DeSchryver, the legislative counsel at Brustein & Manasevit, a Washington-based law firm that specializes in education policy.

Changing Minds

Proponents of the systems stress their ability to help districts conduct analyses to determine whether a particular form of professional development, an induction arrangement, or specific grouping of students and teachers led to improved teaching effectiveness and student achievement.

States with value-added data on teachers—also known as “teacher-effect” data—are also using it to tackle some of education’s most intractable problems, including the maldistribution of teacher talent.

In Tennessee, Hamilton and Knox counties use the data to gauge whether schools with higher poverty concentrations have fewer effective teachers than more-advantaged schools. The analyses will help districts devise recruitment strategies, as well as professional development for teachers not as effective as their peers, said Eric Hilgendorf, the state’s director of charter schools and choice programs.

Ideally, Ms. Guidera said, these possibilities should be paramount in discussions with teachers about the systems’ potential.

“It is a very big change for educators to see data not as a hammer, but as a flashlight,” Ms. Guidera said. “Teachers need to see the proof points about why they should change what they’re doing, and how it’s going to make their jobs easier and better. Until we can prove that to them, they have every reason to be concerned.”

Attempts to introduce teacher-effect data without a consensus on appropriate use have generated controversy. The New York state legislature last year banned the use of such data for tenure decisions for two years after a dispute between the New York City school district and the United Federation of Teachers.

But last month, the city garnered the union’s support for a pilot program to provide teachers and their principals with value-added information. The data will be used to help teachers improve, but not for human-capital decisions, said Christopher Cerf, the deputy schools chancellor.

The reports are expected to show whether a teacher, on average, is particularly effective with certain groups of students, such as those at the low end of the achievement spectrum or students with disabilities. Then, principals will be better able to tailor professional development and improve student groupings, Mr. Cerf said.

“If you are going to rely on the innovative powers of educators, you must give them data and information in order to make intelligent decisions,” he said.

‘Bad Consequences’

Beyond the use of data as a tool, though, lingers the possible move to formal personnel decisions based on the data.

State law in Tennessee permits evaluations to incorporate teacher-effect data, provided that such evaluations be based on at least three complete years of academic data. Florida law requires that teacher evaluations be based primarily on student-achievement data.

Randi Weingarten, the president of both the UFT and its national parent, the American Federation of Teachers, remains opposed to such uses of the teacher-effect data. She said those policies would jeopardize use of the data as a tool to improve teaching and learning.

Ms. Weingarten said that using the data for formal evaluations “could create tremendous bad consequences to attracting and retaining teachers in hard-to-staff schools. We have a moral, statistical, and educational reason not to use these things for teacher evaluation.”

As the issue arises in other states, observers expect it to generate legislative and even legal battles.

In California, the restriction on the teacher-identification database is so tightly written that the state may not legally be able to tie its teacher records to its longitudinal student-achievement database. The law prohibits the new system, which won’t be operational until 2010, from being used for pay, promotion, punishment, evaluation, or other employment decisions.

“All along, we have stressed that this system in no way should be connecting individual student-test scores to individual teachers,” said Mike Myslinski, a spokesman for the California Teachers Association, a supporter of the language.

If the union’s interpretation is correct, the state would not be able to provide even informal information to help teachers improve through reports such as those being piloted in New York City.

Russlyn Ali, the executive director of Education Trust-West, which lobbies for better education for poor children, said her Oakland, Calif., organization challenges that interpretation of the law. “We are going to need a judicial opinion to decide this, because there is too much confusion and too much vitriol,” said Ms. Ali, whose organization supports the use of value-added data to identify excellent teachers.

Experts also are concerned about the potential for such laws to hinder research.

“It is worrisome,” said Douglas N. Harris, an assistant professor of education policy studies at the University of Wisconsin-Madison who has studied teacher-effect data. “Certainly the states that have created these data systems and linked teachers to children have learned a lot more than other states.”

State Question

As other states’ data capacity improves, the question remains how their legislatures will respond to those issues.

“If the states right now are the ones who seem to own the standards and assessments, it makes some sense that they are making some rules about the data,” Ms. Weingarten of the AFT said.

In Colorado, a bill to establish a unique teacher identifier tied to student records failed in 2006, in part over concerns about its use for high-stakes purposes.

A commission later set up by the legislature discussed at length potential misuses of the data. But the panel decided against recommending a prohibition on certain policies, fearing that step might hamstring districts’ ability to use the information innovatively, said Jacqueline J. Paone, the executive director of the Alliance for Quality Teaching. The organization works to improve teacher quality in the state.

The commission’s final recommendation to the legislature, in June, stressed that the data should not be used for punitive purposes, said Ms. Paone, who participated on the panel. Now, it is in lawmakers’ hands to translate those recommendations into legislative language.

Advocates of value-added teacher policies worry that future state decisions will be driven by a coterie of stakeholders, rather than a transparent process such as Colorado’s.

“The decisions about value-added-data systems are generally hashed out between the state’s teachers’ union and a few state legislators,” said Kate Walsh, the president of the Washington-based National Council on Teacher Quality, a group that usually wants states to take a stronger role in setting teacher-quality policy.

“If the public were given half a chance to learn about the power of value-added-data systems,” she said, “I doubt they’d remain unengaged and tolerate depriving schools and teachers themselves of the data.”

Coverage of policy efforts to improve the teaching profession is supported by a grant from the Joyce Foundation.
A version of this article appeared in the October 22, 2008 edition of Education Week as Growth Data For Teachers Under Review

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Science of Reading: Emphasis on Language Comprehension
Dive into language comprehension through a breakdown of the Science of Reading with an interactive demonstration.
Content provided by Be GLAD
English-Language Learners Webinar English Learners and the Science of Reading: What Works in the Classroom
ELs & emergent bilinguals deserve the best reading instruction! The Reading League & NCEL join forces on best practices. Learn more in our webinar with both organizations.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession Bilingual Teachers Are in Short Supply. How 3 Districts Solved That Problem
Helping bilingual paraprofessionals obtain bachelor's degrees and teaching credentials leads to more bilingual teachers, districts found.
9 min read
Elizabeth Alonzo works as a bilingual aide with 2nd grade student Esteycy Lopez Perez at West Elementary in Russellville, Ala., on Dec. 9, 2022.
Elizabeth Alonzo works as a bilingual aide with 2nd grade student Esteycy Lopez Perez at West Elementary in Russellville, Ala., on Dec. 9, 2022. Alonzo obtained her bachelor's degree through a partnership with Reach University and the Russellville city schools district.
Tamika Moore for Education Week
Teaching Profession Opinion How I’m Keeping Ahead of Burnout: 4 Tips for Teachers
An English teacher shares her best advice for battling the long-haul blahs until spring break.
Kelly Scott
4 min read
Young woman cartoon character making step from gloomy grey rainy weather to sunny clear day.
iStock/Getty + Education Week
Teaching Profession Opinion Why Is the Nation Invested in Tearing Down Public Education?
Education professor Deborah Loewenberg Ball argues that panic over test scores keeps us from building on the strengths of our children.
Deborah Loewenberg Ball
5 min read
Illustration of school text books and wrecking ball.
F. Sheehan for Education Week / Getty
Teaching Profession Teachers Censor Themselves on Socio-Political Issues, Even Without Restrictive State Laws
A new survey from the RAND Corporation found that two-thirds of teachers limit their instruction on political and social issues in class.
4 min read
Civics teacher Aedrin Albright stands before her class at Chatham Central High School in Bear Creek, N.C., on Tuesday, Nov. 5, 2019. The class is debating whether President Trump should be impeached. The House impeachment inquiry into Trump’s dealings with Ukraine has become a teachable moment in classrooms around the country as educators incorporate the events in Washington into their lesson plans.
Civics teacher Aedrin Albright stands before her class at Chatham Central High School in Bear Creek, N.C., on Tuesday, Nov. 5, 2019. The class was debating whether President Trump should be impeached. A new national survey found that a majority of teachers are now limiting instruction on political and social issues in class.
Allen G. Breed/AP