Student Achievement

Study for NBPTS Raises Questions About Credential

By Bess Keller — May 12, 2006 5 min read

Teachers certified by the National Board for Professional Teaching Standards are for the most part no more effective in producing student academic progress than teachers without the special status, a long-awaited study concludes.

The research, which draws on one of the largest data sets used so far to examine the credential, was completed well over a year ago. But the board did not provide any public information about the less-than-flattering portrait until earlier this month, when an “overview” was posted on the organization’s Web site. And it put out the summary only after being pressed by a prominent education blogger. National-board officials say they do not intend to release the full study.

Conducted by William L. Sanders, the statistician who pioneered the concept of “value added” analysis of teacher effectiveness, the study found that there was little difference in students’ achievement levels for teachers who earned the prestigious NBPTS credential, those who tried but failed to earn it, and those who never tried to get the certification.

“The amount of variability among teachers with the same NBPTS certification status is considerably greater than the differences between teachers of different status,” says the summary. The study examined more than 35,000 student records and more than 800 teachers in the Charlotte-Mecklenburg and Wake County districts in North Carolina, the state with the most board-certified teachers.

Mr. Sanders, who manages the value-added assessment and research center at the private SAS Institute in Cary, N.C., said one way to think about the implications of the study would be to envision two teachers with identical experience and education applying for the same job—one holding national-board certification and one not. To choose the board-certified teacher over the teacher without the credential would be “only trivially better than a coin flip,” the researcher said.

Mr. Sanders drew conclusions that appear significantly different from those reached by Dan Goldhaber, who also looked at student-test results from North Carolina, though several times the number used by Mr. Sanders and from different years. In a 2004 press release put out by the board to announce his findings, Mr. Goldhaber, a researcher at the University of Washington in Seattle and the Urban Institute in the District of Columbia, said his study appeared to confirm that the board “is in fact identifying those teachers who are more effectively producing student-learning gains.”

Similar Yet Different

Nonetheless, both researchers last week referred to similarities in their results. But while Mr. Goldhaber stressed the reality of small effects on student-learning gains in some grades related to national certification, Mr. Sanders said he thought too much had been made of those.

Research Snippets

A number of studies have examined the worth of the National Board for Professional Teaching Standards credential.

October 2000: Nationally certified teachers from Delaware, the District of Columbia, North Carolina, Ohio, and Virginia performed better than their colleagues without the credential on day-to-day dimensions of teacher expertise. (65 Teachers)

May 2002: The gains of student of board-certified teachers were no greater on average than those made by students of other teachers in Chattanooga, Tenn.
(16 Teachers)

September 2004: In three standardized tests given to 3rd through 6th graders in 14 Arizona districts, nationally certified teachers were linked to an overall average one-month gain in their students’ performance in contrast to others in the same districts. (35 Teachers)

December 2004: Ninth and 10th gradersin the Miami-Dade County school district whose mathematics teachers were certified by the national board scored slightly higher than other students on a Florida math exam. (100,000 student records)

SOURCE: Education Week

“The one thing I feel people have read over the top of is the magnitude of the effects in the Goldhaber report,” he said. The link between several years of classroom experience and student academic progress is many times stronger than any link with national certification, Mr. Sanders pointed out.

Mr. Sanders’ findings came to light last week after Andrew J. Rotherham—a co-founder and the director of the Washington-based Education Sector, a nonprofit think tank—used a posting on his Eduwonk Web log to note that the board had apparently been “sitting on” the results because they were not favorable.

The summary of Mr. Sanders’ research appeared soon after that, although board officials denied the posting was prompted by Mr. Rotherham’s entry on his blog.

The Arlington, Va.-based NBPTS offers its stamp of approval to teachers who successfully negotiate a lengthy and rigorous evaluation. So far, it has certified some 47,500 teachers at a cost estimated at more than $600 million in private, state, and federal money. On top of that, states and districts are spending tens of millions a year on bonus pay for nationally certified teachers as a way to promote better teaching and more learning.

The board has been under increasing pressure to show that the money is wisely spent.

In fact, board officials approached Mr. Sanders to conduct his study even before they launched a broader effort in 2002 to examine the worth of the credential. The board is not under a legal obligation to make the studies it has commissioned publicly available, but it has mostly done so.

‘Brutally Fair’

Mr. Sanders’ research is represented by a summary that he did not see before it was posted on the board’s Web site. “It’s not an adequate summary, and in some ways, it is terribly misleading,” he charged in an interview last week.

The overview is largely critical of the study, citing methodological problems. For instance, it said the study failed to account adequately for a change in the state test and lacked a sufficient number of teachers.

Mr. Sanders rebutted the charges and defended his work, noting he had added two analytical models at the request of board officials. “I spent weeks and weeks and weeks and weeks on this analysis trying to be just as brutally fair and professionally objective as I could,” he maintained.

Mary E. Dilworth, the board’s vice president for higher education initiatives and research, said she “wouldn’t look at [Mr. Sanders’] results as damaging in any way.”

She noted that the board is under no legal obligation to make the paper available since it commissioned the work, and that such decisions are made on a case-by-case basis.

“We hope to use this report as well as others for a better certification system,” she said. Some half-dozen additional studies of the credential’s worth are due in the next several months, she pointed out.

Despite the findings of his study, Mr. Sanders said he believes in the concept of the national board and has been urging officials there to modify the certification process so that it would better reflect the research on student academic gains.

How much doubt the study will cast on the value of national certification among policymakers remains to be seen.

Lynn M. Cornett, the senior vice president for education policies at the Southern Regional Education Board, a research and advocacy group based in Atlanta that works to improve schools across the South, said she could not comment on the study because she had not seen it.

Still, she said, “I think it adds to the continuing discussion of how to use … incentives in states,” a discussion that is likely to broaden out beyond the bonuses now paid to nationally certified teachers in almost all the SREB states. She noted, for instance, that Georgia now requires newly minted nationally certified teachers to teach in low-performing schools to get bonuses and also pays mentor teachers extra.

Mr. Rotherham, a former White House education aide under President Clinton who was named in 2005 to the Virginia state board of education, said in an interview that the board’s failure to be more open about the research was likely to hurt it in the long run.

“They have needlessly aroused suspicion about what they’ve done and needlessly handed their critics ammunition,” he said. “It’s all so … political.”

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Future of Work Webinar
Digital Literacy Strategies to Promote Equity
Our new world has only increased our students’ dependence on technology. This makes digital literacy no longer a “nice to have” but a “need to have.” How do we ensure that every student can navigate
Content provided by Learning.com
Mathematics Online Summit Teaching Math in a Pandemic
Attend this online summit to ask questions about how COVID-19 has affected achievement, instruction, assessment, and engagement in math.
School & District Management Webinar Examining the Evidence: Catching Kids Up at a Distance
As districts, schools, and families navigate a new normal following the abrupt end of in-person schooling this spring, students’ learning opportunities vary enormously across the nation. Access to devices and broadband internet and a secure

EdWeek Top School Jobs

Speech Therapists
Lancaster, PA, US
Lancaster Lebanon IU 13
Elementary Teacher
Madison, Wisconsin
One City Schools

Read Next

Student Achievement From Our Research Center Sources and Notes: How We Graded the States (Quality Counts 2021)
Additional details about how the EdWeek Research Center determines the grades given to states and the nation in the 2021 Quality Counts report.
EdWeek Research Center
4 min read
Student Achievement From Our Research Center What’s Behind the Grades and Scores for Quality Counts 2021?
Here's a guide to the grading scale and each of the indicators that go into making up the rankings for this year's Quality Counts report.
EdWeek Research Center
3 min read
Student Achievement From Our Research Center Where Families Are Feeling Pandemic Impacts the Worst
Recent Census data show families nationwide suffering job loss, food insecurity, and a lack of technology crucial for remote education.
Alex Harwin & Yukiko Furuya
8 min read
Empty home workplace
iStock/Getty
Student Achievement From Our Research Center Are Today's Students Set Up for Success? Nation Earns B-Minus in Latest EdWeek Index
The grade represents steady progress on a range of academic and socioeconomic factors, but the pandemic’s full impact has yet to be felt.
7 min read
Increasing star ratings
DigitalVisionVectors/Getty