Assessment

Groups Honing Real-Time Teacher-Performance Exam

By Stephen Sawchuk — October 14, 2014 4 min read

Prospective doctors take a licensing exam in which they diagnose the ailments of mock patients. Airline pilots dodge wind shear in flight simulators. Even 16-year-olds follow a driving examiner’s directions—turn right, parallel park—to earn their coveted driver’s licenses.

Should a similar licensing standard apply to prospective K-12 teachers?

That’s the thinking behind a new suite of assessments under development by TeachingWorks, a nonprofit launched by University of Michigan education faculty members, and the Educational Testing Service, the purveyor of the venerable Praxis suite of certification tests.

Within a few years, the groups hope to release a new exam capable of measuring teacher-candidates’ ability to execute key aspects of instruction, such as leading a class discussion and asking probing questions to gauge students’ understanding.

As currently envisioned, the exam would rely partly on simulations in which a prospective teacher would interact with actors portraying bewildered parents, 6th graders struggling with fractions, or a rowdy just-back-from-recess class.

The goal is for states to use the exam to supplement or even replace current licensing exams and to ensure candidates enter classrooms with a basic threshold of acceptable skill.

“We should debate less about entry standards to teacher education, and we should agree more on what the exit standards are,” said Deborah Ball, the dean of the University of Michigan’s school of education and the director of TeachingWorks.

Real-Time Assessment

The TeachingWorks and ETS project comes as interest in measuring and improving teachers’ hands-on performance is growing.

Already, a number of performance-based licensing exams exist, notably Stanford University’s edTPA and the ETS’ own Praxis Performance Assessment for Teachers.

Those two exams require a teacher-candidate to assemble a portfolio over several months demonstrating his or her ability to teach a lesson and tailor it for specific students, and include a videotaped segment of each candidate’s instruction.

By contrast, the new exam, tentatively called the National Observational Teaching Exam, or NOTE, would try to gauge a candidate’s teaching skills in real time—and with limited time to prepare.

“The idea is that you’re asked to do something specified at a given moment of time, not give an example of your very best practice,” Ms. Ball said.

The exam will be based on Ms. Ball’s work to codify a list of practices all novice teachers should master and be able to demonstrate before taking charge of their own classrooms. These so-called “high leverage” practices have become the backbone of the University of Michigan’s teacher-preparation programs.

TeachingWorks, a separate body set up by Ms. Ball, consults with education programs to research, refine, and spread the practices.

From a list of 19 core practices, TeachingWorks and the ETS have tentatively settled on four that will serve as the basis for the exam. Specifically, the exam will gauge a teacher’s ability to:

• Conduct a classroom discussion;

• Teach a specific concept, such as dividing fractions, through modeling and examples;

• Elicit and interpret a student’s thinking and tailor instruction in response; and,

• Meet constructively with a parent or guardian to discuss a child’s progress or behavior.

Controlling for Variables

With TeachingWorks providing the curricular basis for the exam, the ETS’ role is to help translate the skills into a testing context.

It is conceptually a difficult task. Indeed, with up to 30 students in a classroom, teaching contains potentially even more variables than driving, flying a plane, or removing tonsils. But ETS officials say technology has made it increasingly possible to control for those variations.

For example, the teams are considering using avatars—"virtual” students represented on a computer screen and controlled by trained actors—to approximate a classroom environment. One such example already exists at the University of Central Florida, in Orlando; its simulated classroom, populated by five mimed students with distinct personalities, has been used by a number of teacher-preparation programs.

To ensure standardization of the exam, the organizations envision giving the prospective teachers a premade lesson plan and making sure that they can carry it out, rather than having them devise the content on their own, as is the case for existing performance exams.

Cost Calculus

Cost could pose a challenge to the endeavor, because performance-based exams tend to be more expensive and longer than other kinds. ETS officials declined to put a dollar estimate on the exam, though they acknowledged that it will have to be considered in the context of novice teachers’ low salaries.

“The practical part is how you make the exam short enough that people will take it, and at a price that people will be able to afford it,” said George Powell, the vice president of teacher licensure and certification programs for the Princeton, N.J.-based ETS. “We’re talking about some pretty sophisticated ways to measure candidates’ abilities.”

It’s also far too early to know whether states and education programs would embrace the novel format. Already, some have been wrestling with the policy implications of portfolio-based tests like the edTPA.

But the project appears to be a go: Prototypes are already being tried out in a handful of teacher-preparation programs across 10 states.

By 2015, the groups plan to begin larger pilots and to have parts of a test for elementary teacher candidates ready for states to adopt by late 2016.

A version of this article appeared in the October 15, 2014 edition of Education Week as Groups Honing Real-Time Teacher-Performance Exam

Let us know what you think!

We’re looking for feedback on our new site to make sure we continue to provide you the best experience.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Future of Work Webinar
Digital Literacy Strategies to Promote Equity
Our new world has only increased our students’ dependence on technology. This makes digital literacy no longer a “nice to have” but a “need to have.” How do we ensure that every student can navigate
Content provided by Learning.com
Mathematics Online Summit Teaching Math in a Pandemic
Attend this online summit to ask questions about how COVID-19 has affected achievement, instruction, assessment, and engagement in math.
School & District Management Webinar Examining the Evidence: Catching Kids Up at a Distance
As districts, schools, and families navigate a new normal following the abrupt end of in-person schooling this spring, students’ learning opportunities vary enormously across the nation. Access to devices and broadband internet and a secure

EdWeek Top School Jobs

Data Analyst
New York, NY, US
New Visions for Public Schools
Project Manager
United States
K12 Inc.
High School Permanent Substitute Teacher
Woolwich Township, NJ, US
Kingsway Regional School District
MS STEM Teacher
Woolwich Township, NJ, US
Kingsway Regional School District

Read Next

Assessment Spotlight Spotlight on Assessment 2021
In this Spotlight, dive into best assessment practices
and more.
Assessment Opinion Testing Students This Spring Would Be a Mistake
High-stakes tests would tell us very little we can't know in other ways, writes a longtime assessment researcher.
Lorrie A. Shepard
5 min read
Illustration of students in virus environment facing wave of test sheets.
Collage by Vanessa Solis/Education Week (Images: iStock/DigitalVision Vectors/Getty)
Assessment Opinion An Open Letter to the NAEP Governing Board
The change under consideration would make the reading test less accurate not more, writes E.D. Hirsch Jr.
E.D. Hirsch Jr.
3 min read
16Hirsch SOC
AscentXmedia/iStock/Getty Images Plus
Assessment It's Official: National Test Is Postponed Due to COVID-19 Concerns
The delay of the 2021 NAEP is a missed opportunity to measure students' pandemic-related learning losses, state by state.
5 min read
Image is teenagers taking a test
Getty