Opinion
Accountability Opinion

Best Practices for Evaluating Teacher Ed. Programs

By Mary Brabeck & Frank C. Worrell — November 04, 2014 4 min read

As we continue to await the U.S. Department of Education’s new proposed regulations on accountability rules for teacher-preparation programs—be they state colleges or universities, private institutions, or alternative-certification routes—it’s important to keep in mind certain steps that can help ensure these pathways produce top-notch teachers, including program assessment and the smarter use of data.

Evidence shows that effective teachers are the most important in-school contributors to student learning. A majority of our nation’s teachers attend college and university programs of teacher education, so how can these programs do a better job of preparing educators for the pre-K-12 classroom? Given the ethical and professional responsibility to ready effective teachers for the full range of diverse learners, what data should these schools use to demonstrate the quality of their graduates?

The new single accreditor of teacher-preparation programs, the Council for the Accreditation of Educator Preparation, or CAEP (whose board Mary Brabeck chairs), has announced it will evaluate programs based on what teacher-candidates can do and how effectively they can teach, as demonstrated through reliable assessments, including classroom observations and students’ standardized-test scores. The forthcoming proposed regulations from the Education Department follow failed negotiations more than two years ago between the department and college and university teacher-preparation programs.

Evidence shows that effective teachers are the most important in-school contributors to student learning."

Most people following this issue expect that the regulations will require these programs to report their outcomes, using the best available, reliable, valid, and fair assessments. The department will likely require survey evidence to assess the satisfaction of principals with their teachers’ performance and teachers with their preparation programs, and perhaps even the satisfaction of pre-K-12 students themselves. Similar to the CAEP standards, the rules will also probably require reliable evidence that graduates can teach effectively and have a positive effect on pre-K-12 learning—commonly measured through assessments of student learning growth. (Student learning-growth assessments include the method of value-added modeling, which looks at changes in K-12 students’ achievement scores.)

All of these data points can inform program faculty members and the public about how well a teacher education program is doing. However, we know data can be subject to error, and bad decisions follow the reporting of inaccurate data or misinterpretations of the reliability and validity evidence. In addition, if the assumptions for the use of a statistic are not met, the “information” is at best useless and at worst dangerous.

Under what conditions can we trust the data to inform decisions about teacher-preparation programs? We invite the Education Department to look at our recent task force report.

The American Psychological Association, or APA, with support and encouragement from CAEP, convened a task force earlier this year (which Frank Worrell chaired) that published a practical resource, “Assessing and Evaluating Teacher Preparation Programs.” This report provides teacher education practitioners and policymakers with some best practices for the use of data, in order to make decisions about improving educator-preparation programs.

This report examines three methods for assessing the effectiveness of teacher education programs: value-added assessments of student achievement; standardized observation protocols; and teacher-performance surveys. These methodologies can be used to demonstrate that teacher-candidates who complete a program are well prepared to help all students learn. The report highlights both the usefulness and limitations of these three methodologies. And it provides a set of recommendations for their optimal use by teacher education programs and other stakeholders in teacher preparation, including states and professional associations.

The report addresses critical concepts such as reliability, validity, intended and unintended consequences of assessment, and overall fairness. It describes a host of factors that could degrade the validity of an assessment system and the quality of decisions made. It emphasizes that using multiple sources of data will result in higher-quality data in order to make valid judgments.

Collecting these data will not be easy without investment. Universities must assign resources—time, infrastructure, technical capacity, funding, and personnel—to collect pupil and teacher data of high integrity. States must build the appropriate data systems to successfully evaluate their teacher education programs.

Preparation programs must also develop data-collection expertise and the tools to analyze these evaluations. They will have to identify the elements or candidate attributes that make positive contributions to pre-K-12 student learning and use them to improve existing programs.

Faculty members, school and university administrators, state policymakers, and accrediting bodies must reach agreement about the merits of teacher-preparation programs.

Decisions about teacher education programs by the federal Education Department and all other stakeholders must be made now using the best data and methods available, even as we consider and acknowledge the limitations of these methods. The APA report serves as a guide to developing policy and practice that will allow teacher-preparation programs to demonstrate their progress toward readying the teachers we need.

A version of this article appeared in the November 05, 2014 edition of Education Week as Best Practices for Assessing Teacher Education Programs

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Culturally Relevant Pedagogy to Advance Educational Equity
Schools are welcoming students back into buildings for full-time in-person instruction in a few short weeks and now is the perfect time to take a hard look at both our practices and systems to build
Content provided by PowerMyLearning
Classroom Technology Webinar Making Big Technology Decisions: Advice for District Leaders, Principals, and Teachers
Educators at all levels make decisions that can have a huge impact on students. That’s especially true when it comes to the use of technology, which was activated like never before to help students learn
Professional Development Webinar Expand Digital Learning by Expanding Teacher Training
This discussion will examine how things have changed and offer guidance on smart, cost-effective ways to expand digital learning efforts and train teachers to maximize the use of new technologies for learning.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Accountability The Feds Offered Waivers on ESSA Accountability. Here's Where States Stand on Getting Them
While they get less attention than testing waivers, flexibility related to low-performing schools is an important federal and state issue.
5 min read
Image of a student taking a test with a mask on.
Rich Vintage/E+
Accountability Opinion Absenteeism Is the Wrong Student Engagement Metric to Use Right Now
In a post-pandemic era for school accountability, let’s focus on measuring what matters.
Sara Johnson, Annette Anderson & Ruth R. Faden
4 min read
Figure being erased.
Getty
Accountability Biden Education Team Squashes States' Push to Nix All Tests but Approves Other Flexibility
The department has telegraphed its decision to deny states' requests to cancel federally mandated tests for weeks.
3 min read
A first-grader learns keyboarding skills at Bayview Elementary School in San Pablo, Calif on March 12, 2015. Schools around the country are teaching students as young as 6 years old, basic typing and other keyboarding skills. The Common Core education standards adopted by a majority of states call for students to be able to use technology to research, write and give oral presentations, but the imperative for educators arrived with the introduction of standardized tests that are taken on computers instead of with paper and pencils.
The U.S. Department of Education denied some states' requests to cancel standardized tests this year. Others are seeking flexibility from some testing requirements, rather than skipping the assessments altogether.
Eric Risberg/AP
Accountability Explainer Will There Be Standardized Tests This Year? 8 Questions Answered
Educators want to know: Will the exams happen? If so, what will they look like, and how will the results be used?
12 min read
Students testing.
Getty