Opinion
Federal Opinion

What We’re Getting Right With PISA

By Michele Bruniges — February 06, 2019 4 min read
BRIC ARCHIVE
  • Save to favorites
  • Print

Over the past two decades, PISA has become the global yardstick for measuring educational success, with more than 80 countries regularly comparing quality, equity, and efficiency in their schooling systems. As chair of PISA’s Governing Board, I am responding to a recent suggestion that the OECD should change the frequency with which it produces international comparisons.

In essence, PISA tests the knowledge and skills of 15-year-old students through metrics that are internationally agreed upon. It links them with contextual data from students, teachers, schools, and systems to understand performance differences. It then harnesses the power of collaboration to act on the data, by creating shared points of reference and by highlighting opportunities for peers to learn from one another.

But the real value of PISA—the Program for International Student Assessment—lies in the global platform for knowledge sharing and collaboration that it established. It attracts the world’s best thinkers, and mobilizes thousands of educators and scientists from the participating countries, to explore what we should expect from students and how we can test that, and what we can learn from performance variation and the policies and practices that different countries pursue. High-performing school systems in Canada, Estonia, or Japan, or rapid improvers like Peru, Portugal, or Vietnam, have become popular destinations for peer-learning and further research.

More frequent assessments provide policymakers with more up-to-date information.”

PISA exemplifies the power of international collaboration. No single country has been able to mount an assessment as relevant, reliable, and innovative as countries were able to develop jointly through PISA. Leading experts in participating countries establish the scope and nature of the assessments. Governments of the participating countries direct this effort based on shared, policy-driven interests.

Some of those decisions are not easy, and many involve negotiation and compromise. What is the right balance between continuity and innovation to ensure the reliable measurement of progress, while retaining the capacity of PISA to adjust to new developments and anticipating future needs? In the digital age, reading literacy has become a very different construct from how it was defined when PISA first tested reading in 2000.

How can the measures be as broad and comparable as possible while retaining relevance in national contexts? Students may learn different things in different countries, or at different points in their schooling career, and there is great variability in the cultural and curricular context of countries.

What is the right balance between the size of samples and the quality and depth of measurement, both of which have cost implications? And what is the right balance between measuring outcomes and measuring co-variates of outcomes that can help explain those outcomes?

One of those design decisions, which governments are regularly discussing, concerns the frequency with which PISA should be conducted. More frequent assessments provide policymakers with more up-to-date information and a more reliable assessment of educational progress. They establish better links between intended, implemented, and achieved policies; and offer a greater scope for the development of new and innovative assessment domains and methods. For example, it took PISA three testing cycles—or nine years—to establish the seminal assessment of collaborative problem-solving that OECD—the Organization for Economic Cooperation and Development—and participating countries successfully implemented in 2015. But, obviously, greater frequency involves greater costs and greater burdens on schools.

When governments reviewed that balance last, in 2014, a clear majority of the member countries of the OECD favored PISA testing every three years as the optimal trade-off between the competing demands. The United States was among the countries favoring a three-year cycle, and then-U.S. Secretary of Education Arne Duncan played an active role in advancing PISA and fostering peer-learning and collaboration among the participating countries for each of the assessments during his tenure.

Obviously, governments change, and the views of governments change, and both the demands on PISA, as well as the methods available to PISA, evolve. That is why governments will continue to come together to reassess all the design decisions in PISA on a regular basis, including the frequency of the cycles, in order to build a consensus of what will serve their countries best. The next such review is planned for 2021.

In the face of education challenges greater than ever before, it may be wiser to accelerate our efforts to learn from the world’s most rapidly improving education systems, rather than slowing down the rate at which we measure educational progress. We compare the rate of economic growth among our countries every three months, and the evolution of unemployment every six months, so seeing how well we prepare our students for their future every three years doesn’t seem exaggerated.

A version of this article appeared in the February 13, 2019 edition of Education Week as Let’s Embrace PISA’s Success

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
Teaching Students to Use Artificial Intelligence Ethically
Ready to embrace AI in your classroom? Join our master class to learn how to use AI as a tool for learning, not a replacement.
Content provided by Solution Tree
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Empowering Students Using Computational Thinking Skills
Empower your students with computational thinking. Learn how to integrate these skills into your teaching and boost student engagement.
Content provided by Project Lead The Way
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
IT Infrastructure & Management Webinar
The Reality of Change: How Embracing and Planning for Change Can Shape Your Edtech Strategy
Promethean edtech experts delve into the reality of tech change and explore how embracing and planning for it can be your most powerful strategy for maximizing ROI.
Content provided by Promethean

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal 5 Trump Education Priorities for a Second Term
With key players appointed to their cabinet positions, the scaffolding for President-elect Donald Trump's second term is taking shape.
7 min read
President-elect Donald Trump takes the stage before speaking at the FOX Nation Patriot Awards on Dec. 5, 2024, in Greenvale, N.Y.
President-elect Donald Trump takes the stage before speaking at the FOX Nation Patriot Awards on Dec. 5, 2024, in Greenvale, N.Y. With the frameworks now in place, Trump has laid priorities for education.
Heather Khalifa/AP
Federal Here's How Much Linda McMahon's Foundation Has Donated to Education Causes
The president-elect's pick for education secretary has long given to education causes through her family foundation.
5 min read
Linda McMahon, former Administrator of Small Business Administration, speaks during the Republican National Convention on July 18, 2024, in Milwaukee.
Linda McMahon, former Administrator of Small Business Administration, speaks during the Republican National Convention on July 18, 2024, in Milwaukee. McMahon, Trump's choice to lead the U.S. Department of Education in his second term, has a long history of giving to education causes through her family foundation.
J. Scott Applewhite/AP
Federal Republicans Preview Their Education Priorities in a Second Trump Term
In a hearing, Republicans called for more civics education and expressed concerns over "critical race theory" in schools.
5 min read
Rep. Aaron Bean, R-Fla., Chair of the House Subcommittee on Early Childhood, Elementary, and Secondary Education, speaks during a hearing on antisemitism in K-12 public schools, Wednesday, May 8, 2024, on Capitol Hill in Washington.
Rep. Aaron Bean, R-Fla., chair of the House Subcommittee on Early Childhood, Elementary, and Secondary Education, speaks during a hearing on antisemitism in K-12 public schools on May 8, 2024, in Washington. At a hearing on Dec. 4, 2024, the subcommittee discussed civics and government curriculum.
Jacquelyn Martin/AP
Federal Opinion The Trump Administration Should 'Devolve the Ed Dept.'s Responsibilities to the States'
After six years helming the House ed. committee, U.S. Rep. Virginia Foxx cuts loose on high points and frustrations of her tenure.
8 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week