Education Opinion

Put PISA in Perspective

By Walt Gardner — December 08, 2010 3 min read
  • Save to favorites
  • Print

The media seemed mesmerized by the latest results of the Program for International Student Assessment, as if the rankings portended the future of the U.S. Before jumping to any such absurd conclusion, readers need to understand more about the nuts and bolts of the test. I grant that this process is technical and dry, but it is the only way of knowing if valid inferences are being made about PISA. You’ve got to look under the hood of a car if you want to know why the engine is malfunctioning.

PISA measures learning that has taken place since birth, but not necessarily what students have learned during their previous year in school. (PISA has been given every three years since 2000 to 15-year-olds.) As a result, it’s extremely difficult to disentangle school effects from non-school effects. Although this distinction is crucial, it is given short shrift by the media in their reportage and commentary.

It’s also vital to determine if a true sample of students from each country is being tested. It’s here that China’s results are highly suspect. About 5,100 students only from Shanghai were chosen. But Shanghai is hardly representative of China because it is an industrialized center with scores of modern universities. In contrast, the U.S. selected students from both public and private schools across the nation.

Most important, the entire matter is overblown. According to a study in the International Journal of Education Policy & Leadership in April 2008, the relationship between student achievement rankings on international assessments of reading, mathematics and science and a nation’s future economic growth is untenable and not causal. Yet you wouldn’t know this by the hyperbolic lead in AOL News: “China has dropped an educational bomb on the United States ... " (“Why Are Chinese Students Walloping US Kids on Test? Dec. 7).

None of the above seems to sink in. In fact, any explanations are immediately labeled as excuses. This attitude effectively cuts off a rational discussion because it puts the other side on the defensive. In an op-ed published in the Wall Street Journal on Dec. 8, Chester E. Finn Jr. acknowledges virtually all of my points and yet curiously concludes that PISA’s “international rankings are widely trusted as a reliable barometer of how young people in different countries compare on core academic subjects” (“A Sputnik Moment for U.S. Education”).

I’m not saying that PISA is unimportant. But we have heard alarmist cries about scores on international tests for decades. In April 1983, “A Nation at Risk” based its bleak prediction on international standardized tests that ranked Japanese students ahead of their American counterparts. But this scare thesis failed to pass muster when Japan’s economy tanked in 1990. Starting in 1991, the U.S. entered the longest period of economic prosperity in its history. And the U.S. is still ranked No. 1 by the World Economic Forum. Isn’t it fair to ask if other factors are at play here?

So let me raise another point. If reformers, including Education Secretary Arne Duncan, are as concerned about the economic future of the U.S. as they maintain, then why do they not say a word about the performance of private schools? After all, these students also took PISA, and are going to enter the workplace or go to college too. Shouldn’t reformers ask why private schools are not doing a better job?

The facile answer is that private schools are not supported by taxpayers. Therefore, they are not accountable in the same way that public schools are. Technically, this is correct. But if the real goal is to prepare all students to compete in the new global economy, don’t private schools have a responsibility as well?

I maintain that if all schools were privatized tomorrow, critics would suddenly become mute. I say that because I believe the endless attacks on public schools are a thinly disguised tactic used to divert attention away from the ultimate objective. PISA and other tests are simply handy tools to undermine confidence.

The opinions expressed in Walt Gardner’s Reality Check are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Evaluating Equity to Drive District-Wide Action this School Year
Educational leaders are charged with ensuring all students receive equitable access to a high-quality education. Yet equity is more than an action. It is a lens through which we continuously review instructional practices and student
Content provided by BetterLesson
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Student Well-Being Webinar
Attendance Awareness Month: The Research Behind Effective Interventions
More than a year has passed since American schools were abruptly closed to halt the spread of COVID-19. Many children have been out of regular school for most, or even all, of that time. Some
Content provided by AllHere

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Schools Get the Brunt of Latest COVID Wave in South Carolina
In the past few weeks, South Carolina has set records for COVID-19 hospitalizations and new cases have approached peak levels of last winter.
4 min read
Two Camden Elementary School students in masks listen as South Carolina Gov. Henry McMaster talks about steps the school is taking to fight COVID-19, Wednesday, Sept. 15, 2021, in Camden, S.C. McMaster has adamantly and repeatedly come out against requiring masks in schools even as the average number of daily COVID-19 cases in the state has risen since early June. (AP Photo/Jeffrey Collins)
Education More States Are Requiring Schools to Teach Native American History and Culture
Advocates say their efforts have gained some momentum with the nation’s reckoning over racial injustice since the killing of George Floyd.
3 min read
A dancer participates in an intertribal dance at Schemitzun on the Mashantucket Pequot Reservation in Mashantucket, Conn., Saturday, Aug. 28, 2021. Connecticut and a handful of other states have recently decided to mandate students be taught about Native American culture and history. (AP Photo/Jessica Hill)
Education Judge's Temporary Order Allows Iowa Schools to Mandate Masks
A federal judge ordered the state to immediately halt enforcement of a law that prevents school boards from ordering masks to be worn.
4 min read
Iowa Gov. Kim Reynolds speaks to reporters following a news conference, Thursday, Aug. 19, 2021, in West Des Moines, Iowa. Reynolds lashed out at President Joe Biden Thursday after he ordered his education secretary to explore possible legal action against states that have blocked school mask mandates and other public health measures meant to protect students against COVID-19. Reynolds, a Republican, has signed a bill into law that prohibits school officials from requiring masks, raising concerns as delta variant virus cases climb across the state and schools resume classes soon. (AP Photo/Charlie Neibergall)
Education Hurricane Ida Deals New Blow to Louisiana Schools Struggling to Reopen
The opening of the school year offered teachers a chance to fully assess the pandemic's effects, only to have students forced out again.
8 min read
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021. Louisiana students, who were back in class after a year and a half of COVID-19 disruptions kept many of them at home, are now missing school again after Hurricane Ida. A quarter-million public school students statewide have no school to report to, though top educators are promising a return is, at most, weeks away, not months.
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021.
John Locher/AP