International

U.S. Students Score Above Average on New Problem-Solving Test

By Holly Kurtz — April 15, 2014 5 min read
  • Save to favorites
  • Print

U.S. 15-year-olds scored above average on a first-of-its-kind international assessment that measured creative problem-solving skills.

However, their mean scores were significantly lower than those earned in 10 of the 44 countries and economies that took the Program for International Student Assessment, or PISA, 2012 problem-solving test.

The assessment, which was the subject of an Organization for Economic Cooperation and Development report released on April 1, defined creative problem solving as the ability to “understand and resolve problem situations where a method of solution is not immediately obvious.”

Worldwide, a representative sample of 85,000 15-year-olds took the computer-based exam, including 1,273 U.S. students in 162 schools.

The Paris-based OECD introduced the exam based on the belief that today’s high school students will enter an economy in which on-the-job problem solving has gotten progressively more complex because computers have replaced many of the human employees whose jobs once consisted of completing simple tasks.

Top 25 Performers

U.S. students performed just above the international average on the new Program for International Student Assessment problem-solving test.

BRIC ARCHIVE

SOURCE: Organization for Economic Cooperation and Development

“In modern societies, all of life is problem solving,” states the report.

It is the fifth of six OECD reports on the 2012 assessment, which also tested mathematics, reading, and science, and collected information on students’ communities, lives, and schools. “Complex problem-solving skills are particularly in demand in fast-growing, highly skilled managerial, professional, and technical occupations,” the report says.

Range of Scores

With an average score of 508 points, U.S. students exceeded the 500-point average on the exam, in which countries’ mean scores ranged from a low of 399 (Columbia) to 562 (Singapore). This meant they performed on par with students in England, Estonia, France, Netherlands, Italy, the Czech Republic, Germany, Belgium, Austria, Norway, and Ireland.

Singapore, Korea, and Japan earned the highest scores. In those countries, about one in five students was able to solve the most complex problems, compared to the international average of one in nine.

Heinz-Dieter Meyer, an associate professor of governance, education, and policy at the State University of New York at Albany, said the scores raised questions for him because these nations are not necessarily known for creativity. “Educators may be surprised to see that the results of the new study again list ‘the usual suspects'—Singapore, Korea, and Japan—ahead of everyone else, even though we know from a wealth of sociological and anthropological studies that the cultures in these countries reward conformity above all,” he said.

Other countries that earned significantly higher scores than the United States were Macao, Hong Kong, Shanghai, Chinese Taipei, Canada, Australia, and Finland.

Content and Creativity

U.S. performance was especially strong on tasks designed to measure interactive problem solving, which requires students to find some of the information they need on their own. For example, one interactive task on the exam required students to explore the buttons of an MP3 player on their screen in order to correctly respond to questions about how to use the device.

By contrast, a “static task” provides all the information upfront. In one static task that appeared on the exam, students were given a list of rules regarding the seating preferences of guests invited to a birthday party and then asked to sit them around a table, according to these rules.

The ability to excel in interactive problem solving suggests that “students in the United States are open to novelty, tolerate doubt and uncertainty, and dare to use intuition to initiate a solution,” according to a report released with the results.

“We believe probably that has to do with the way mathematics or reading or science is taught in the United States, especially when you compare that with how it is taught in other countries,” said Pablo Zoido, an analyst with the OECD’s PISA office in Paris. “We think problem solving, or teaching through problem solving, is more developed in the United States than it is in other countries.”

U.S. students also performed better on problem solving than on mathematics, meaning that their problem-solving skills exceeded those of students in nations with similar performance in math. Even though they scored above average on problem solving, U.S. students scored slightly below average in mathematics in 2012.

However, U.S. students lagged behind those in the highest-performing nations when it came to tasks that required them to “select, organize, and integrate the information and feedback received in order to represent and formulate their understanding of the problem,” according to the OECD report.

In addition to presenting results for all students who took the test, the PISA report also broke out average scores for subgroups. In the United States, girls’ scores equaled those of boys even though, internationally, boys outscored girls by 7 points. Exceptions to that trend were Australia, Finland, and Norway, where girls outperformed boys.

However, as in other nations, more U.S. boys than girls earned extremely high scores on the exam. Across all participating countries, there were an average of three top-performing boys for every two top-performing girls.

Students with immigrant backgrounds scored significantly lower than non-immigrants in the United States, as they did in most of the other nations that participated in the exam. Finally, as in the rest of the world, the relationship between socioeconomic status and assessment results was weaker in problem solving than in mathematics.

Reopening Debate

Michael J. Feuer, the dean of the graduate school of education and human development and a professor of education at George Washington University in Washington, suspected that these latest PISA results could play a prominent role in discussions of how schools prepare students for the world of work.

“I anticipate that the results will reopen a longstanding and important debate about the general versus specific nature of ‘problem-solving skills,’ and about where (school, work, family) and when (at age 15, during the pre-K years, throughout the lifespan) those skills can and should be formed, especially in an era when skill demands are changing because of technology and other global economic realities,” he said. However, Mr. Feuer was also concerned that too much might be made of the results of a single test of a single age group.

“Although performance on this test, which is based on simulated problem situations, is perhaps mildly indicative of a more general and long-lasting set of relevant competencies, it would be a mistake to infer that knowledge and skills assessed at age 15 are somehow fixed or predictive of future performance or of ‘success in life,’ ” he continued. “There is abundant research showing that much learning takes place ‘on the job’ or experientially, and that performance on even high-quality simulation tasks on standardized assessments are weak predictors.”

Related Tags:

A version of this article appeared in the April 16, 2014 edition of Education Week as U.S. Students Score Above Average On New Problem-Solving Test

Events

Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Privacy & Security Webinar
Navigating Cybersecurity: Securing District Documents and Data
Learn how K-12 districts are addressing the challenges of maintaining a secure tech environment, managing documents and data, automating critical processes, and doing it all with limited resources.
Content provided by Softdocs

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

International What the Research Says It's Not Just U.S. Students. Civics Scores Have Dropped Around the World
Eighth graders are less engaged and knowledgeable about government than they were before the pandemic, a global study finds.
5 min read
vote ballot initiatives money 1371378601 01
LAUDISENO/iStock/Getty and EdWeek
International England Pushes for Cellphone Bans in Schools. Could the U.S. Be Next?
England is the latest country seeking to keep cellphones out of class.
3 min read
Tight crop photo of a student looking at their cellphone during class. The background is blurred, but shows students wearing uniforms.
E+
International Photos PHOTOS: Take a Round-the-World Tour of the Return to School
Here's what back to school looks like in classrooms around the globe.
1 min read
A teacher gives a lesson on the first day of school at a cadet lyceum in Kyiv, Ukraine on Sept. 4, 2023.
Young cadets sing the national anthem during a ceremony on the first day of school at a cadet lyceum in Kyiv, Ukraine, on Sept. 4, 2023.
Efrem Lukatsky/AP
International Opinion School Reform Is Tough All Over, Not Just in the U.S.
Even though some reforms produce evidence of student success, that often isn't enough to overcome political hurdles.
6 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty