Assessment

Puerto Rico Still Awaits NAEP Math Results

By Sean Cavanagh — May 02, 2006 4 min read

Three years after students in Puerto Rico took their first crack at a specially designed version of the National Assessment of Educational Progress, their scores have yet to be made public, a delay that has frustrated some members of NAEP’s policy-setting board.

The test being given in the U.S. commonwealth also breaks new ground for NAEP. It is the first version of “the nation’s report card” written entirely in Spanish for students taught primarily in that language, which will allow those scores to be compared against students there and in the 50 states. But crafting the test in another language has brought a host of challenges.

NAEP was first given in Puerto Rico in 2003, then again in 2005. When officials at the National Center for Education Statistics, which administers the test, conducted an internal review of the 2003 results, they found that students had answered questions correctly only 25 percent of the time, on average, according to information released by federal officials in March. Students also skipped large numbers of items: As many as 80 percent of test-takers left some questions blank. Many of those problems occurred again in 2005.

Held to the Same Standards

The No Child Left Behind Act requires that Puerto Rico take part in NAEP to remain eligible for federal Title I funding targeted at public schools with large numbers of disadvantaged children. A sampling of students throughout the United States must take the assessment every two years in math and reading.

Puerto Rico at a Glance

As a U.S. commonwealth, Puerto Rico has the right to set policy for its schools and curricula, although it is also expected to comply with some federal policies, including the No Child Left Behind Act.

3.9 million residents

604,000 total public school students

1,538 public schools

28 percent of Puerto Rico’s school funding comes from federal sources—roughly three times the average amount of the 100 largest school districts in the United States.

$3,404 is spent on an average per-pupil basis ($6,606 in the largest U.S. school districts).

47 percent of households in Puerto Rico are considered to be living in poverty, a higher percentage than in any of the largest school districts in the 50 states.

96 percent of students in Puerto Rico attend Title I-eligible schools, compared with 51 percent of students in the largest school districts in the 50 states.

$466 million was the amount Puerto Rico received in Title I aid in fiscal 2005.

SOURCE: U.S. Department of Education

Because of the difficulty of translating a test of English-reading skills into Spanish, federal officials are requiring students in Puerto Rico to take part only in the math NAEP. In 2002, U.S. officials said the 2003 trial would be used solely to determine the feasibility of offering comparisons between students in Puerto Rico and in the 50 states.

Officials at the NCES, the primary statistics arm of the U.S. Department of Education, are confident the results from the 2003 and 2005 exams will be released by late this summer, said Peggy Carr, an associate commissioner of the NCES.

NCES officials, after reviewing the Puerto Rico test results from 2003 and 2005, have nearly resolved their doubts about how to interpret them, Ms. Carr said. “We’re not as concerned as we were before.”

Yet the delays have frustrated some members of the National Assessment Governing Board, including Luis A. Ramos, who questions if the scores from Puerto Rico’s students are being withheld simply because they are low.

“It is incumbent upon [us] that when we conduct the assessment, we report the results,” said Mr. Ramos, a native of the island, in an interview. “NAEP’s proven itself to be a great yardstick for students in the United States. … I want Puerto Rico to be held to the accountability standards of No Child Left Behind.”

Lost in Translation

The NCES crafted the original 2003 Puerto Rico test with help from a bilingual advisory committee, some of whose members had lived in the commonwealth. After reviewing the problems on the first test, those experts also sought help with the test translation from teachers working in Puerto Rican schools. In addition to making changes in the vocabulary and wording of some questions, officials gave students more time on the 2005 test than their counterparts in the 50 states. Yet the problems persisted.

John Stevens, another governing-board member who said he is disappointed that scores have not been released, said the board and the NCES need to know more about how motivated students in the commonwealth are to take the exam. “It’s a different place,” he said. “To what extent have we engaged people in Puerto Rico?” he said.

Translating tests in math can be as difficult as, if not more challenging than, in other academic subjects, said Guillermo Solano-Flores, a professor of education at the University of Colorado at Boulder. (“Math: the Not-So-Universal Language,” July 13, 2005.)

Sometimes, the problem is the arcane vocabulary of math, he said. In Spanish, test designers may seek to break up questions into different sentences, or repeat certain words, to make the translation clearer. But those changes can inadvertently make the question easier or harder, he said.

“That item loses its assessment value,” said Mr. Solano-Flores, who has studied math and science translations.

José A. Rivera, the NAEP coordinator for Puerto Rico’s education department, said he believes lack of alignment between the test and the curriculum could be a factor in students’ answering questions incorrectly or leaving them blank. Puerto Rican officials are undertaking a major effort to craft stronger curricula and standards in schools and link them with assessments. Approximately 2,800 4th and 8th graders at 105 schools in Puerto Rico took the 2005 NAEP.

Re-Evaluation Common

Officials elsewhere have struggled to motivate students to take the NAEP tests seriously, particularly at the high school level. But Mr. Rivera believes 4th and 8th graders in Puerto Rico want to do well on the exam.

“The Puerto Rico Department of Education and their students take NAEP seriously,” he wrote in an e-mail response to questions from Education Week. “This is not a factor in driving down scores.”

Two international tests, the Program for International Student Assessment, or PISA, and the Trends in International Mathematics and Science Study, or TIMSS, have translated exam questions across many languages, including Spanish and English.

Albert E. Beaton, who directed the 1995 TIMSS test worldwide, said it is not uncommon for test designers to re-evaluate results if scores from one population come in far below the norm, or if students skip many questions. The 1995 TIMSS test was translated into numerous languages.

The goal of large-scale tests like NAEP, Mr. Beaton said, is not simply to know that a student population is scoring above or below the norm, but how far above or below. “I would take the conservative approach,” he said about deciding when to release scores.

Related Tags:

A version of this article appeared in the May 03, 2006 edition of Education Week as Puerto Rico Still Awaits NAEP Math Results

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Building Equitable Systems: Moving Math From Gatekeeper to Opportunity Gateway
The importance of disrupting traditional American math practices and adopting high-quality math curriculum continues to be essential for changing the trajectory of historically under-resourced schools. Building systems around high-quality math curriculum also is necessary to
Content provided by Partnership for L.A. Schools
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Measuring & Supporting Student Well-Being: A Researcher and District Leader Roundtable
Students’ social-emotional well-being matters. The positive and negative emotions students feel are essential characteristics of their psychology, indicators of their well-being, and mediators of their success in school and life. Supportive relationships with peers, school
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Making Digital Literacy a Priority: An Administrator’s Perspective
Join us as we delve into the efforts of our panelists and their initiatives to make digital skills a “must have” for their district. We’ll discuss with district leadership how they have kept digital literacy
Content provided by Learning.com

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Opinion Alternatives to Standardized Tests During a Pandemic Year
Three educators suggest alternatives to federally mandated standardized testing during this year undercut by COVID-19.
7 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty
Assessment Opinion AP Exams Can't Be Business as Usual This Year
The College Board seems unconcerned with the collateral damage of its pandemic approach, writes an assistant superintendent of curriculum and instruction.
Pete Bavis
5 min read
Illustration of large boat in turbulent waters with other smaller boats falling into the abyss.
iStock/Getty Images Plus
Assessment Federal Lawmakers Urge Miguel Cardona to Let States Cancel Tests, Highlighting Discord
A letter from Democratic members to the new education secretary calls for an end to the "flawed" system of annual standardized exams.
3 min read
Jamaal Bowman speaks to reporters after voting at a polling station inside Yonkers Middle/High School in Yonkers, N.Y. on June 23, 2020.
Jamaal Bowman speaks to reporters after voting at a polling station inside Yonkers Middle/High School in Yonkers, N.Y. on June 23, 2020.
John Minchillo/AP
Assessment How Two Years of Pandemic Disruption Could Shake Up the Debate Over Standardized Testing
Moves to opt out of state tests and change how they're given threaten to reignite fights over high-stakes assessments.
9 min read
Image of a student at a desk.
patat/iStock/Getty