Assessment

Ed. Dept. Shows Relationship Between NAEP, TIMSS

By Millicent Lawton — May 13, 1998 3 min read
  • Save to favorites
  • Print

For the first time, 40 states and the District of Columbia can see how their 8th graders stack up in math and science against students in 41 nations worldwide.

With state policymakers, business leaders, and others looking for ways to benchmark students’ academic progress in an international context, a research study released last week by the U.S. Department of Education is a “very powerful tool,” said Gary W. Phillips, an associate commissioner in the department’s National Center for Education Statistics.

For More Information:
The report linking TIMSS with NAEP can be found on the World Wide Web at www.nces.ed.gov.

As states try to decipher how good is good enough for students’ performance in core subjects, it can be useful to look at how other countries, or economic competitors, do, state and federal officials said.

The report presents data on how the 40 states whose students took the National Assessment of Educational Progress in 1996 would have done had they participated in the Third International Mathematics and Science Study, which 41 countries took in 1995. Minnesota, Missouri, and Oregon students actually took the international exam.

For each of the states, the District of Columbia, Guam, and Department of Defense schools, the report lists those countries that would have been expected to perform higher, not significantly different, and lower than that state or jurisdiction had it taken TIMSS. For example, it tries to answer the question of where Arizona falls in relation to Canada. The study also details what percentage of students in the state would have performed in the upper half of students and in the top 10 percent of students taking TIMSS.

Minnesota, with actual results, and Alaska virtually tied for the largest proportions of students falling into those categories for math performance in the 8th grade. In science, Minnesota’s actual results showed that about 20 percent of its students would have scored in the top 10 percent of takers of TIMSS--the largest proportion among the states.

No 4th Grade Link

To make the link between the two tests, statisticians used a mathematical formula to translate performance on one test into performance on the other--much the same way that the conversion is made between tem-peratures expressed in degrees Fahrenheit and degrees Celsius.

It helped greatly, officials said, to be able to check the link by looking at the actual results of Minnesota, which took TIMSS in 1995, and Missouri and Oregon, which took a special administration of the international exams last year.

The National Center for Education Statistics did not explicitly rank states by their international performance. “We don’t want to set up that horse race because we feel there’s too much error in the data,” Mr. Phillips said. But “we think this methodology is sufficiently robust to be able to do these comparisons” of how states would have done on TIMSS.

Mr. Phillips emphasized that the way the Education Department did the linking was just one way of doing it and that the extrapolation of NAEP to TIMSS scores represented a cutting-edge methodology.

At the same time, the statistics center has been unsuccessful in linking states’ performance on the 4th grade NAEP with the performance of 4th graders taking TIMSS. Researchers have yet to figure out why.

The ability to connect performance on a national exam such as NAEP to the international ones holds significance for the future success of the Clinton administration’s proposed voluntary national tests in 4th grade reading and 8th grade math. A major selling point of the national tests has been that individual students taking them would be able to know how they would have fared had they taken TIMSS. But the tests have powerful opponents in Congress and face a dubious future.

Oregon to Singapore

The international comparison provides a useful frame of reference for Oregon, said Stephen Slater, an assessment specialist for the state education department there. “Economically, Oregon is not just competing with Texas and Massachusetts and California,” he said. “We are competing globally, and so Singapore is just as valid a comparison group as the state of Washington.”

A version of this article appeared in the May 13, 1998 edition of Education Week as Ed. Dept. Shows Relationship Between NAEP, TIMSS

Events

Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Privacy & Security Webinar
Navigating Cybersecurity: Securing District Documents and Data
Learn how K-12 districts are addressing the challenges of maintaining a secure tech environment, managing documents and data, automating critical processes, and doing it all with limited resources.
Content provided by Softdocs

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment The 5 Burning Questions for Districts on Grading Reforms
As districts rethink grading policies, they consider the purpose of grades and how to make them more reliable measures of learning.
5 min read
Grading reform lead art
Illustration by Laura Baker/Education Week with E+ and iStock/Getty
Assessment As They Revamp Grading, Districts Try to Improve Consistency, Prevent Inflation
Districts have embraced bold changes to make grading systems more consistent, but some say they've inflated grades and sent mixed signals.
10 min read
Close crop of a teacher's hands grading a stack of papers with a red marker.
E+
Assessment Opinion What's the Best Way to Grade Students? Teachers Weigh In
There are many ways to make grading a better, more productive experience for students. Here are a few.
14 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty
Assessment Spotlight Spotlight on Assessment
This Spotlight will help you evaluate effective ways to offer students feedback, learn how to improve assessments for ELs, and more.