November 05, 2003 1 min read
  • Save to favorites
  • Print

Achievement Levels

The governing board that oversees the National Assessment of Educational Progress has awarded a $1.5 million contract to ACT Inc. of Iowa City to help set new achievement levels for the NAEP math test in grade 12.

The achievement levels describe what students should know and be able to do on NAEP tests and establish the scores needed to meet three standards: “basic,” “proficient,” and “advanced.”

If the National Assessment Governing Board approves ACT’s recommendations, the new standards will be used for the first time in 2004, when the NAEP 12th grade math test introduces substantial new content, including more advanced algebra and geometry. Math tests in grades 4 and 8 will change only slightly, and the present scale scores and achievement levels will be maintained.

Although the percent of students reaching each achievement level is the primary means of reporting NAEP results, the levels remain controversial. In 1998, a panel of experts convened by the National Research Council called the current method for setting the standards— known as the modified-Angoff method—"fundamentally flawed” and said the governing board should replace it.

The performance standards the board sets are often too rigorous and don’t reflect student achievement on other tests, the panel said.

ACT Inc. will explore using a different standards-setting procedure. Under the modified-Angoff method, panels of experts determine on an item-by-item basis how likely it is that a student at the basic, proficient, or advanced level would get the item correct. ACT experts will field-test a new procedure, referred to as “map mark,” which is a modification of the “bookmark” technique.

Under the bookmark method, panelists get a loose-leaf booklet of the test items, in order of difficulty from easiest to hardest. They study the items and what they’re measuring, and then put a bookmark in the notebook to indicate where they think the cutoff points should be for each level.

Jim Carlson, the governing board’s assistant director for psychometrics, said the contract calls for a field test of the new method, upon which the board will decide the procedure to actually use.

The new 18-month contract also requires consultation with teachers, subject-matter specialists, parents, and other members of the public.

Lynn Olson


Student Well-Being K-12 Essentials Forum Boosting Student and Staff Mental Health: What Schools Can Do
Join this free virtual event based on recent reporting on student and staff mental health challenges and how schools have responded.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Curriculum Webinar
Practical Methods for Integrating Computer Science into Core Curriculum
Dive into insights on integrating computer science into core curricula with expert tips and practical strategies to empower students at every grade level.
Content provided by

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: October 11, 2023
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated: September 27, 2023
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Briefly Stated: September 20, 2023
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education From Our Research Center What's on the Minds of Educators, in Charts
Politics, gender equity, and technology—how teachers and administrators say these issues are affecting the field.
1 min read
Stylized illustration of a pie chart
Traci Daberko for Education Week