Education

Testing

November 05, 2003 1 min read
  • Save to favorites
  • Print

Achievement Levels

The governing board that oversees the National Assessment of Educational Progress has awarded a $1.5 million contract to ACT Inc. of Iowa City to help set new achievement levels for the NAEP math test in grade 12.

The achievement levels describe what students should know and be able to do on NAEP tests and establish the scores needed to meet three standards: “basic,” “proficient,” and “advanced.”

If the National Assessment Governing Board approves ACT’s recommendations, the new standards will be used for the first time in 2004, when the NAEP 12th grade math test introduces substantial new content, including more advanced algebra and geometry. Math tests in grades 4 and 8 will change only slightly, and the present scale scores and achievement levels will be maintained.

Although the percent of students reaching each achievement level is the primary means of reporting NAEP results, the levels remain controversial. In 1998, a panel of experts convened by the National Research Council called the current method for setting the standards— known as the modified-Angoff method—"fundamentally flawed” and said the governing board should replace it.

The performance standards the board sets are often too rigorous and don’t reflect student achievement on other tests, the panel said.

ACT Inc. will explore using a different standards-setting procedure. Under the modified-Angoff method, panels of experts determine on an item-by-item basis how likely it is that a student at the basic, proficient, or advanced level would get the item correct. ACT experts will field-test a new procedure, referred to as “map mark,” which is a modification of the “bookmark” technique.

Under the bookmark method, panelists get a loose-leaf booklet of the test items, in order of difficulty from easiest to hardest. They study the items and what they’re measuring, and then put a bookmark in the notebook to indicate where they think the cutoff points should be for each level.

Jim Carlson, the governing board’s assistant director for psychometrics, said the contract calls for a field test of the new method, upon which the board will decide the procedure to actually use.

The new 18-month contract also requires consultation with teachers, subject-matter specialists, parents, and other members of the public.

Lynn Olson

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Critical Ways Leaders Can Build a Culture of Belonging and Achievement
Explore innovative practices for using technology to build an environment of belonging and achievement for all staff and students.
Content provided by DreamBox Learning
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Professional Development Webinar
Strategies for Improving Student Outcomes with Teacher-Student Relationships
Explore strategies for strengthening teacher-student relationships and hear how districts are putting these methods into practice to support positive student outcomes.
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Classroom Technology Webinar
Transform Teaching and Learning with AI
Increase productivity and support innovative teaching with AI in the classroom.
Content provided by Promethean

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: September 21, 2022
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Briefly Stated: September 7, 2022
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Briefly Stated: August 31, 2022
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Briefly Stated: August 24, 2022
Here's a look at some recent Education Week articles you may have missed.
8 min read