Education

Testing

November 05, 2003 1 min read
  • Save to favorites
  • Print

Achievement Levels

The governing board that oversees the National Assessment of Educational Progress has awarded a $1.5 million contract to ACT Inc. of Iowa City to help set new achievement levels for the NAEP math test in grade 12.

The achievement levels describe what students should know and be able to do on NAEP tests and establish the scores needed to meet three standards: “basic,” “proficient,” and “advanced.”

If the National Assessment Governing Board approves ACT’s recommendations, the new standards will be used for the first time in 2004, when the NAEP 12th grade math test introduces substantial new content, including more advanced algebra and geometry. Math tests in grades 4 and 8 will change only slightly, and the present scale scores and achievement levels will be maintained.

Although the percent of students reaching each achievement level is the primary means of reporting NAEP results, the levels remain controversial. In 1998, a panel of experts convened by the National Research Council called the current method for setting the standards— known as the modified-Angoff method—"fundamentally flawed” and said the governing board should replace it.

The performance standards the board sets are often too rigorous and don’t reflect student achievement on other tests, the panel said.

ACT Inc. will explore using a different standards-setting procedure. Under the modified-Angoff method, panels of experts determine on an item-by-item basis how likely it is that a student at the basic, proficient, or advanced level would get the item correct. ACT experts will field-test a new procedure, referred to as “map mark,” which is a modification of the “bookmark” technique.

Under the bookmark method, panelists get a loose-leaf booklet of the test items, in order of difficulty from easiest to hardest. They study the items and what they’re measuring, and then put a bookmark in the notebook to indicate where they think the cutoff points should be for each level.

Jim Carlson, the governing board’s assistant director for psychometrics, said the contract calls for a field test of the new method, upon which the board will decide the procedure to actually use.

The new 18-month contract also requires consultation with teachers, subject-matter specialists, parents, and other members of the public.

Lynn Olson

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Webinar
The State of Assessment in K-12 Education
What is the impact of assessment on K-12 education? What does that mean for administrators, teachers and most importantly—students?
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Centering the Whole Child in School Improvement Planning and Redesign
Learn how leading with equity and empathy yield improved sense of belonging, attendance, and promotion rate to 10th grade.

Content provided by Panorama
Teaching Profession Webinar Examining the Evidence: Supports to Promote Teacher Well-Being
Rates of work dissatisfaction are on the rise among teachers. Grappling with an increased workload due to the pandemic and additional stressors have exacerbated feelings of burnout and demoralization. Given these challenges, what can the

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Briefly Stated: January 12, 2022
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education School Bus Driver Retires After 48 Years Behind Wheel
Charles City school bus driver Betty Flick sat behind the wheel for the final time last week, wrapping up a 48-year career for the district.
3 min read
Charles City school bus driver Betty Flick poses with one of her farewell signs. Flick has been driving for Charles City School District for 48 years.
Betty Flick quickly fell in love with the job and with the kids, which is what has had her stay in the district for this long.
Courtesy of Abby Koch/Globe Gazette
Education Briefly Stated: December 1, 2021
Here's a look at some recent Education Week articles you may have missed.
9 min read
Education Briefly Stated: November 17, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read