Assessment

Panel Recommends State-Level NAEP For 12th Graders

By Lynn Olson — March 10, 2004 6 min read

The nation’s primary barometer of student performance should expand dramatically to provide mandatory state results on the achievement of 12th graders and to measure their readiness for college, employment, and the military.

The report, “12th Grade Student Achievement in America: A New Vision for NAEP,” is available from the National Assessment Governing Board. (Requires Adobe’s Acrobat Reader.)

Those are the chief recommendations of a national commission formed last year to review the future of the 12th grade National Assessment of Educational Progress.

Often known as “the nation’s report card,” the congressionally financed program provides the country’s best measure of student achievement in grades 4, 8, and 12. But even though all states must take part in NAEP reading and math tests in grades 4 and 8 every two years, participation in the 12th grade test is voluntary. And, until now, it has produced results only at the national level.

“Twelfth grade NAEP has the potential to supply crucial information about student achievement that America needs and that is unavailable from any other source, but NAEP is not now fulfilling the potential,” argues the commission’s report, “12th Grade Student Achievement in America: A New Vision for NAEP.”

The 18-member commission—of precollegiate and higher education faculty members, policymakers, and representatives from business and the military—was scheduled to present its report to the board that oversees NAEP late last week. The National Assessment Governing Board, or NAGB, which established the commission, is not expected to vote on its recommendations until summer.

In some sense, the 12th grade assessment is even more important than those in earlier grades, said Michael T. Nettles, a co-chairman of the commission and a member of the governing board, “because it is the final signal that we get about elementary and secondary education and its quality.”

Still, the commission took its recommendations a step further, contending that the test should not only look back at what students have learned through grade 12, but also ahead to how ready they are for further learning and employment.

That could prove especially controversial, given a lack of consensus about what knowledge and skills make a student ready for college.

Making participation in the state NAEP mandatory for grade 12 in reading and mathematics also would require action by Congress, including significantly more money. The costs of the proposals have yet to be estimated.

‘Not a Simple Matter’

“Changing the 12th grade assessment is not a simple matter,” said Darvin M. Winick, the chairman of NAGB, noting that the report provides the “beginning point” for further consideration and discussion.

The commission recommended that state participation in 12th grade science and writing tests be voluntary, as it is now in grades 4 and 8, with results available by state. Tests in additional subjects, such as economics, also would remain voluntary and yield results solely at the national level.

In making its recommendations, the commission asserted that NAEP is in a unique position to provide nationally representative data about the performance of high school seniors.

States typically do not test 12th graders, its report points out. And, even if they did, state tests vary so much in content and administration that the results cannot be added up to provide a national picture of performance.

College-admissions tests, such as the ACT and the SAT, are taken by a self-selected group of teenagers bound for college and also do not produce nationally representative data. College-placement tests and policies also vary widely.

Yet growing concerns about high schools and about rates of college retention and remediation have generated a hunger for such data. And the creation of a nationwide measure of college readiness could prove timely.

“We’ve really never set a national performance standard for college readiness,” said Michael W. Kirst, a professor of education at Stanford University.

The 12th grade NAEP “has potential to span the boundary between secondary and postsecondary education,” he argued in a background paper prepared for the governing board. “Even NAGB discussing college- readiness issues would stimulate K-16 meetings that otherwise would have no venue or incentive to occur.”

But he and others acknowledged that redesigning the 12th grade NAEP to assess college readiness would mean a whole new orientation for the long-standing program, and one fraught with difficulties.

In particular, Mr. Kirst said, higher education institutions, leaders, and lobbyists would be wary of an expanded NAEP role, since they already fear the extension of K-12 accountability policies to colleges. “They fear any camel’s nose under the tent,” he said.

An analysis conducted for the governing board by the Washington-based Education Trust also found a wide divergence between what NAEP items now measure and what’s measured on college- placement exams, particularly in math.

While college-placement tests essentially measure students’ knowledge of algebra and functions, based on multiple-choice items, NAEP items span a much wider range of topics, the study found. And the formats—including short-answer and long-answer questions—are so different that the tests are “nearly incomparable.”

Although a revised mathematics framework for NAEP 2005 includes more algebraic content, the report notes, it was too soon to tell whether that would make a difference. The study found similar discrepancies in writing, but fewer in reading.

An analysis by the Iowa City-based ACT Inc. program also found disparities between the content of NAEP 12th grade exams and the ACT’s WorkKeys system, designed to measure workplace readiness.

Low Participation Rates

But an even greater dilemma may be how to increase student- participation rates and motivation to do well on such a senior-year exam.

“The biggest challenge, I believe, is how do we get 12th graders, seniors in high school, to help America know what they know? To give us a real effort, a real picture, of what they know and can do, and to take this seriously in the final weeks of their senior year,” said Mark Musick, the co- chairman of the commission and the president of the Southern Regional Education Board.

“All too often,” said the NAGB member, “lots of seniors don’t appear to take too much seriously.”

Taking part in the 12th grade NAEP test is voluntary for both high schools and students selected for the national sample. Between 1988 and 2000, about one-third of students selected for the 12th grade test did not participate. That figure jumped significantly in 2002, when almost half the students drawn for the sample did not take the tests.

Such low participation rates are a “significant threat to the validity” of the exam, the commission noted.

It recommended “bold and dramatically new incentives” to increase participation and encourage students to do well on the tests, which do not carry individual consequences for students. Such incentives might range from recognition on high school transcripts to college scholarships.

Charles E. Smith, the executive director for NAGB, said the report would now go through an “elaborate” review process.

The board plans to share the report with interested groups, hold a public hearing on its recommendations, and form ad hoc committees to address specific issues, such as the costs associated with the proposals.

“We feel like this is a major item,” Mr. Smith said. “It deserves more than the normal amount of attention.”

Related Tags:

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Culturally Relevant Pedagogy to Advance Educational Equity
Schools are welcoming students back into buildings for full-time in-person instruction in a few short weeks and now is the perfect time to take a hard look at both our practices and systems to build
Content provided by PowerMyLearning
Classroom Technology Webinar Making Big Technology Decisions: Advice for District Leaders, Principals, and Teachers
Educators at all levels make decisions that can have a huge impact on students. That’s especially true when it comes to the use of technology, which was activated like never before to help students learn
Professional Development Webinar Expand Digital Learning by Expanding Teacher Training
This discussion will examine how things have changed and offer guidance on smart, cost-effective ways to expand digital learning efforts and train teachers to maximize the use of new technologies for learning.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment How Can Teachers Better Understand Students? A New Breed of Assessment Will Try to Help
Researchers will work to create formative assessments that can give teachers a window into students’ emerging identities and strengths
4 min read
In this Nov. 19, 2020, file photo, sixth-grade students listen to instruction in class at Cape Cod Lighthouse Charter School in East Harwich, Mass.
Researchers hope to create new assessments to help teachers gain deeper insights into the identities and strengths of their students, like these 6th graders at Cape Cod Lighthouse Charter School in East Harwich, Mass.
Elise Amendola/AP
Assessment Opinion It's Time We Begin Using Assessments to Look Forward, Instead of Back
Schools do not get much value from high-stakes tests. Many are now allowing schools to use better assessments to guide student learning.
Seth Feldman
5 min read
shutterstock 19525837
Shutterstock
Assessment Opinion Grading Has Always Been an Imperfect Exercise. COVID-19 Made It Worse
It’s hard reducing the complexity of each student’s social, emotional, and academic learning to a letter grade. Maybe we’re doing it wrong.
Lory Walker Peroff
4 min read
A student's grades are unknown
Robert Neubecker for Education Week
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Facing the Future Together: Digital Innovative Solutions
Join us to discuss how digital innovative solutions can enrich the educational experience in the K-12 environment. We’ll share how these ...
Content provided by Pearson