Artificial Intelligence

If ChatGPT Can Write Virtually Anything, What Should a National Writing Exam Test?

By Libby Stanford — November 17, 2023 6 min read
Image of a person using a computer, with glasses, papers, and pencil on the desk too.
  • Save to favorites
  • Print

For good or ill, people use ChatGPT now to write virtually any type of communication, from award acceptance speeches to business emails to book reports.

Now the rapid ascendance of artificial intelligence is raising fundamental questions about what future students should be taught about writing—and, by extension, how their writing skills should be measured.

The panel that oversees the National Assessment of Educational Progress voted at its quarterly meeting this week to postpone the next scheduled writing exam by two to three years so the board can have more time to develop the exam framework with a better sense of how the rapidly developing AI technology might shape writing instruction.

See Also

Photo collage of computer with pixelated image of girl.
F. Sheehan for Education Week / Getty

Pending congressional approval of a waiver to test students on non-election years to avoid politicizing NAEP, that means the exam will be pushed back from 2030 to either 2032 or 2033.

The NAEP writing exam was last given in 2017, when students used tablets to complete it. The writing exam has previously tested students in grades 4, 8, and 12.

The decision by the National Assessment Governing Board on the writing exam was included in the board’s overall approval of a new NAEP schedule, which will expand 12th grade reading and math, 8th grade U.S. civics and history, and 8th grade science exams to include state-level results starting in 2028. (Currently, NAEP releases only national results for those exams.)

The board also used the meeting to approve a new science framework that lays out the content and skills to be tested on the NAEP science exam and further discuss the future of AI and NAEP.

The federally administered NAEP is the primary exam used to track U.S. students’ progress over time and compare performance state to state.

Educators and schools go from AI wariness to slow acceptance

While some educators were initially wary of AI and its potential impact on schooling,—New York City public schools, for example, even banned the tool briefly before reversing course—experts have made it clear that AI is here to stay, and students need to learn how to use the technology to be effective and successful workers.

But exactly how AI should be used in writing instruction remains unclear. The technology is rapidly changing, and so are opinions about its value. For NAGB, the governing body that makes decisions about NAEP assessments years in advance, that’s a difficult landscape to navigate.

“We heard clear guidance from the field that AI will have implications for the teaching and the assessment of writing,” Martin West, one of the panel’s members and a Massachusetts state board of education member, said in an interview. “We did not hear a consensus on exactly what those changes would look like. That’s understandable given the pace of change in the technology and what it’s capable of doing. So, this didn’t seem like the right time to undertake a framework revision that we would want to stand the test of time.”

AI also has the potential to change the way the public accesses and uses NAEP data. The National Center for Education Statistics, the division of the federal Education Department that administers NAEP and compiles and analyzes its results, is looking to partner with an AI chatbot service that will allow people to ask specific questions about data, Ebony Walton, an NCES statistician, said at the meeting.

For example, a person could type into a chatbot, “please show me the results relating absenteeism to performance in NAEP reading grade 4,” and it would provide that breakdown. The chatbot will only include information that has been released to the public, Walton said.

See Also

Image of a plan with a goal, with a digital texture.
Collage via iStock/Gettty

New schedule means more information for states

The board also approved concrete changes to the NAEP schedule.

Starting in 2028, NAEP will begin state-level assessments of 12th grade students every four years in reading and math. Congress requires the administration of NAEP at the national and state levels in reading and math every two years for 4th and 8th graders and at the national level and every four years for 12th graders. NAEP is also administered on the state level and for a handful of urban districts for 4th and 8th grade students.

The change means a wider selection of 12th-grade students will take the NAEP reading and math tests to give an accurate representation of the demographics in participating states, as states won’t be required to participate.

Currently, states have limited tools to understand achievement among high school seniors who are just completing their K-12 career. The ACT, SAT, and AP exams, for example, don’t test a full sample of students. With the new schedule, which will start testing 12th graders on the state level every four years in 2028 or 2029, depending on the approval of the congressional waiver, states will have a more robust understanding of what students know as they exit the K-12 system.

“Yes, [the AP exam] gives a snapshot of what my kids can do, but that’s not the entire senior class of my high school,” said Patrick Kelly, one of the governing board’s members and a South Carolina teacher who teaches AP U.S. government and history courses. “As much as I wish my class was a direct reflection of the total student population at my high school, it’s not.”

But while the board members agreed state-level results will be beneficial, some also shared concerns about getting buy-in from states. Seniors in high school may not be as motivated to try on the exams and school districts are wary of adding another test to the already packed assessment schedule high school seniors face, according to feedback NAGB received from school district and state leaders.

NAEP has provided state-level results for 12th graders twice before—in 2009, when 11 states participated, and 2013, when 13 states participated. At their meeting Friday, the board members charged NAGB staff with finding ways to generate interest and support for the 12th-grade exam from state officials.

See Also

Image of a clock, calendar, and a pencil.
Tatomm/iStock/Getty
Assessment NAEP Results Are Often Politicized. Could Rescheduling It Help?
Evie Blad, May 22, 2023
3 min read

New science framework focuses on sensemaking, not memorization

The board also approved an updated science framework. The new science framework aims to better reflect research-backed science instruction with an emphasis on “the three dimensions of science”: disciplinary concepts, such as physical science, life sciences, and earth and space sciences; science and engineering practices; and crosscutting concepts, or the concepts that are used across science disciplines and provide tools to better understand new phenomena.

Those generally reflect the Next Generation Science Standards, a shared set of science goals about 20 states have adopted.

NAEP has outlined specific crosscutting concepts or themes that students should learn, including patterns; cause and effect; scale, proportion, and quantity; systems and system models; conservation, flows, and cycles, otherwise known as tracking energy and matter; relationships between structure and function; and the conditions for stability and change in systems.

The new framework also adds engineering and technology concepts to better reflect modern science education. And it has a specific focus on sense-making—the process of having students build an understanding of concepts by applying them to real-world scenarios.

“It really is going to allow us to assess what can students do with information, not just what do students know,” Kelly said.

Events

Early Childhood K-12 Essentials Forum Early Childhood Education: Building Essential Skills for Success
Join this free virtual event to examine the biggest challenges in supporting young children, from preschool through elementary school. 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Absenteeism Webinar
Attendance Isn't an Attendance Problem
Boost attendance by strengthening relationships, belonging, and support with practical strategies from Doug Fisher & Nancy Frey.
Content provided by Corwin
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
The Principal's Role in Collective Efficacy and Student Outcomes
Learn practical strategies that help principals translate their confidence into stronger collective teacher efficacy and student outcomes.
Content provided by Otus

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Artificial Intelligence Opinion How Teachers Are Experimenting With AI
From supporting students to saving time on tasks, educators share their thoughts on the tool.
1 min read
Collage with a photo of a young boy using a laptop with the assistance of a teacher, a motherboard, a keyboard with a child's hands typing on it and torn pieces of paper with handwriting and numbers on them.
Illustration by Emily Wright for Education Week + Getty
Artificial Intelligence Opinion Howard Gardner: How AI Will Force Us to 'Rethink' Education
The question isn’t whether to use AI but how, explains the father of multiple intelligences.
6 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
Artificial Intelligence Data Literacy Skills Seen as Key for Success in the Age of AI
Educators and parents see benefits if students learn more data literacy skills, survey shows.
3 min read
HONOLULU, HI - OCTOBER 28, 2025: Seventh grade students work in a Coding and AI Data Sciences class. Kulia Academy, a public charter middle school, specializes in teaching students to the use of AI, artificial intelligence, and data science, on October 28, 2025 in Honolulu, Hawaii. There are 150 students in 6th and 7th grades.
Seventh-grade students work in a coding and AI data sciences class at Kulia Academy on Oct. 28, 2025. The public charter middle school in Honolulu, Hawaii, specializes in teaching students how to use data science and artificial intelligence to learn. Educators and parents see benefits if students learn more about data science and artificial intelligence, according to a new survey.
Photo by Melanie Stetson Freeman/The Christian Science Monitor via AP
Artificial Intelligence Students Created a National AI Policy Framework. Here’s What It Includes
Nearly 100 students from across the country collaborated to set guardrails around AI use in schools.
8 min read
A group of 98 high school students representing all 50 states who spent three days in Boston creating, debating, and voting on a framework for what they believe AI use in schools should look like.“America’s Youth AI Festival,” took place July 17-19 and was hosted by nonprofit Day of AI; MIT RAISE; AASA, The School Superintendents Association; and the Edward M. Kennedy Institute for the U.S. Senate.
A group of 98 high school students representing all 50 states spent three days in Boston July 17-19 creating, debating, and voting on a framework for what they believe AI use in schools should look like. Some experts say educators should get students more involved in helping craft AI policies for schools.
Eric Haynes/Edward M. Kennedy Institute