Federal

NRC Weighs In on States’ Science Assessments

By Sean Cavanagh — July 12, 2005 5 min read
  • Save to favorites
  • Print

States that are designing science tests to satisfy the No Child Left Behind Act should set up broad “systems” of assessment, in which questions are aligned with standards and curriculum and new teachers are thoroughly trained in using the exams to improve student learning.

Those are some of the central recommendations of a report by the National Research Council that offers guidance to state officials on how to craft the science tests that the sweeping federal law will require in the 2007-08 school year.

Those tests are likely to have what the report calls a “powerful influence” over how the subject is taught in the coming years. Establishing entire systems of assessment—as opposed simply to drawing up tests to comply with the law—is crucial for states, in order to promote a broad, conceptual understanding of science and its processes, according to the study, released last month.

Further information on the report, “Systems for State Science Assessment,” is available from The National Academies Press.

A committee of testing experts and university researchers convened by the research council produced the report, “Systems for State Science Assessment.” The NRC, located in Washington, is a division of the congressional chartered National Academies, which provides research for the government, scientists, engineers, and the public.

The authors say the tests should be built around “organizing principles” or “big ideas” of science, such as evolution and molecular theory, to give students a stronger sense of how different aspects of the discipline connect.

Too often, science tests offer facts in isolation, focusing “on the item,” said Mark R. Wilson, one of the report’s editors.

“You really have to step back and focus on the information,” he said. “What purpose are you trying to serve by presenting the item on the test?”

Multiple Assessments

The report notes that states have several options for meeting the No Child Left Behind Act’s requirement for science assessments at least once in each grade span of 3-5, 6-9, 10-12, and measuring the progress of individual subgroups of students. States should consider using more than one test, with pieces of assessments written at the state and district levels, the report says.

Science Know-How

A panel of university and K-12 experts spells out the basic science skills that states should incorporate into the science tests to comply with the No Child Left Behind Act.

• Define concepts and describe how they relate to other areas of science.

• Design and conduct investigations.

• Pose questions about science that can be answered through investigations.

• Conduct measurements.

• Use data and graphs to organize and display information.

• Make predictions, using knowledge of scientific principles and relationships.

• Construct explanations, based on scientific evidence.

SOURCE: National Research Council

Science tests should include both multiple-choice questions and those asking for written responses, which the authors say are better able to gauge understanding of overall scientific concepts and processes.

“Any one test, task, or assessment situation is an imperfect measure of what students understand and can do,” the report says. “Including different types of measures in the system can … paint a richer picture of student achievement and can tap into the complexity of each science standard more fully.”

The difficulty of designing tests around those district and state partnerships makes it unlikely that states would try it, said Greg Hall, a committee member and Washington state’s assistant superintendent for assessment and research. Still, he said, many state officials may try to be creative in generating their assessments, in part because under the NCLB law, states do not have to use science-test results as a factor in determining whether schools face such penalties as giving students the option to transfer to other schools, as they do in reading and mathematics.

“You might be able to take some more risks in what you do,” Mr. Hall said. “You may see more innovative approaches.”

As of the 2004-05 academic year, 22 states had science tests in elementary, middle, and high school that were aligned to their state standards, according to an analysis by Education Week’s most recent Quality Counts report. (States are required to have content standards for science in place by the coming school year)

Better-Trained Teachers

Yet if state officials hope to use science tests to foster achievement in the subject, the research council’s report says, they will have to improve their performance in a critical area: teacher training. Not only do teacher colleges need to produce instructors with solid grounding in the subject matter—a long-standing concern of state and school officials—but they also need to provide teachers with more-specific training in how to use tests to improve their instruction, according to the NRC.

To that end, schools of education should include more courses on testing, and science testing in particular, in their curricula, the report urges. And states, which are responsible for setting licensing requirements for teachers, should make competence in student assessment mandatory, it says.

The goal is to have teachers who can use science tests to gauge “how well students are learning,” Mr. Wilson said, as well as to grade students’ work.

Arthur E. Wise, the president of the National Council for Accreditation of Teacher Education, commended the research council for pressing for improving the training of teachers in using science tests. But he noted that his Washington-based organization, which currently accredits more than 600 teacher colleges nationwide, has implemented new, stronger requirements for institutions to provide aspiring teachers with more expertise on how to administer and evaluate tests.

“We’re already there,” Mr. Wise said. He acknowledged, however, that NCATE’s effort is “a major new approach,” and that teacher colleges “are still figuring out new and more effective ways” to train teachers in testing.

The report also recommends that the federal government take a more active role in helping states devise strong standards and tests. Federal agencies can award grants for research aimed at producing models for states to follow, the authors say. They also suggest that the U.S. Department of Education require every state to have an independent body to evaluate the content of its science standards. Such evaluations should be made public, they add, and be included in the department’s review of NCLB compliance.

Federal Checkup

Lawrence S. Lerner, a retired professor at California State University-Long Beach, who has studied state science standards for years, found the idea of a stronger federal role in reviewing them appealing.

Since the passage of the 3½-year-old No Child Left Behind law, states have been drafting new science standards “very vigorously,” and they are longer and more detailed, he said. Yet the quality of the documents that Mr. Lerner said he had seen varied from “model standards, to really awful, to everything in between.” While he had not reviewed states’ science tests in as much depth, Mr. Lerner said he suspected he would find similar disparities in those exams.

Generally, states’ standards in science were strongest at the elementary level and gradually became weaker at the middle and high school levels, a weakness he attributed partly to lack of subject-matter expertise among some of the standards-setters. Demanding a more thorough review of standards and tests would benefit students, said Mr. Lerner, who did not serve on the NRC committee.

“The question is, to what extent would the states stand for that much federal involvement?” he said.

Events

School & District Management Webinar EdMarketer Quick Hit: What’s Trending among K-12 Leaders?
What issues are keeping K-12 leaders up at night? Join us for EdMarketer Quick Hit: What’s Trending among K-12 Leaders?
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
Teaching Students to Use Artificial Intelligence Ethically
Ready to embrace AI in your classroom? Join our master class to learn how to use AI as a tool for learning, not a replacement.
Content provided by Solution Tree
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Empowering Students Using Computational Thinking Skills
Empower your students with computational thinking. Learn how to integrate these skills into your teaching and boost student engagement.
Content provided by Project Lead The Way

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Opinion The Trump Administration Should 'Devolve the Ed Dept.'s Responsibilities to the States'
After six years helming the House ed. committee, U.S. Rep. Virginia Foxx cuts loose on high points and frustrations of her tenure.
8 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
Federal What's in the Lawsuit That Alleges Linda McMahon Failed to Protect Children
The lawsuit filed by former World Wrestling Entertainment workers alleges a culture of acceptance of sexual misconduct.
8 min read
Small Business Administration administrator Linda McMahon attends a cabinet meeting in the Cabinet Room of the White House on Aug. 16, 2018, in Washington.
Linda McMahon attends a meeting in the Cabinet Room of the White House on Aug. 16, 2018, in Washington. McMahon, then head of the U.S. Small Business Administration, is President-elect Donald Trump's choice to lead the Education Department in his new administration.
Andrew Harnik/AP
Federal How Trump Could Roll Back Access to Free School Lunches
Project 2025 and a GOP budget proposal call for axing a federal rule that allows public schools to serve free meals to all students.
5 min read
Cafeteria workers serve student lunches at Firebaugh High School in Lynwood, Calif. on Wednesday, April 3, 2024. Demand for school lunches has increased after California guaranteed free meals to all students regardless of their family's income.
Cafeteria workers serve lunches at Firebaugh High School in Lynwood, Calif., on Wednesday, April 3, 2024. Demand for school lunches has increased after California guaranteed free meals to all students regardless of their family's income. A federal school lunch provision that makes it easier for public schools to provide universal free meals may be a target for elimination in President-elect Donald Trump's upcoming term if some conservative activists and lawmakers get their way.
Richard Vogel/AP
Federal A Bill to Kill the Education Department Is Already Filed. Here's What It Says
The bill represents another attempt at a long-term Republican goal.
6 min read
People walk outside the U.S Capitol building in Washington, June 9, 2022.
People walk outside the U.S Capitol building in Washington, June 9, 2022. Legislation has been introduced in the Senate to abolish the Department of Education.
Patrick Semansky/AP