Assessment

Mastery of Science Standards Long Way Off, NAEP Suggests

By Nora Fleming — July 16, 2012 | Corrected: February 21, 2019 6 min read
  • Save to favorites
  • Print

Corrected: An earlier version of this story inadvertently interchanged phrases, changing the meaning of a quote from Arthur Eisenkraft, the director of the Center of Science and Math in Context at the University of Massachusetts.

As state and education leaders work on finishing a set of voluntary national standards aimed at improving the quality of science education, today’s students have failed to demonstrate the deeper understanding of core science concepts those new standards prioritize.

The results from the first National Assessment of Educational Progress of both hands-on and interactive computer-based science tasks, administered in 2009 and recently released, found that students in 4th, 8th, and 12th grades performed poorly when asked to execute higher-level problem-solving and critical-thinking skills in real and simulated laboratory settings.

Additionally, results of the 2011 NAEP in science, released last month, found fewer than a third of 8th graders performing at “proficient” levels.

While those outcomes weren’t that surprising, there is still concern that the push to improve science education may be more challenging than simply encouraging states to adopt uniform national science standards that call for students to improve their in-depth knowledge of science concepts, understand how they connect, and master how they can be applied to the real world. Practical challenges to implementing such changes may be exacerbated by district budget cuts and pressure to plow through material and regularly assess students.

“The results are one of the strongest arguments we have for why the Next Generation Science Standards will be important to implement, state by state. Yet great standards won’t mean anything if great curriculum isn’t developed,” said Susan Singer, a professor of natural sciences at Carleton College, in Minnesota.

“We’ll never get at the nature of science if we don’t engage in effective lab learning, integrated into the flow of instruction,” Ms. Singer said.

Thinking Required

Both the recent hands-on and computer NAEP in science asked students to predict what might happen in a particular scenario, make observations about what occurred in the scenarios, and explain the findings of the experiments or investigations they launched. Those questions examined how well students could conduct and reason through “real life” science situations and grasp the scientific concepts of what occurred in their investigations, according to the report from the National Center for Education Statistics, the U.S. Department of Education division that administers NAEP.

“Increasingly, graduates are called on to do things in today’s world that require more than rote memory and how to follow instructions,” Alan J. Friedman, a member of the National Assessment Governing Board, which sets policy for NAEP, said during a conference call about the tests. “There was no way to memorize for this test and no amount of rote drill and practice that could prepare students for it; these tests test what students can do in more complex environments and the richness of what students can do with real stuff.”

About 2,000 students at each grade level were given each test and asked to complete two 40-minute hands-on tasks or three interactive computer tasks, 20 to 40 minutes in length. In an 8th grade interactive computer task, for example, students could have been asked to plan a new, simulated recreation area for a town using part of an existing wildlife area, evaluate the impact different locations for the space could have on wildlife, and determine which space would be best to build on.

On average, the students were able to accurately report what was happening in scenarios with limited data, but were challenged by manipulating multiple variables and making decisions as part of running an experiment, according to the findings. In addition, the numbers of students able to draw the right conclusions in experiments were much higher than the numbers able to provide explanations or justifications for their answers based on the findings.

Seventy-one percent of 4th graders could accurately select how volume changes when ice melts, for example, but only 15 percent could explain why that happened using evidence from the experiment.

Professional Development

The findings were fairly consistent across grade levels, other than 12th graders scoring some 15 percentage points lower than the younger students on the interactive computer tasks.

Timing of the results comes as a draft of the new national science standards, which are being developed by a cadre of 26 states and a team of writers led by Achieve, a Washington-based nonprofit group, are in circulation for public comment. Focused around scientific and engineering practices, cross-cutting concepts that span science disciplines, and core subject matter in science, engineering, and technology, the standards are expected to be final by early next year. They would require adopting states to invest in improving their science curricula, assessment, and teaching.

According to Gerry Wheeler, the executive director of the National Science Teachers Association, while the proposed standards are promising, lack of time, funding, materials, and teacher training present challenges, he said.

“Our science classrooms look like classrooms of 40 years ago,” Mr. Wheeler said. “The science teacher needs help bringing science into their children’s high-tech world.”

Part of such professional development should include how to incorporate hands-on, interactive learning and labs into classroom lessons, said Arthur Eisenkraft, a professor of science education and the director of the Center of Science and Math in Context at the University of Massachusetts Boston. Too often, labs are tacked on as a supplementary piece of instruction, rather than blended into learning, said Mr. Eisenkraft, who helped develop the NAEP framework.

As a result, students are too often focused on “what’s happening” and “what does it mean” types of questions rather than on “how do we know,” he said.

Others, however, maintain that there could be too much emphasis on hands-on and interactive science at the expense of improving students’ core knowledge.

“We have to make sure that any standards—whether national or not—include essential science content,” said Kathleen Porter-Magee, a senior director at the Washington-based Thomas B. Fordham Institute. “Process skills are important to science, but they must be thoughtfully paired with deep understanding of critical content.”

‘Fused Knowledge’

While the results of the recent hands-on and interactive computer tasks have some educators worried, others are less concerned.

Nancy Butler Songer, a professor of science education and learning technologies at the University of Michigan, in Ann Arbor, and alongtime researcher on improving science education, said she finds it promising that NAEP officials and national organizations like Achieve are continuing to recognize the need to change science education and build “fused knowledge,” or content knowledge plus science practices.

BRIC ARCHIVE

Those current efforts are part of the necessary “pieces coming together” to improve science education, she said, which include professional development to help teachers teach science better, curriculum and standards to guide teaching, and tests to measure how well students are understanding the concepts.

“We’ve maintained a misconception in what it meant to know science,” Ms. Songer said. “While it’s taken awhile to uproot this idea, what we know now is that you can’t get to a deeper level of understanding in science without working in science in a sophisticated way. You have to use models or gather and apply evidence from experiments to that concept in order to really know science. “

Related Tags:

Coverage of science, technology, engineering, and mathematics education is supported by a grant from the Noyce Foundation, at www.noycefdn.org.
A version of this article appeared in the July 18, 2012 edition of Education Week as NAEP Shows Science-Standards Mastery Long Way Off

Events

Jobs October 2021 Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Data Webinar
Using Integrated Analytics To Uncover Student Needs
Overwhelmed by data? Learn how an integrated approach to data analytics can help.

Content provided by Instructure
Professional Development Online Summit What's Next for Professional Development: An Overview for Principals
Join fellow educators and administrators in this discussion on professional development for principals and administrators.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment State Test Results Are In. Are They Useless?
While states, districts, and schools pore over data from spring 2021 tests, experts urge caution over how to interpret and use the results.
9 min read
FILE - In this Jan. 17, 2016 file photo, a sign is seen at the entrance to a hall for a college test preparation class in Bethesda, Md. The $380 million test coaching industry is facing competition from free or low-cost alternatives in what their founders hope will make the process of applying to college more equitable. Such innovations are also raising questions about the relevance and the fairness of relying on standardized tests in admissions process.
A sign is posted at the entrance to a hall for a test-preparation class. Assessment experts say educators should use data from spring 2021 tests with caution.
Alex Brandon/AP
Assessment Data Young Adolescents' Scores Trended to Historic Lows on National Tests. And That's Before COVID Hit
The past decade saw unprecedented declines in the National Assessment of Educational Progress's longitudinal study.
3 min read
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Assessment Whitepaper
Proven Techniques for Assessing Students with Technology
Dr. Doug Fisher’s proven assessment techniques help your students become active learners and increase their chances for higher learning g...
Content provided by Achieve3000
Assessment Long a Testing Bastion, Florida Plans to End 'Outdated' Year-End Exams
Florida Gov. Ron DeSantis said the state will shift to "progress monitoring" starting in the 2022-23 school year.
5 min read
Florida Governor Ron DeSantis speaks at the opening of a monoclonal antibody site in Pembroke Pines, Fla., on Aug. 18, 2021.
Florida Gov. Ron DeSantis said he believes a new testing regimen is needed to replace the Florida Standards Assessment, which has been given since 2015.
Marta Lavandier/AP