Opinion
Federal Commentary

Not Ready for Science Tests

By Junlei Li — April 25, 2006 6 min read

—Bob Soule´

33li

In his January State of the Union Address, President Bush put math and science at the forefront of America’s education agenda. This coincides with the federal No Child Left Behind Act’s requirement that every state begin testing children in science, starting with the 2007-08 school year. Even without that federal mandate, the inclusion of science in the test-and-accountability system would be inevitable.

For decades, civic, business, and scientific leaders across party lines have decried the science education crisis, blaming it for weakening our national security and spurring the loss of American jobs to overseas competitors (most recently, China and India). Three pragmatic questions are left unanswered in the knee-jerk responses to this perceived crisis: What science are we teaching, how should we test it, and when is science education ever good enough?

The science we are supposed to teach is codified in the lengthy documents that make up each state’s science standards. However, in late 2005, the Thomas B. Fordham Institute issued its “State of State Science Standards” report, giving nearly two-thirds of the states a grade of C or below for their science standards. The main criticisms included unusable documents, unrealistic coverage, unscientific content, and confusing teaching recommendations. One need not agree with this particular report. But no studies of states’ science standards, regardless of the reviewers’ perspectives, have ever given a majority of the states A grades. Shouldn’t the standards themselves be held accountable before we attempt to develop accountability systems based on them?

Before we declare two-thirds of our children to be failing in science, maybe we should establish a realistic baseline by administering NAEP test items to today’s educated and productive adults.

Even assuming that states make serious efforts to fix science standards before 2007, we still have to design valid science tests to go with the standards. There are many technical issues at play in test design, but one challenge is more obvious and critical than all others: how to create a science test that is not, in essence, a reading exam with a new name. Unlike mathematics, which has its own universal language of symbols and numbers, most science subjects rely heavily on verbose descriptions and specialized vocabulary. To address this issue, psychologists who study children’s scientific reasoning, like myself, have made accommodations—by reading instructions aloud to children, giving them objects to manipulate, and asking them to explain their answers verbally or pictorially.

These techniques are not new, but they are much too expensive to administer to every child in every state. Without them, however, the high proportions of schools and students that have already failed on reading tests have little chance of succeeding on science tests. Why waste money testing science if the test merely reaffirms failing scores in reading?

The urgency for science tests is bolstered by the National Assessment of Educational Progress, often called “the nation’s report card.” NAEP science tests have consistently concluded that fewer than one-third of our 4th, 8th, and 12th graders were “proficient” in science. Yet before we readily accept and lament our science-achievement woes, we need to ask what proficiency is. Should 8th graders know some, or all, of the periodic table? Some, or all, of the planets in the solar system? Some, or all, of the kingdoms, phyla, classes, and orders of the classification system? The “mile-wide, inch-deep” curriculum in K-12 education has been decried for decades, yet every subset of scientists remains adamant that its topic be included in a nontrivial way in the curriculum, thereby creating a “mile-wide and mile-deep” science expectation. More science content seems like better science for the committees of business leaders, professional scientists, and science educators—those who set the standards and the test-proficiency bars.

This is folly. In science, as in many other areas of education, we must distinguish between what we want and what we need. I may want a supersize, all-terrain SUV, but I only need a compact car to take my daughter to preschool and myself to work. Likewise, the “Hummer” science curriculum we want for K-12 education includes much more content knowledge than most educated and productive Americans can recall. The 1996 NAEP, for example, asked 8th graders to identify the two most common elements in Earth’s crust. I gave that same question to a nonrandom sample of science and engineering majors at Carnegie Mellon University (one of the world’s best science and engineering universities), and they did not know the answer. Before we declare two-thirds of our children to be failing in science, maybe we should establish a realistic baseline by administering NAEP test items to today’s educated and productive adults.

For our country as a whole, and a citizenry consisting mainly of people who are not professional scientists, we need to balance our appetite for more science with other competing education priorities. We can set a more realistic expectation by examining our science achievement in an international context, through studies like the Trends in International Mathematics and Science Study, or TIMSS. As with the NAEP tests, TIMSS results are often interpreted as alarming and dismal evidence of our inadequate science education, particularly when compared against Asian competitors’ like Japan and South Korea. We neglect to consider that the average scores of our white students were at par with the averages of the homogeneous Asian countries, and that American students attending relatively affluent schools (with fewer than a quarter of students eligible for free or reduced-price lunches) outperformed Japanese students attending comparable schools there. Based on TIMSS results, the science gaps between races and economic classes within America are three times the gap between U.S. and Japanese students.

For our country as a whole we need to balance our appetite for more science with other competing education priorities.

If we truly want knowledge of science for all Americans, we should be worrying more about closing the scoring gaps within America than the one overseas. If our domestic science gaps closed today, our science scores would easily surge ahead of our Asian competitors’. Treating science education as a nationwide pandemic misplaces our priorities and resources, by both failing to recognize the world-class science education we are already providing and shifting the focus away from the urgent need to better serve minority children and children of all races attending less-affluent schools.

Science testing can be a part of the right solution to improve our nation’s science education, but it is being rushed into our schools in an indiscriminate fashion and on a timeline detached from the realities in America’s education system. There are unexamined but critical gaps in research, practice, and public debate about what the goals, tests, and success criteria should be for our children’s science education. There is a tendency to treat all science-test news as bad news, without recognizing our successes to better focus on our remaining challenges.

Under these conditions, haste in science testing makes waste. Holding off the nationwide science tests for just a year or two could redirect a tremendous amount of federal, state, and local resources to the task of seeking the right solutions for the right students at the right time.

Events

Student Well-Being Webinar Boosting Teacher and Student Motivation During the Pandemic: What It Takes
Join Alyson Klein and her expert guests for practical tips and discussion on how to keep students and teachers motivated as the pandemic drags on.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
A Holistic Approach to Social-Emotional Learning
Register to learn about the components and benefits of holistically implemented SEL.
Content provided by Committee for Children
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
How Principals Can Support Student Well-Being During COVID
Join this webinar for tips on how to support and prioritize student health and well-being during COVID.
Content provided by Unruly Studios

EdWeek Top School Jobs

Interdisciplinary STEAM Specialist
Smyrna, Georgia
St. Benedict's Episcopal School
Interdisciplinary STEAM Specialist
Smyrna, Georgia
St. Benedict's Episcopal School
Arizona School Data Analyst - (AZVA)
Arizona, United States
K12 Inc.
Software Engineer
Portland, OR, US
Northwest Evaluation Association

Read Next

Federal Biden Legal Team Steps Back From Trump Stance on Transgender Female Sports Participation
The Education Department's office for civil rights pulls a letter that said Connecticut's transgender-inclusive policy violates Title IX.
4 min read
Bloomfield High School transgender athlete Terry Miller, second from left, wins the final of the 55-meter dash over transgender athlete Andraya Yearwood, far left, and other runners in the Connecticut girls Class S indoor track meet at Hillhouse High School in New Haven, Conn on Feb. 7, 2019. Transgender athletes are getting an ally in the White House next week as they seek to participate as their identified gender in high school and college sports. Attorneys on both sides say they expect President-elect Joe Biden’s Department of Education will switch sides in legal battles that could go a long way in determining whether transgender athletes are treated by the sex on their birth certificates or by how they identify.
Bloomfield High School transgender athlete Terry Miller, second from left, wins over transgender athlete Andraya Yearwood, far left, and other runners in an event in New Haven, Conn. The two transgender athletes are at the center of a legal fight in Connecticut over the participation of transgender female athletes in girls' or women's sports.
Pat Eaton-Robb/AP
Federal Congress Again Tries to Pass Eagles Act, Focused on School Shootings After Parkland
A group of bipartisan Congressional lawmakers is once again trying to get a law passed aimed at preventing school violence.
Devoun Cetoute & Carli Teproff
2 min read
Suzanne Devine Clark, an art teacher at Deerfield Beach Elementary School, places painted stones at a memorial outside Marjory Stoneman Douglas High School on Feb. 14, 2019 during the first anniversary of the school shooting in Parkland, Fla.
Suzanne Devine Clark, an art teacher at Deerfield Beach Elementary School, places painted stones at a memorial outside Marjory Stoneman Douglas High School on Feb. 14, 2019 during the first anniversary of the school shooting in Parkland, Fla.
Wilfredo Lee/AP
Federal Some Districts Extend Paid Leave Policies as They Hope for Passage of Biden Relief Plan
With federal provisions having expired, some school employees have had to dip into their own banks of leave for COVID-19 purposes.
5 min read
Linda Davila-Macal, a seventh grade reading teacher at BL Garza Middle School in Edinburg, Texas, works from her virtual classroom at her home on Aug. 31, 2020.
A teacher leads a virtual classroom from her home.
Delcia Lopez/The Monitor via AP
Federal President Biden Is Walking a 'Careful Tightrope' When It Comes to School Reopenings
CDC guidance and confusion over his rhetoric turn up the pressure, and could overshadow progress in schools and nuanced public opinion.
9 min read
President Joe Biden answers questions during a televised town hall event at Pabst Theater in Milwaukee on Feb. 16, 2021.
President Joe Biden answers questions during a televised town hall event in Milwaukee earlier this month.
Evan Vucci/AP