Opinion
Federal Opinion

Fixing the Flaw in the ‘Growth Model’

By David P. Sokola, Howard M. Weinberg, Robert J. Andrzejewski & Nancy A. Doorey — May 20, 2008 6 min read
  • Save to favorites
  • Print

Almost from the day the federal No Child Left Behind Act became law in 2002, educators, parents, and others have been calling for more flexibility in the way it allows states to assess student achievement. Over the years, that call has only grown louder: Eighty-two percent of Americans in last year’s Phi Delta Kappa/Gallup poll said that they wanted schools rated on the improvement students make during the year, rather than on the percentage who meet the state standard at the end of the year.

Policymakers have heeded the message—or at least part of it. In 2005, the U.S. Department of Education allowed up to 10 states to pilot assessment systems based on “growth models” that measure students’ progress toward standards, in contrast to the pass-fail assessments originally required by NCLB. Last December, U.S. Secretary of Education Margaret Spellings opened the growth-model pilot to all eligible states, greatly expanding access not only to a more equitable accountability system, but also to a richer stream of information that schools and educators can use to address the needs of their students.

But, please, let’s hold our applause—we’re not there yet. For while the expanded pilot lets more states develop their own growth models, it still requires those models to incorporate the traditional grade-level assessments. As long as this language is in place, the growth-model pilot will be laboring under a fundamental flaw: using an instrument designed to give static information about a relatively narrow slice of the achievement spectrum to measure a much broader range of movement over time.

Why not craft the reauthorized NCLB to foster innovation and improvement in the field of assessment, rather than to prevent it?

This makes about as much sense as using a snapshot to describe a marathon: It gives some information about who’s at or very near a given point, but says nothing about those who are behind or ahead of that benchmark. In contrast, a computer-assisted, fully adaptive assessment, currently prohibited under NCLB, draws on questions from multiple grade levels, dynamically adjusting them based on each student’s responses, to capture a student’s current position anywhere along the continuum, as well as that student’s distance from the grade-level proficiency marker.

Fortunately, correcting the flaw is relatively easy: Simply change the legislation’s language to permit states to use fully adaptive assessments in their growth-model pilots, if they so choose. U.S. Reps. Tom Petri, R-Wis., and David Wu, D-Ore., introduced such legislation in the House last fall. Now, we’re urging Sen. Edward M. Kennedy, D-Mass., to make the change a priority as he works with President Bush to reauthorize the No Child Left Behind Act.

For those who like the federal law as it is, this change would have minimal impact. States still could use their current grade-level assessments to measure student growth, or they could even forgo the option of growth models entirely. But for those who believe that NCLB is a work in progress, permitting the use of fully adaptive assessments would enable the law to realize its goal of increasing and determining the pace of student achievement.

First, this change would give schools credit for growth that grade-level tests can’t reliably detect. Most educators, for example, would give good marks to a school that moves a 5th grader from 2nd grade skills to a 4th grade level over the course of the school year. But grade-level tests, by definition, aren’t constructed to record achievement outside a narrow band of expectations. So the farther above or below grade level the student starts out, the less information a grade-level test will provide, and the greater the margin of error in individual scores.

While this flaw is NCLB’s, it is schools, educators, and students who are unfairly paying the price—particularly those in areas with the highest concentrations of low-income and minority students. How many of those schools facing the law’s numerous penalties—including the ultimate penalty of restructuring—are, in fact, achieving the intent of the growth models: placing their students on track to reach higher academic standards within a few years? Sadly, under the law’s current rules, we have no way of knowing. As a result, the growth models as currently approved are having little or no impact.

This limitation became clear when our state, Delaware, implemented its own growth-model pilot with 32,000 students in 47 schools. In the summer of 2007, the pilot partners commissioned the Center for Research in Educational Policy at the University of Memphis to compare official NCLB status and growth-model school ratings with simulated growth-model ratings that used both the regular state assessment to determine proficiency and the adaptive assessment to determine growth for students below the bar. The center’s results clearly showed the fully adaptive tests more accurately measuring whether a student was on track to reach proficiency within four years.

Using fully adaptive assessments also would, at long last, enable states to turn NCLB’s blunt-force, pass-fail results into much more nuanced, relevant, and timely information that teachers could use to improve their instruction. One common criticism of the law is that it pushes schools to teach to the middle—focusing on students within a point or two of proficiency to improve their percentages—while neglecting higher and lower performers. Having detailed information about each student generated by the adaptive tests would help them teach to each child’s needs, and set meaningful individual growth targets within the framework of the standards.

Schools also could use this high-quality data to identify effective practices, evaluate and adjust their instruction, focus their resources, monitor trends within their systems, and provide parents with information they could use to support their children’s learning. The Northwest Evaluation Association, which produced the proprietary adaptive assessment we used in our pilot, has published growth norms based on the past scores of more than 2.3 million students. So educators and parents could compare a student’s rate of growth with typical rates for a given score and grade level. Northwest is one of several vendors of such assessments.

The test design that adaptive assessments make use of is not a new one—in fact, it has long proved its worth in entrance exams such as the SAT, the Graduate Record Examination, and the Law School Admission Test, as well as in numerous national certification exams. Critics of adaptive assessments rightly raise the issue of costs, including the cost of aligning the tests to state standards. But our pilot also looked into some ways these costs can be mitigated. The most promising strategy builds on the recent trend among states of identifying “essential standards”—the core building blocks in each content area. Such an approach opens the doors to much broader collaboration and cost-sharing among consortia of states on their assessments and online reporting systems. Why not craft the reauthorized NCLB to foster innovation and improvement in the field of assessment, rather than to prevent it?

In establishing national accountability goals, the No Child Left Behind Act also set a high bar for itself: If we intend to rate or sanction schools, educators, and students based on their performance, the data we use to evaluate that performance also need to be accurate and useful. This simply won’t happen as long as the law fails to acknowledge the fact that not all students start out at grade level—and that it can’t address the significant minority who fall outside its own fairly rigid bounds.

Ironically, these students—both the high and the low performers within their grades—are the ones who stand to gain the most from the targeted instruction and other benefits made possible by a properly functioning assessment system. Making it right is an easy fix, and the payoff would be huge. Now it’s up to our federal lawmakers to make that happen.

A version of this article appeared in the May 21, 2008 edition of Education Week as Fixing the Flaw in the ‘Growth Model’

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
Teaching Students to Use Artificial Intelligence Ethically
Ready to embrace AI in your classroom? Join our master class to learn how to use AI as a tool for learning, not a replacement.
Content provided by Solution Tree
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Empowering Students Using Computational Thinking Skills
Empower your students with computational thinking. Learn how to integrate these skills into your teaching and boost student engagement.
Content provided by Project Lead The Way
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
IT Infrastructure & Management Webinar
The Reality of Change: How Embracing and Planning for Change Can Shape Your Edtech Strategy
Promethean edtech experts delve into the reality of tech change and explore how embracing and planning for it can be your most powerful strategy for maximizing ROI.
Content provided by Promethean

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal 5 Trump Education Priorities for a Second Term
With key players appointed to their cabinet positions, the scaffolding for President-elect Donald Trump's second term is taking shape.
7 min read
President-elect Donald Trump takes the stage before speaking at the FOX Nation Patriot Awards on Dec. 5, 2024, in Greenvale, N.Y.
President-elect Donald Trump takes the stage before speaking at the FOX Nation Patriot Awards on Dec. 5, 2024, in Greenvale, N.Y. With the frameworks now in place, Trump has laid priorities for education.
Heather Khalifa/AP
Federal Here's How Much Linda McMahon's Foundation Has Donated to Education Causes
The president-elect's pick for education secretary has long given to education causes through her family foundation.
5 min read
Linda McMahon, former Administrator of Small Business Administration, speaks during the Republican National Convention on July 18, 2024, in Milwaukee.
Linda McMahon, former Administrator of Small Business Administration, speaks during the Republican National Convention on July 18, 2024, in Milwaukee. McMahon, Trump's choice to lead the U.S. Department of Education in his second term, has a long history of giving to education causes through her family foundation.
J. Scott Applewhite/AP
Federal Republicans Preview Their Education Priorities in a Second Trump Term
In a hearing, Republicans called for more civics education and expressed concerns over "critical race theory" in schools.
5 min read
Rep. Aaron Bean, R-Fla., Chair of the House Subcommittee on Early Childhood, Elementary, and Secondary Education, speaks during a hearing on antisemitism in K-12 public schools, Wednesday, May 8, 2024, on Capitol Hill in Washington.
Rep. Aaron Bean, R-Fla., chair of the House Subcommittee on Early Childhood, Elementary, and Secondary Education, speaks during a hearing on antisemitism in K-12 public schools on May 8, 2024, in Washington. At a hearing on Dec. 4, 2024, the subcommittee discussed civics and government curriculum.
Jacquelyn Martin/AP
Federal Opinion The Trump Administration Should 'Devolve the Ed Dept.'s Responsibilities to the States'
After six years helming the House ed. committee, U.S. Rep. Virginia Foxx cuts loose on high points and frustrations of her tenure.
8 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week