Federal Opinion

Assessing ‘Success’ in School Finance Litigations

By Michael A. Rebell & Bruce D. Baker — July 08, 2009 6 min read
  • Save to favorites
  • Print

The New Jersey Supreme Court issued a milestone ruling at the end of May in the Abbott v. Burke education finance case, culminating 35 years of litigation by approving the constitutionality of the state’s new education funding formula.

Holding that the new formula provides every New Jersey student a “thorough and efficient education,” the court lifted remedial requirements for special funding to the state’s 31 very-high-poverty urban school systems, the so-called Abbott districts. In doing so, the justices also noted that the litigation has resulted in “measurable educational improvement” for the thousands of low-income and minority students in those districts.

With a total of 44 other states now having been the scene of similar legal challenges to historical inequities and inadequacies in the funding of public education—and with the vast majority of those cases having been won by the plaintiffs—this decisive development in the New Jersey litigation provides an appropriate occasion for taking stock of what these cases in general have achieved.

Virtually all analysts agree that school finance litigation has substantially increased the overall level of spending on schools in the United States, and that it has also resulted in a clear reduction in funding disparities among school districts in most states. But there has been far more contention—supported by far less analysis—about the effect of these judicial decrees on student achievement, especially on the achievement of the low-income and minority students who historically have been shortchanged by state school finance systems.

What convinced the New Jersey justices that the additional funding provided to poorer urban districts resulted in better student outcomes? From 1999 to 2007, student scale scores shot up by 26 points on the statewide 4th grade mathematics assessment, with the greatest increases occurring in the Abbott districts. As a result, the achievement gap between those districts and the rest of the state declined by more than one-third. Analogous gains have been reported in Kansas, Kentucky, Massachusetts, New York, and other states where plaintiffs have won increased school funding in recent years.

Still, there are those who refuse to accept this forceful evidence. In a recent book, Schoolhouses, Courthouses, and Statehouses, and in an Education Week Commentary of June 10, 2009, Eric A. Hanushek and Alfred A. Lindseth conclude that reading and math scores on the National Assessment of Educational Progress tests did not significantly improve over a 15-year period in four states—Kentucky, Massachusetts, New Jersey, and Wyoming—that had court remedies requiring increases in school funding. Hanushek and Lindseth focused on NAEP because it provides a national benchmark not subject to the manipulations that occur with some of the state testing programs. The authors have, however, misused the NAEP data. A proper analysis of NAEP scores shows that considerable gains have in fact been made in those states.

Hanushek and Lindseth use 1992 as the base year in all of their NAEP analyses, contending this is a good starting point for considering the impact of these litigations because it was “prior to the commencement of their respective remedies.” This may be the case for Massachusetts, which decided its case in 1993. Kentucky, however, had instituted its reforms two years earlier, while Wyoming, where a major case was decided in 1995, did not fully implement the court-approved remedy until 2001. In New Jersey, the court did not order the critical program and funding remedies until 1998-2000.

Moreover, the range of years chosen by Hanushek and Lindseth is not appropriate for NAEP analysis because the extension of NAEP to state-level data was in a trial period from 1990 until 1996, and full implementation of state reading assessments did not occur until 1998. In addition, in 1996, NAEP changed its rules for permitting accommodations in the administration of its tests to students with special needs. For that very reason, officials who administer NAEP caution about making long-term-trend comparisons from before 1996 to after 1996.

We looked, therefore, at NAEP reading scores from 1998 to 2007 and math scores from 1996 to 2007. Our review indicates that, overall, in 12 of 13 instances (the analysis included 13, rather than 16, testing instances because New Jersey did not administer any NAEP tests except in 4th grade math until 2002), gains for all students in these states exceeded gains for all students nationally, and in nine of 13 cases, gains for students from backgrounds of poverty in these states exceeded gains for poverty students nationally. In sum, focusing on the more appropriate years, the NAEP test results, like the available data on the state assessments, indicate that school finance litigation does, in fact, result in measurable gains in student performance.

Nevertheless, we are reluctant to conclude definitively, based on this limited testing data, that all or any of these litigations are a “success.” As many commentators have noted, there are substantial questions about the validity and reliability of many of the state tests, and also about the NAEP tests, which are not aligned with the state curricula students are learning and which are administered only to a small sample of students in each state.

Furthermore, studies have shown that the high-stakes concentration on English and math required by the federal No Child Left Behind Act actually reduces time, effort, and student accomplishment in science, social studies, the arts, and other subjects that essentially “don’t count.” This runs directly counter to the courts’ stipulation in many adequacy cases that states are constitutionally obliged to provide a “thorough and efficient” or a “sound basic education” in all content areas, and not just in English and math.

The New Jersey Supreme Court, for example, determined that students are constitutionally entitled to an educational opportunity that is needed in the contemporary setting to “equip a child for his role as a citizen and as a competitor in the labor market.” Although plausible survey instruments and other mechanisms for assessing these broad-based skills are available, they are not often used, and the data they generate are rarely analyzed.

In short, judging the effect of these court decisions on student achievement is a complex business. The test statistics may be useful indicators of important trends, but to really understand the impact of the education finance litigations, one must also look to underlying patterns and take into account a wide range of educational, political, and economic variables that, over time, affect the outcomes of the reform process. For example, with the NAEP statistics we have cited, lesser gains for poverty students in Wyoming come as no surprise, since in that state funding was leveled up significantly, yet disparities between districts were largely retained. It also is significant that Kentucky’s relative scores have declined in recent years, a time period when funding levels in Kentucky began to lag behind neighboring states’.

Accordingly, to gauge accurately the extent to which lasting reforms that prepare students to become capable citizens and productive workers were achieved, we should look to discerning case studies of developments and broad-based outcomes in Kentucky, Massachusetts, New Jersey, Wyoming, and many other states. Studies of this sort, in contrast to the kind of back-of-the-envelope “analyses” offered by Hanushek and Lindseth, would not only answer questions about how to define “success,” and how much “success” was achieved, but would also provide important recommendations and guidance on how to further enhance meaningful student success in the future.

A version of this article appeared in the July 15, 2009 edition of Education Week as Assessing ‘Success’ in School Finance Litigations

Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Evaluating Equity to Drive District-Wide Action this School Year
Educational leaders are charged with ensuring all students receive equitable access to a high-quality education. Yet equity is more than an action. It is a lens through which we continuously review instructional practices and student
Content provided by BetterLesson

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Feds to Probe Whether Texas Ban on School Mask Mandates Violates Disability Rights Laws
The Education Department has already opened investigations in six other states that ban universal school mask requirements.
2 min read
A staff member holds the door open for kids on the first day of school at Goodwin Frazier Elementary School in New Braunfels, Texas on Tuesday, Aug. 25, 2020.
A staff member holds the door open at Goodwin Frazier Elementary School in New Braunfels, Texas in 2020. This year, Texas has prohibited school districts from requiring all students to wear masks.
Mikala Compton/Herald-Zeitung via AP
Federal New Federal Team to Work on Puerto Rico School Improvement, Oversight
The Puerto Rico Education Sustainability Team will focus on creating better learning environments and improving financial management.
3 min read
Secretary of Education Miguel Cardona visits the Emilio Delgado School in Corozal on June 30, 2021 during a visit to Puerto Rico.
Secretary of Education Miguel Cardona visits the Emilio Delgado School in Corozal on June 30, 2021 during a visit to Puerto Rico.
Teresa Canino Rivera/GDA via AP
Federal Pandemic Tests Limits of Cardona's Collaborative Approach as Education Secretary
He's sought the image of a veteran educator among former peers, but COVID has forced him to take a tough stance toward some state leaders.
10 min read
Education Secretary Miguel Cardona and Schools Chancellor Meisha Porter speak to Mia Arias, 10, during their visit to P.S. 5 Port Morris, a Bronx elementary school, Tuesday, Aug. 17, 2021 in New York.
U.S. Secretary of Education Miguel Cardona and Schools Chancellor Meisha Porter speak to Mia Arias, 10, during a visit to P.S. 5 Port Morris, a Bronx elementary school, last month.
Brittainy Newman/AP
Federal White House Launches Hispanic Education Initiative Led by Miguel Cardona
President Joe Biden said his administration intends to address the "systemic causes" of educational disparities faced by Hispanic students.
2 min read
Education Secretary Miguel Cardona writes down and draws positive affirmations on poster board with students during his visit to P.S. 5 Port Morris, a Bronx elementary school, Tuesday, Aug. 17, 2021 in New York.
U.S. Secretary of Education Miguel Cardona visits students in New York City at P.S. 5 Port Morris, a Bronx elementary school in the Bronx last month.
Brittainy Newman/AP