Opinion
School & District Management Opinion

Data, Data Everywhere, But Not a Drop to Use

By Diane Kline — May 28, 2009 6 min read

Just as the weary seamen in “The Rime of the Ancient Mariner” were surrounded by a vast ocean of water yet had none to drink, educators are drowning in seas of data they cannot use.

Over the past four years, the U.S. Department of Education’s Institute of Education Sciences has awarded $264 million to 41 states and the District of Columbia for statewide longitudinal-data systems. Foundations have contributed millions of philanthropic dollars to ensure such systems’ development. And in response to the federal No Child Left Behind Act, districts have created entire departments whose sole purpose is to respond to request-for-compliance data.

Are we there yet? Do we really need more educational data? Apparently so, according to the new administration. Through the American Recovery and Reinvestment Act, another $250 million has been allocated in economic-stimulus funds for the development of state longitudinal-data systems.

The Education Department itself apparently questions the value of these state systems. A study on classroom data utilization released recently by the department found that “the vast majority of the activity around data systems and data use in districts and schools involves district, not state data systems. … [T]he hoped-for efficiencies to be gained from integrating data systems at the state, district, and school levels are not apparent from the vantage point of schools and districts.”

Data systems designed with usage in mind can help build the internal capacity schools and districts need to survive the upheavals of economic crisis, ever-changing political platforms, and the rapidly revolving door of superintendents.”

The American Productivity and Quality Center’s recently released findings from “Best Practices in Data-Driven Decision Making,” a benchmarking study sponsored by the Data Quality Campaign, revealed the factors that support and serve as barriers to data-driven decisionmaking. Study participants, which represented 69 districts ranging in size from 3,000 students to a million, and included five of the nation’s largest school systems, overwhelmingly agreed that it is not the lack of data that hinders data-driven decisionmaking.

To the contrary, officials in these districts described “being overwhelmed by the sheer number of data collects from the state for compliance reporting.” One participating superintendent reported that his district “has 83 state data collects a year,” and that only 2 percent of the data can be used for analyzing and improving student achievement.

It’s hard to argue with the value of longitudinal-data systems. This is especially true when one of the objectives of the federal stimulus plan is to provide much-needed data for linking K-12 and higher education information to workforce skills and training. But in an economic environment in which newspapers are filled with stories of impending teacher layoffs, proposals for four-day school weeks, and districts that are selling commercial ad space on the sides of school buses to raise cash, why would the Obama administration rank state longitudinal-data systems as one of its top priorities?

Maybe it’s because the view from 50,000 feet is always much prettier than the view at ground zero. Isolated academics, policymakers, foundations, and nonprofits may have great ideas for developing sophisticated data systems that will “help” educators. But the realities of attempting to use data for decisionmaking are much messier and more complex than they appear to be. Challenges such as slow state cycle time for turning around summative test data, lack of software interoperability, and insufficient time for teachers to discuss the data overwhelm the best of intentions.

The APQC’s benchmarking study included national focus groups of teachers and district administrators who explored barriers to data use. In one session, as administrators began to discuss a proposed bond issue to purchase newer, more sophisticated software systems, the teachers in the room began to show signs of growing frustration. After patiently listening to the conversation, one teacher blurted out, “We are just beginning to learn to use what we have now; please don’t buy a new one!”

Does the evidence indicate that state longitudinal-data systems would not have a positive impact on student success? Absolutely not. The studies cited, plus the APQC’s 30 years of experience in the field, show clearly that data systems designed with utilization in mind can create breakthrough improvement in student achievement. This means that data systems must be part of larger improvement systems to be effective.

What do I mean by an “improvement system”? It is a framework for managing an organization that ensures the organization gets the results it wants. And developing improvement systems is hard work. They require clarity of organizational purpose, definition of and focus on customers, identification and mapping of important organizational processes, development and tracking of key performance measures and metrics, benchmarking of internal and external best practices, use of tools for process improvement, and knowledge management. It is the improvement system that provides the mechanisms for utilizing the data.

A handful of successful districts nationwide have implemented data-centric improvement systems. Many were best-practice partners in our benchmarking study, including the following exemplars:

North Carolina’s Iredell-Statesville school district, the 2008 winner of the Malcolm Baldrige award in education, attributes much of its success to a deeply ingrained culture of data inquiry. All staff members know that you don’t walk into the superintendent’s office or go to any meeting unless you have the facts and figures to support whatever you came to discuss. In Georgia, the Gwinnett County public schools, another best-practice partner, has identified data owners who participate in cross-functional action teams to constantly review data validity. And at the Western Heights district in Oklahoma, the superintendent reviews multiple data “dashboards” at the start of each school day. By using these computer-generated compilations of pertinent data, the superintendent can give staff, community, and board members accurate, real-time data on just about any metric that has an impact on student achievement.

I propose that we not add a promising initiative like state longitudinal-data systems to the ever-growing pile of stagnant, random acts of educational reform. As a part of the Obama administration’s plans to help educators, we should create something that will actually affect the daily challenges of teaching students and running a school district.

As a part of, or in addition to, the money that has been allocated for state longitudinal-data systems, the administration should provide dollars for building improvement systems. Data systems designed with usage in mind can help build the internal capacity schools and districts need to survive the upheavals of economic crisis, ever-changing political platforms, and the rapidly revolving door of superintendents.

There are no silver bullets for improving the mess we have made of our nation’s education system. But as Clayton Wilcox, a former superintendent of Florida’s Pinellas school district, says, there are many promising “silver BBs” for education reform. The development and implementation of data-driven improvement systems is one shining BB that has great potential for not just improving, but transforming, the U.S. education system.

A version of this article appeared in the June 10, 2009 edition of Education Week

Events

Jobs The EdWeek Top School Jobs Virtual Career Fair
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
How to Power Your Curriculum With Digital Books
Register for this can’t miss session looking at best practices for utilizing digital books to support their curriculum.
Content provided by OverDrive
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Embracing Student Engagement: The Pathway to Post-Pandemic Learning
As schools emerge from remote learning, educators are understandably worried about content and skills that students would otherwise have learned under normal circumstances. This raises the very real possibility that children will face endless hours
Content provided by Newsela

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management More Than 1 Million Students Didn't Enroll During the Pandemic. Will They Come Back?
Education Week analyzed state data to gather a more comprehensive understanding of this year's enrollment loss.
6 min read
Students participate in class outside at the Woodland Pond School, a private school  located near Bangor, Maine. Maine experienced one of the nation's largest drops in student enrollment this school year, according to an EdWeek analysis.
Students participate in class outside at the Woodland Pond School, a private school located near Bangor, Maine. Maine experienced one of the nation's largest drops in student enrollment this school year, according to an EdWeek analysis.
Photo courtesy of Woodland Pond School
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Sponsor
Drive Improvement in Your School With Harvard’s Certificate in School Management and Leadership
Aubree Mills had two dilemmas she needed to address: One was recruiting and retaining good teachers at the Ira A. Murphy Elementary School
Content provided by Harvard Graduate School of Education
School & District Management Opinion Are Your Leadership Practices Good Enough for Racial Justice?
Scratch being a hero. Instead, build trust and reach beyond school walls, write Jennifer Cheatham and John B. Diamond.
Jennifer Cheatham & John B. Diamond
5 min read
Illustration of leadership.
Collage by Laura Baker/Education Week (Images: DigitalVision Vectors, iStock, Getty)
School & District Management We Pay Superintendents Big Bucks and Expect Them to Succeed. But We Hardly Know Them
National data is skimpy, making it hard to know what influences superintendents' decisions to move on, retire, or how long they stay. Why?
8 min read
Conceptual image of tracking with data.
marcoventuriniautieri/iStock/Getty