Opinion
Education Opinion

ESEA Hearing: What Wasn’t Answered

By Peter Greene — January 26, 2015 4 min read
  • Save to favorites
  • Print

The first Senate hearing on the NCLB rewrite focused on testing and accountability. Discussion at and around the hearing has centered on questions of the Big Standardized Test. How many tests should be given? How often should the test be given? Should it be a federal test or a state test? Who should decide where to draw the pass-fail line on the test?

These are all swell questions to ask, but they are absolutely pointless until we answer a more fundamental question:

What do the tests actually tell us?

Folks keep saying things such as “We need to continue testing because we must have accountability.” But that statement assumes that tests actually provide accountability. And that is a gargantuan assumption, leading Congress to contemplate building a five-story grand gothic mansion of accountability on top of a foundation of testing sand in a high stakes swamp.

The question did not go completely unaddressed. Dr. Martin West led off with some observations about the validity of the test. And then he trotted out Chetty, Friedman and Rockoff (2014) a study that piles tautology (we define good teachers as those with good test results, and then we discover that those good teachers get good test results; also, red paint is red) on top of correlation dressed up as causation. If you like your Chetty debunking with a more scholarly flair, try this. If you like it with Phineas and Ferb references, try this.

Then West piled up more correlation dressed as causation. Citing Deming et al (2014), West takes a stand for the predictive power of testing, and in doing so, he himself makes clear why his support of testing validity is actually no support at all.

Predictive power is not causation. Let’s take a stroll through a business district and meet some random folks. I’ll bet you that the quality of their shoes is predictive of the quality of their cars and their homes. Expensive shoes predict a Lexus parked in front of a five story grand gothic mansion.

It does not follow, however, that if I buy really nice shoes for all the homeless people in that part of town, they will suddenly have expensive homes and fancy cars.

And here’s how test-based accountability works. People off in some capital tell local authorities, “We want to end homelessness. So we expect pictures of all your homeless wearing nice shoes. And if the number doesn’t go up, we will dock your pay, kill your dog, and take away your dessert for a year.” The local authorities will get those pictures (even if they have to use fake shoes or the same shoes on multiple feet), send off the snapshots to the capital, the capital folks will congratulate themselves for ending poverty, and the homeless people will still be sleeping under a bridge and not in a fancy gothic mansion.

Another version of the same central question that was neither asked nor answered at the hearing would be:

What would give us the best, most complete, most accurate sense of how well educated a young person might be? How many people would seriously answer, “Oh, given the need to measure the full range of a person’s skills, knowledge and aptitudes, I would absolutely depend on a bubble test covering just two thin slivers out of the whole pizza of that person.” When you think of a well-educated person, do you automatically think of a person who does really well on standardized tests of certain math and reading skills?

Oddly enough, it was a nominally pro-test witness whose testimony underlined that. Paul Leather, of the New Hampshire Department of Education, testified at some length about the granite state’s extensive work in developing something more like a whole-child, full-range assessment-- something that is robust and flexible and individual and authentic and basically everything that a standardized mass-produced test is not.

Congress put the cart not only before the horse, but before the wheels came back from the blacksmith shop. What they need to do is bring in the testing whizzes of Pearson/PARCC/SBA/etc and ask them to show how the Big Standardized Test measures anything other than a student’s ability to take the Big Standardized Test. And I have not even addressed the question of whether or not the Big Standardized Test accurately measures even the slim slice of skills that it claims to assess-- but that question needs to be asked as well. We’re missing serious discussions of testing’s actual results, like this one. Instead, Congress engaged in a long discussion of how best to clean and press the emperor’s new clothes.

There is no point in discussing what testing program best provides accountability if the tests do not actually measure any of the things we want schools to be accountable for. You can build your big gothic mansion in the swamp, but it will be sad, scary and dangerous for any people who have to live there.

The opinions expressed in View From the Cheap Seats are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Data Webinar
Using Integrated Analytics To Uncover Student Needs
Overwhelmed by data? Learn how an integrated approach to data analytics can help.

Content provided by Instructure
Classroom Technology Webinar How Pandemic Tech Is (and Is Not) Transforming K-12 Schools
The COVID-19 pandemic—and the resulting rise in virtual learning and big investments in digital learning tools— helped educators propel their technology skills to the next level. Teachers have become more adept at using learning management
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Data Webinar
How Can Data-Driven Instructional Programming Promote Equity and Student Achievement?
By now, you’ve started the new school year and begun gathering new academic data on your learners from interim, summative, and perhaps even social and emotional learning (SEL) assessment sources. These data points help you
Content provided by ACT

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Students Argue Civics Education Is a Constitutional Right, Continue Court Fight
Students nationwide need to know how to participate in the political process and exercise their constitutional rights, their lawyers argue.
4 min read
High school teacher Natalie O'Brien, center, hands out papers during a civics class called "We the People," at North Smithfield High School in North Smithfield, R.I., on March 8, 2017. Students in Rhode Island are asking a federal appeals court to affirm that all public school students have a constitutional right to a civics education because they feel they aren't taught how to meaningfully participate in a democratic and civil society.
High school teacher Natalie O'Brien, center, hands out papers during a civics class called "We the People," at North Smithfield High School in North Smithfield, R.I., on March 8, 2017. Students in Rhode Island are asking a federal appeals court to affirm that all public school students have a constitutional right to a civics education because they feel they aren't taught how to meaningfully participate in a democratic and civil society.
Steven Senne/AP
Education Senators Put YouTube, TikTok, Snapchat on the Defensive on Kids' Online Safety
Senators questioned executives from YouTube, TikTok, and Snapchat about what they’re doing to ensure young users’ safety on their platforms.
5 min read
The Youtube, left, and Snapchat apps on a mobile device in New York, on Aug. 9, 2017. The leaders of a Senate panel have called executives from YouTube, TikTok and Snapchat to face questions on what the companies are doing to ensure young users’ safety. The hearing Tuesday, Oct. 26, 2021, comes as the panel bears down on hugely popular social media platforms and their impact on children.
The Youtube, left, and Snapchat apps on a mobile device in New York, on Aug. 9, 2017. The leaders of a Senate panel have called executives from YouTube, TikTok and Snapchat to face questions on what the companies are doing to ensure young users’ safety. The hearing Tuesday, Oct. 26, 2021, comes as the panel bears down on hugely popular social media platforms and their impact on children.
Richard Drew/AP
Education Briefly Stated: October 27, 2021
Here's a look at some recent Education Week articles you may have missed.
8 min read
Education Vulnerable Students Left Behind as Schooling Disruptions Continue
The effects of unpredictable stretches at home can mirror those of chronic absenteeism and lead to long-term harm to learning.
4 min read
Students board a school bus on New York's Upper West Side on Sept. 13, 2021. Even as most students return to learning in the classroom this school year, disruptions to in-person learning, from missing one day because of a late school bus to an entire two weeks at home due to quarantine, remain inevitable as families and educators navigate the ongoing pandemic.
Students board a school bus on New York's Upper West Side on Sept. 13, 2021. Even as most students return to learning in the classroom this school year, disruptions to in-person learning, from missing one day because of a late school bus to an entire two weeks at home due to quarantine, remain inevitable as families and educators navigate the ongoing pandemic.
Richard Drew/AP