Federal

Buckley Warns NAEP Background Survey Proposals May Reinvent the Data Wheel

By Sarah D. Sparks — December 06, 2013 3 min read
  • Save to favorites
  • Print

Cross-posted from Catherine Gewertz at Curriculum Matters.

Arlington, Va.

In all the high-profile attention to the periodic results of the National Assessment for Educational Progress, often forgotten is the wealth of data that is collected from students as a part of those tests. The National Assessment Governing Board, which sets policy for NAEP, is taking early steps to revamp that bank of “background questions,” but got a big blast of criticism Friday from an influential source: the U.S. Department of Education’s chief statistician.

It unfolded during the quarterly meeting of the NAGB board, which Jack Buckley attends as chief of the National Center for Education Statistics.

At a committee meeting, two respected experts—Alan Ginsburg, the former director of policy and program evaluation services at the federal education department, and Marshall “Mike” Smith, a top advisor in the department during three adminstrations—laid out their proposal for how NAGB could streamline its current list of more than 1,400 bits of information that are collected about students’ backgrounds through questionnaires, and instead expand and regroup the questions to form composite indicators that bear on policy and practice.

Putting groups of variables together on given topics yields important information about the factors that affect student achievement, Smith argued. Ginsburg offered examples of what that might look like. Information collected from NAEP-tested students about their teachers’ expectations, combined with their reported race or ethnicity, for instance, shows that two-thirds of white students report that their teachers have high expectations for them, while only 47 percent of African American students report the same.

Smith and Ginsburg proposed a framework that would embrace student-level factors such as home educational climate, preschool and afterschool experiences, and student motivation, and school-level factors like teacher quality and professionalism, schools’ use of technology and school climate.

The presentation drew some warm remarks from committee members about its potential value helping illuminate performance patterns that can shape policy to improve education. But during the question-and-answer period, Buckley rose from the spectator section to change the tone of the conversation.

“I find this whole line of reasoning baffling,” said Buckley, who recently announced his resignation to take a senior job with the College Board. The committee seems to be functioning, he said, “as if we live in a world where the only source of data is NAEP.”

Noting that the NCES produces staggering amounts of data every year, in such forms as “The Condition of Education,” which includes dozens of tables of NAEP data, and the “Digest of Education Statistics,” he urged the committee to recognize that “there’s an awful lot of information out there already... That’s why we have a federal agency for [education] statistics,” he said.

Smith said that the new proposed approach would produce information in different combinations than is currently available.

“We’re talking about concepts that aren’t typically captured in one question,” he said. “It is different, I think.”

The tension was broken by the committee chair announcing that there was no more time for discussion, since a working lunch session of the entire NAGB board was about to begin.

At that session, Smith and Ginsburg gave a modified version of their presentation to the NAGB board. It drew many interested questions, and supportive remarks.

“Wonderful work,” said NAGB member and assessment expert W. James Popham. “Don’t you dare stop.”

This wasn’t the first whack that NAGB has taken at the questionnaires of background questions given to students who take the tests; they’ve been undergoing revision for a while. And today’s exchange wasn’t the first sign of tension between NCES and NAGB, either; the two entities have an uneasy alliance peppered with disagreements. The NAGB board members, appointed by the U.S. Secretary of Education, are officially independent of the department.

Related Tags:

A version of this news article first appeared in the Inside School Research blog.


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
What’s Next for Teaching and Learning? Key Trends for the New School Year
The past 18 months changed the face of education forever, leaving teachers, students, and families to adapt to unprecedented challenges in teaching and learning. As we enter the third school year affected by the pandemic—and
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
How Data and Digital Curriculum Can Drive Personalized Instruction
As we return from an abnormal year, it’s an educator’s top priority to make sure the lessons learned under adversity positively impact students during the new school year. Digital curriculum has emerged from the pandemic
Content provided by Kiddom
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Pandemic Tests Limits of Cardona's Collaborative Approach as Education Secretary
He's sought the image of a veteran educator among former peers, but COVID has forced him to take a tough stance toward some state leaders.
10 min read
Education Secretary Miguel Cardona and Schools Chancellor Meisha Porter speak to Mia Arias, 10, during their visit to P.S. 5 Port Morris, a Bronx elementary school, Tuesday, Aug. 17, 2021 in New York.
U.S. Secretary of Education Miguel Cardona and Schools Chancellor Meisha Porter speak to Mia Arias, 10, during a visit to P.S. 5 Port Morris, a Bronx elementary school, last month.
Brittainy Newman/AP
Federal White House Launches Hispanic Education Initiative Led by Miguel Cardona
President Joe Biden said his administration intends to address the "systemic causes" of educational disparities faced by Hispanic students.
2 min read
Education Secretary Miguel Cardona writes down and draws positive affirmations on poster board with students during his visit to P.S. 5 Port Morris, a Bronx elementary school, Tuesday, Aug. 17, 2021 in New York.
U.S. Secretary of Education Miguel Cardona visits students in New York City at P.S. 5 Port Morris, a Bronx elementary school in the Bronx last month.
Brittainy Newman/AP
Federal Feds Add Florida to List of States Under Investigation Over Restrictions on Mask Mandates
The Education Department told the state Sept. 10 it will probe whether its mask rule is violating the rights of students with disabilities.
3 min read
Surrounded by lawmakers, Florida Gov.Ron DeSantis speaks at the end of a legislative session on April 30, 2021, in Tallahassee, Fla.
Surrounded by lawmakers, Florida Gov.Ron DeSantis speaks at the end of a legislative session on April 30, 2021, in Tallahassee, Fla.
Wilfredo Lee/AP
Federal How Biden Will Mandate Teacher Vaccines, Testing in Some States That Don't Require Them
President Joe Biden's COVID-19 plan will create new teacher vaccination and testing requirements in some states through worker safety rules.
4 min read
Nurse Sara Muela, left, administers the Johnson & Johnson COVID-19 vaccine to educator Rebecca Titus at a vaccination site setup for teachers and school staff at the Berks County Intermediate Unit in Reading, Pa., on March 15, 2021.
Nurse Sara Muela administers a COVID-19 vaccine to educator Rebecca Titus at a vaccination site for at the Berks County Intermediate Unit in Reading, Pa.
Matt Rourke/AP