School & District Management

Common Standards Set for Federal Education Research

By Sarah D. Sparks — May 07, 2013 4 min read
  • Save to favorites
  • Print

As part of an effort to improve the quality of educational research and make it less balkanized, the National Science Foundation and the Institute of Education Sciences have introduced a common set of evidence standards for federally funded work.

The criteria, rolled out last week at the American Educational Research Association’s annual meeting here, will guide all new research at the IES, the U.S. Department of Education’s main research agency, and all NSF research in science, technology, engineering, and mathematics education.

“We’re now in a time of amazing change; we’re all looking at the Common Core State Standards, new assessment techniques,” said AERA President-elect Barbara Schneider, a professor of education and sociology at Michigan State University in East Lansing. “It’s terribly exciting, but this all raises questions and concerns about what kind of research needs to go on, what kind of capacity needs to go on.”

The new guidelines distinguish three interconnected types of education studies:

• Core knowledge, including foundational research, early-stage, and exploratory research;

• Design and development research, to create interventions or strategies; and

• Impact evaluations, including how those interventions work under ideal situations, as well as real-life settings with different groups of students.

“We need stronger evidence provided at a faster pace,” said Janice M. Earle, the NSF’s education evaluations coordinator.

“We’re under more constrained federal resources,” she said, “and that provides a powerful impetus for collaborating and building purposefully on each other’s portfolios and investments.”

For each type of study, researchers must lay out their purpose and how the project contributes to existing evidence, as well as explain how it would further understanding of important policy or practice.

Moreover, researchers would have to be much more concrete about what they expect to produce and how other researchers would be able to build on the results.

The standards also align expectations for research on informal learning, such as in museums, clubs, and after school.

“We wanted to make sure there was a strong sense that all settings were fair game,” Ms. Earle said.

Clearer Goals

The guidelines have been in development for two years at the two agencies, the federal Office of Science and Technology, and the Office of Management and Budget.

But efforts to make education research more coherent across agencies goes back at least as far as the creation of the IES itself, in 2002, when then-Director Grover J. “Russ” Whitehurst sought to overhaul the Education Department’s research agency in the mold of the NSF and the National Institutes of Health, which were seen as having better-quality studies.

Those early efforts also sparked a long-running debate over whether quality necessitates experimental designs and randomized controlled trials alone.

The new joint evidence standards are in part an attempt to resolve that debate, by defining high standards of evidence and usable, relevant results for different types of research, from basic descriptive studies to nationwide evaluations of programs.

The new standards also lay out a more holistic view of how different types of studies can be used together to build a knowledge base.

All federal agencies have come under pressure from the OMB to beef up the quality of their research and program evaluations.

“This has been a pretty significant change for how we do business,” said Nadya Chinoy Dabby, the Education Department’s associate assistant deputy secretary for innovation and improvement.

“Most of our programs across IES and NSF have a ton of different evaluation requirements. Most of them aren’t particularly meaningful, they don’t connect to what you do next, don’t connect to what we do next, and so they sort of sit out there, and that’s appropriate because they’re also not particularly rigorous,” she said.

“But that doesn’t mean that we are systematically building a knowledge base, and it doesn’t mean that at the end of the day we are improving outcomes for our students,” she added.

“The part I think will be most useful is the articulation of expectations,” said Barbara Means, the director of the Center for Technology and Learning at SRI International, a Menlo Park, Calif., research group that has held grants from both agencies. “This is the first time I’ve really seen a clear articulation of what we should see at the end of a project.”

More Competitions?

The joint criteria were inspired in part, said IES Director John Q. Easton, by the tiered-evidence format of the $150 million Investing in Innovation, or i3, grants. The Education Department program, which provides different levels of funding based on the level of evidence on which a project is based, has become “a model across the federal government,” he said.

The joint standards also come as the Obama administration seeks in the president’s fiscal 2014 budget proposal to overhaul the federal government’s “fragmented approach” to STEM education by combining or restructuring 114 of the 220 education programs in that area in 11 of the 13 agencies that house them.

Part of that proposed overhaul would involve consolidating $180 million from the budgets of the IES, the NSF, and the Smithsonian Institution to create aligned programs, including $150 million in new competitive grants, which could raise the profile of the new evidence standards in the same way i3 did for the earlier tiered-evidence model.

It remains to be seen whether there will be any traction on those proposals in Congress. But Edith Gummer, the program director for the NSF’s learning-research division, said the evidence standards are final, and in the coming months, the agencies will publish and integrate them into new research competitions and priorities.

Related Tags:

A version of this article appeared in the May 08, 2013 edition of Education Week as Common Criteria Set for Federal Research

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Law & Courts Webinar
Future of the First Amendment:Exploring Trends in High School Students’ Views of Free Speech
Learn how educators are navigating student free speech issues and addressing controversial topics like gender and race in the classroom.
Content provided by The John S. and James L. Knight Foundation
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Start Strong With Solid SEL Implementation: Success Strategies for the New School Year
Join Satchel Pulse to learn why implementing a solid SEL program at the beginning of the year will deliver maximum impact to your students.
Content provided by Satchel Pulse
Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Schools Prefer Cheaper Ventilation Options to Curb COVID: Why They Should Consider Upgrading
Most schools are opening windows and hosting class outdoors rather than investing in costlier, more-effective measures.
2 min read
Students from PS 11 Elementary School participate in art projects and interactive activities, during an after-school outdoor program held in the High Line park in New York, NY, October 21, 2020.
Students from PS 11 Elementary School participate in art projects and interactive activities during an after-school outdoor program in New York City in 2020. Many schools are opting for outdoor classes and other-low cost measures to maintain healthy air quality during the pandemic.
Anthony Behar/Sipa via AP Images
School & District Management Hour by Busy Hour: What a Principal's Day Actually Looks Like
From the time they wake up until they set the alarm at night, school leaders juggle the routine, the unexpected, and the downright bizarre.
Left, Principal Michael C. Brown talks on a radio at Winters Mill High School in Westminster, Md., on May 17, 2022. Right, Boone Elementary School principal Manuela Haberer directs students and parents in the pick-up line at the conclusion of the school day on May 19, 2022 in San Antonio, Texas.
Left, Principal Michael C. Brown talks on a radio at Winters Mill High School in Westminster, Md., on May 17, 2022. Right, Boone Elementary School principal Manuela Haberer directs students and parents in the pick-up line at the conclusion of the school day on May 19, 2022 in San Antonio, Texas.
From left, Steve Ruark and Lisa Krantz for Education Week
School & District Management Photos What School Leadership Looks Like: A Day in the Life of a Principal
A look at a typical day for one elementary school principal in Texas and a high school principal in Maryland.
1 min read
Principal Michael C. Brown, from left, talks to seniors Brady D’Anthony, 18, and Sydney Dryden, 17, at Winters Mill High School in Westminster, Md., Tuesday, May 17, 2022.
Principal Michael C. Brown, from left, talks to seniors Brady D’Anthony, 18, and Sydney Dryden, 17, at Winters Mill High School in Westminster, Md., Tuesday, May 17, 2022.
Steve Ruark for Education Week
School & District Management Schools Can Access Tons of Money for Electric Buses. Will They Use It?
Electric buses are growing more appealing as fuel prices rise, but some districts remain wary of the cost and logistics.
5 min read
Stockton Unified School District's new electric bus fleet reduces over 120,000 pounds of carbon emissions and leverages The Mobility House's smart charging and energy management system.
The new electric bus fleet at California's Stockton Unified School District is projected to reduce the district's carbon emissions.
Business Wire via AP