School & District Management

Project to Vet Think Tanks’ Work With Eye Out for Ideological Bias

By Lynn Olson — March 21, 2006 3 min read
  • Save to favorites
  • Print

A just-launched project will review education reports released by private think tanks for the quality of their research, methodology, and conclusions, using expert academic reviewers.

The Think Tank Review Project is a joint collaboration of the Arizona State University Education Policy Studies Laboratory and the University of Colorado’s Education and Public Interest Center. It has pledged to provide “expert reviews” to policymakers, the news media, and the public within two weeks of a report’s release. The first such reviews—of three reports released since January—were posted online last week at http://thinktankreview.org.

The project reflects a growing concern among researchers that studies on hot-button issues increasingly appear in public without having undergone an independent peer review by scholars. The project’s creators particularly hope to provide a counterpoint to what they view as a proliferation of education reports coming from think tanks that were founded to advance particular ideological points of view. (“Research: Researching the Researchers,” Feb. 20, 2002.)

View Think Tank Project Reviews from Arizona State University’s Education Policy Studies Laboratory.

“Despite garnering media attention and their influence with many legislators, reports released by private think tanks are often of very poor quality,” Alex Molnar, the director of the Education Policy Studies Laboratory, said in a press release announcing the project.

“Many think tank reports are little more than ideological argumentation dressed up as research,” he said. “We believe that policymakers, reporters, and the public will greatly benefit from having qualified social scientists provide reviews of these documents in a timely fashion.”

Neutrality Debated

BRIC ARCHIVE

Ellen Condliffe Lagemann, a professor of education at Harvard University’s graduate school of education and a former president of the Chicago-based Spencer Foundation, which focuses on education research, called the project a “much-needed development.”

“It’s very difficult for laypeople to react critically to the claims made in reports published by these organizations,” she said in an e-mail. “We all need help in understanding some of the complicated design issues that arise in evaluating programs, judging the significance of different test scores, and the like.”

But the project itself has raised eyebrows about whether it will be bias-free. Its funding comes from the Great Lakes Center for Education Research and Practice, an East Lansing, Mich.-based group founded by the Michigan Education Association, an affiliate of the National Education Association. (“Union-Funded Study Finds Fault With High-Stakes Testing,” Sept. 28, 2005.)

BRIC ARCHIVE

While it’s useful and appropriate for researchers and advocates to monitor and critique each other’s work, said Frederick M. Hess, the director of education policy studies at the conservative American Enterprise Institute in Washington and the executive editor of Education Next,the Arizona State scholars “are more than a little ideological in their own right.”

“Even aside from the issue of funding, these are individuals who have clearly articulated policy preferences,” he said. “While that’s fine, they’re certainly not neutral authorities. I’d hope that media treat these ‘critiques’ accordingly and carefully weigh their claims.”

Kevin Welner, the director of the Education and Public Interest Center at the University of Colorado at Boulder, said: “Each of our reviewers is an independent scholar. I do not think the reviewers even know the source of the funding. There is absolutely no pressure being exerted by the Great Lakes Center on the content of the reviews.”

The project’s first three reviews cover a report by the Cato Institute and the Milton & Rose D. Friedman Foundation, on the District of Columbia voucher program; a report by the Manhattan Institute for Policy Studies evaluating Florida’s plan to end social promotion, which later appeared as an article in Education Next; and a report by the Wisconsin Policy Research Institute on the status of high school education in that state.

Related Tags:

A version of this article appeared in the March 22, 2006 edition of Education Week as Project to Vet Think Tanks’ Work With Eye Out for Ideological Bias


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Ensuring Continuity of Learning: How to Prepare for the Next Disruption
Across the country, K-12 schools and districts are, again, considering how to ensure effective continuity of learning in the face of emerging COVID variants, politicized debates, and more. Learn from Alexandria City Public Schools superintendent
Content provided by Class
Teaching Profession Live Online Discussion What Have We Learned From Teachers During the Pandemic?
University of California, Santa Cruz, researcher Lora Bartlett and her colleagues spent months studying how the pandemic affected classroom teachers. We will discuss the takeaways from her research not only for teachers, but also for

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management A Vaccine for Kids Is Coming. 6 Tips for Administering the Shot in Your School
Start planning now, get help, and build enthusiasm. It's harder than it looks.
11 min read
Cole Rodriguez, a 15-year-old student at Topeka West, gets a COVID-19 vaccine Monday, Aug. 9, 2021 at Topeka High School's vaccine clinic.
Cole Rodriguez, a 15-year-old student, gets a COVID-19 vaccine at Topeka High School's vaccine clinic.
Evert Nelson/The Topeka Capital-Journal via AP
School & District Management Letter to the Editor School Mask Mandates: Pandemic, ‘Panicdemic,’ or Personal?
"A pandemic is based on facts. A 'panicdemic' is based on fears. Today, we have both," writes a professor.
1 min read
School & District Management How 'Vaccine Discrimination' Laws Make It Harder for Schools to Limit COVID Spread
In Montana and Ohio, the unvaccinated are a protected class, making it tough to track and contain outbreaks, school leaders say.
4 min read
Principal and District Superintendent Bonnie Lower takes the temperature of a student at Willow Creek School as the school reopened, Thursday, May 7, 2020, in Willow Creek, Mont.
Bonnie Lower, a principal and district superintendent in Willow Creek, Mont., checks the temperature of a student as Willow Creek School reopened for in-person instruction in the spring.
Ryan Berry/Bozeman Daily Chronicle via AP
School & District Management Opinion 'Futures Thinking' Can Help Schools Plan for the Next Pandemic
Rethinking the use of time and place for teachers and students, taking risks, and having a sound family-engagement plan also would help.
17 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty