English-Language Learners

Panel Faults Methods of E.D.'s Bilingual-Education Studies

By Peter Schmidt — August 05, 1992 3 min read
  • Save to favorites
  • Print

The N.R.C. panel members, he continued, appear to belong to a second school of thought that backs experimental research only.

The National Research Council has questioned the validity of the two largest studies of bilingual education issued by the Education Department in recent years.

A panel convened by the N.R.C., an arm of the National Academy of Sciences, said last month that the studies were designed too poorly to be conclusive.

Alan L. Ginsburg, who supervised the studies and requested the N.R.C. review as director of the Education Department’s planning and evaluation service, defended the studies, saying the N.R.C. panel judged them by unreasonably high methodological standards.

The first study--which department officials had said was likely to quell much of the debate over bilingual education--found that the three most common bilingual-education methods were equally effective. (See Education Week, Feb. 20, 1991.)

The other tracked the progress of limited-English-proficient elementary-school students over five years and concluded that the type of instruction provided to them depended more on local conditions and resources than the pupils’ academic needs. (See Education Week, May 2, 1990.)

The N.R.C. panel said the studies lacked a firm conceptual grounding, did not have specific objectives, and were not designed to answer the basic policy questions that motivated them.

“The real problem with the studies we reviewed was that the questions were not asked in a way that would lead to the proper assessments,’' said Stephen E. Fienberg, who chaired the review panel.

No Clear Agreement

The Education Department asked the N.R.C. to review the two studies in October 1990.

The review panel concluded that the studies suffered from the absence of a clear agreement on the objective of bilingual education.

The lack of agreement, the report said, complicates the tasks of designing valid studies and of deciding which programs are the best.

“The studies do not license the conclusion that any one type of program is superior to any other nor that the programs are equally effective,’' the N.R.C. panel said.

“Even if one of the programs was definitely superior,’' the reviewers wrote, “the studies as planned and executed could well have failed to find the effect.’'

In spite of their limitations, some of the studies’ findings appeared to be consistent with the results of other studies, and they both supported the theoretical foundations of native-language instruction, the panel found.

Both studies, the report noted, suggested that, under certain conditions, primary-language instruction is important for second-language development in language arts and mathematics.

The panel advised the Education Department not to conduct other analyses of data from the studies because they would not lead to solid conclusions.

It recommended, instead, that the department conduct “more focused and theoretically driven studies’’ that clearly define different instructional approaches and examine them in specific contexts.

The N.R.C. panel faulted the studies for relying too heavily on elaborate statistical methods to overcome shortcomings in research design. It suggested that the department may have been better off if the money spent identifying programs that exemplify certain educational approaches had instead been spent to establish programs that would have allowed for valid experiments.

Split in Research Community

Mr. Ginsburg said the N.R.C. report illustrated a division in the educational-research community.

The department’s studies, he said, were conducted by researchers who believe it is often impossible and unethical for scientists to create the precise conditions necessary for scientifically valid experiments.

The N.R.C. panel members, he continued, appear to belong to a second school of thought that backs experimental research only.

The N.R.C. report, “Assessing Evaluation Studies: The Case of Bilingual Education Strategies,’' is available for $19 prepaid, plus $3 shipping, from the National Academy Press, 2101 Constitution Ave., N.W., Washington, D.C. 20418; telephone (202) 334-3313 or (800) 624-6242.

A version of this article appeared in the August 05, 1992 edition of Education Week as Panel Faults Methods of E.D.'s Bilingual-Education Studies


English-Language Learners Webinar Helping English-Learners Through Improved Parent Outreach: Strategies That Work
Communicating with families is key to helping students thrive – and that’s become even more apparent during a pandemic that’s upended student well-being and forced constant logistical changes in schools. Educators should pay particular attention
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Mathematics Webinar
Addressing Unfinished Learning in Math: Providing Tutoring at Scale
Most states as well as the federal government have landed on tutoring as a key strategy to address unfinished learning from the pandemic. Take math, for example. Studies have found that students lost more ground
Content provided by Yup Math Tutoring
Classroom Technology Webinar Building Better Blended Learning in K-12 Schools
The pandemic and the increasing use of technology in K-12 education it prompted has added renewed energy to the blended learning movement as most students are now learning in school buildings (and will likely continue

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

English-Language Learners Here's How Schools Are Helping Afghan Refugee Students
Districts are preparing to welcome students arriving from Afghanistan, with some even helping in evacuation efforts.
5 min read
Templeton Students have opportunities throughout the school year to wear traditional garments from their Native countries. The students are always excited to share their cultures with others.
Students at Templeton Elementary in Riverdale, Md., wear garments from their native countries. The school works to make refugee students feel comfortable and supported, including by offering Afghan students a place to pray and halal food options.
Randall Pike/Prince George’s County Public Schools
English-Language Learners Spotlight Spotlight on Bilingual Instruction
In this Spotlight, identify potential gaps in your schools, evaluate dual-language education programs, and more.
English-Language Learners Opinion Q&A Collections: Teaching English-Language Learners
Ten years' worth of posts sharing the advice of over 100 experienced teachers of English-language learners.
12 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
English-Language Learners Opinion Four Educator-Recommended Approaches for Teaching English-Language Learners
Five educators recommend classroom strategies for teaching ELLs, including translanguaging & consistency.
13 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."