Education

Researchers Seek To Measure ‘Opportunity’ Standards

By Robert Rothman — April 28, 1993 4 min read
  • Save to favorites
  • Print

ATLANTA--In a development that could influence a growing policy debate, researchers at all levels of education are designing ways to measure the “opportunity to learn’’ curricular content available to students, according to several of the researchers.

Speaking here at the annual meeting of the American Educational Research Association this month, the head of an international mathematics and science study outlined plans to measure curriculum and instructional practices in the participating countries. In addition, a U.S. official described steps to examine what is taught in classrooms in this country, while local officials discussed attempts to determine if students have been taught material that appears on tests.

The efforts are essential to insure that all students have access to high-quality instruction, said Floraline I. Stevens, a research associate at the National Science Foundation.

Tests alone, she said, cannot determine whether students’ performance actually reflects what they know or what their schools have offered.

Citing similar concerns, members of Congress have insisted that an attempt to set national standards for student performance be balanced with standards for schools as well. (See Education Week, April 7, 1993.)

“Without looking at opportunity to learn,’' Ms. Stevens said, “you’re really not looking at what students are able to do.’'

But Lois Peak, a researcher at the National Center for Education Statistics, cautioned that the efforts thus far have not yet yielded a “neat, nifty’’ indicator of opportunity to learn. And even if researchers succeed in coming up with one, she suggested, it will not improve students’ opportunities unless teachers use it to improve instruction.

“Unless teachers know how to interpret it and apply it back to their teaching,’' Ms. Peak said, “all the indicators in the world will not change education.’'

International Studies

Although the opportunity-to-learn issue has emerged only recently in policy debates in this country, it has long been a concern in international studies of student achievement, noted Leigh G. Burstein, a professor of education at the University of California at Los Angeles.

Countries participating in such studies, he said, have sought to determine the extent to which differences in performance reflect differences in curricula, rather than in achievement.

“Failure to try to capture opportunity to learn as comprehensively as possible,’' Mr. Burstein said, “is prima facie evidence that an achievement study is flawed.’'

The Third International Mathematics and Science Study, which is scheduled to be administered in 1995, will include a number of efforts to get at that question, according to William H. Schmidt, a professor of education at Michigan State University and the U.S. national coordinator of the study.

Beginning this spring, he said, researchers will analyze curriculum guides and textbooks from the participating countries to determine the “intended curriculum,’' or what students are expected to know.

In addition, the study will also survey teachers and principals to learn about teachers’ backgrounds, their beliefs about subject matter, and their instructional practices.

“Our hope is to relate opportunities and what is going on in classrooms to the ‘attained curriculum'--in other words, achievement,’' Mr. Schmidt said.

U.S. Studies

Within the United States, the N.C.E.S. has also taken steps to measure students’ learning opportunities, said Sharon A. Bobbitt, a statistician in the center’s division of elementary and secondary education statistics.

Both the National Education Longitudinal Survey of 1988 and the National Assessment of Educational Progress survey teachers and principals to determine the emphasis and amount of time they devote to particular topics, she noted.

In addition, the center is also planning a new study of school quality that will also attempt to measure opportunity to learn. The study, scheduled to be piloted next year, is expected to include both qualitative and quantitative methods to get inside the “black box’’ and find out what happens inside classrooms.

States and districts are using testing programs to determine students’ opportunity to learn, the researchers said.

The California Learning Assessment System, a revamped statewide testing program that will be administered this spring, will ask students if they have been taught in ways that enable them to answer the open-ended math questions on the assessment, according to Mr. Burstein.

The Los Angeles school system, meanwhile, has developed a new testing program that offers insight into instructional practices, said Trudy D. Wasney, a research adviser in the district’s program-evaluation and assessment branch.

The program, part of a five-year, $9 million project to boost student achievement in 10 historically low-achieving schools, tests students every eight weeks on exams that are aligned with instructional objectives.

“The tests monitor, in effect, the degree to which students had been exposed to grade-level objectives, and how well they had been taught,’' Ms. Wasney explained.

But despite such efforts, measures of opportunity to learn are relatively rare, Ms. Stevens said.

A survey conducted by Ms. Stevens of research directors of 91 large school districts found that the concept was “virtually unknown.’'

In addition, developing valid measures poses a number of problems, Ms. Peak said. Citing a study of teachers of Chapter 1 students conducted by researchers from the Johns Hopkins University, Ms. Peak noted that teachers may say they have taught something even if they have not.

A version of this article appeared in the April 28, 1993 edition of Education Week as Researchers Seek To Measure ‘Opportunity’ Standards

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Data Webinar
Education Insights with Actionable Data to Create More Personalized Engagement
The world has changed during this time of pandemic learning, and there is a new challenge faced in education regarding how we effectively utilize the data now available to educators and leaders. In this session
Content provided by Microsoft
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Accelerate Learning with Project-Based Learning
Earlier this year, the George Lucas Educational Foundation released four new studies highlighting how project-based learning (PBL) helps accelerate student learning—across age groups, multiple disciplines, and different socio-economic statuses. With this year’s emphasis on unfinished
Content provided by SmartLab Learning
School & District Management Live Online Discussion Principal Overload: How to Manage Anxiety, Stress, and Tough Decisions
According to recent surveys, more than 40 percent of principals are considering leaving their jobs. With the pandemic, running a school building has become even more complicated, and principals' workloads continue to grow. If we

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education California Makes Ethnic Studies a High School Requirement
California is among the first in the nation to require students to take a course in ethnic studies to get a diploma starting in 2029-30.
4 min read
FILE - In this Jan. 22, 2020, file photo, Democratic Assembly members, from left, James Ramos, Chris Holden Jose Medina, and Rudy Salas, Jr., right, huddle during an Assembly session in Sacramento, Calif. Medina's bill to make ethnic studies a high school requirement was signed into law by California Gov. Gavin Newsom on Friday, Oct. 8, 2021. (AP Photo/Rich Pedroncelli, File)
Education California Requires Free Menstrual Products in Public Schools
The move comes as women’s rights advocates push nationwide for affordable access to pads, tampons, and other items.
1 min read
Tammy Compton restocks tampons at Compton's Market, in Sacramento, Calif., on June 22, 2016. California public schools and colleges must stock their restrooms with free menstrual products under a new law signed by Gov. Gavin Newsom, Friday, Oct. 8, 2021.
Tammy Compton restocks tampons at Compton's Market, in Sacramento, Calif., on June 22, 2016. California public schools and colleges must stock their restrooms with free menstrual products under a new law signed by Gov. Gavin Newsom, Friday, Oct. 8, 2021.
Rich Pedroncelli/AP
Education Florida to Dock School District Salaries for Requiring Masks
Florida is set to dock salaries and withhold funding from local school districts that defied Gov. Ron DeSantis' ban on mask mandates.
2 min read
Florida Gov. Ron DeSantis speaks, Tuesday, Sept. 14, 2021, at the Doral Academy Preparatory School in Doral, Fla.
Florida Gov. Ron DeSantis speaks, Tuesday, Sept. 14, 2021, at the Doral Academy Preparatory School in Doral, Fla.
Wilfredo Lee/AP
Education More Than 120,000 U.S. Kids Had Caregivers Die During Pandemic
The toll has been far greater among Black and Hispanic Americans, a new study suggests.
3 min read
FILE - In this Thursday, Sept. 2, 2021 file photo, a funeral director arranges flowers on a casket before a service in Tampa, Fla. According to a study published Thursday, Oct. 7, 2021, by the medical journal Pediatrics, the number of U.S. children orphaned during the COVID-19 pandemic may be larger than previously estimated, and the toll has been far greater among Black and Hispanic Americans. (AP Photo/Chris O'Meara, File)