Federal

Ed. Dept. Releases Guide for Evaluating Online Learning

By Andrew Trotter — July 02, 2008 3 min read

The U.S. Department of Education today released its first guide to the evaluation of online-learning programs in K-12 education.

The report is designed to help school leaders gauge the effectiveness of online education, as its use grows rapidly across the United States.

“While online-learning programs that deliver courses have been around for about a decade, this report is the first to fully address the issues in evaluating online programs in K-12 education,” said Susan D. Patrick, the president and chief executive officer of the North American Council for Online Learning, or NACOL, which released its own standards for online programs earlier this year. (“Voluntary Online-Teaching Standards Come Amid Concerns Over Quality,” March 5, 2008)

School districts are turning to online courses, complete grade-level and degree-granting programs, and instructional resources to address missions ranging from Advanced Placement or specialized instruction, to “credit recovery” and alternative education, to providing supplementary resources to teachers and students in regular classrooms. Individual students and private and charter schools are also procuring online learning, often with public funding.

But evaluation methods have lagged far behind the swift growth, varied application, and complex nature of online learning.

“Online [education] adds a number of unique elements—in some cases, we need to build new instruments,” said Timothy J. Magner, the director of the Education Department’s office of technology.

Mr. Magner was here attending the National Educational Computing Conference, where he was to speak about evaluation issues today as part of a panel discussing the report.

Different Evaluations Needed

He noted, for example, that an online course that has students at many different locations raises the question of what are the best types of data collection for measuring a program’s performance. Using online surveys for a widely dispersed population might be most convenient, but it may not be accurate, because technology and supervision and other conditions might vary widely as well; site visits might even be necessary sometimes.

The diverse goals of online instruction also call for different kinds of evaluations, Mr. Magner said.

The contractor that prepared the report, WestEd Inc., based in San Francisco, analyzed seven recent evaluations that were seen to be models of the types of studies needed for online programs and instructional resources. The evaluations were of Alabama Connecting Classrooms, Educators, & Students Statewide Distance Learning; Algebra 1 Online; the Appleton eSchool; the Arizona Virtual Academy; the Chicago Public Schools Virtual Academy; Digital Learning Commons; and Thinkport.

Descriptions and lessons from those evaluations form the heart of the 68-page report.

“The standards for evaluating online resources are different than the more comprehensive criteria that is needed to evaluate an online program, such as a virtual school within a state or district that offers a full course and provides a highly qualified teacher through online teaching,” said Ms. Patrick, who was Mr. Magner’s predecessor as the adviser on educational technology to U.S. Secretary of Education Margaret Spellings.

Ms. Patrick of NACOL, based in Vienna, Va., said she made suggestions based on a draft of the report, urging the department to separate the evaluation issues pertaining to complete online courses and online supplementary resources.

She said the report shows that the Education Department “is focused on research to inform practice, and supports the growth of the important innovation of online learning in K-12 schools.” She added that she hopes the department will publish the evaluation instruments used in the research, to make the report “scalable” for other school districts.

Events

Student Well-Being Webinar Boosting Teacher and Student Motivation During the Pandemic: What It Takes
Join Alyson Klein and her expert guests for practical tips and discussion on how to keep students and teachers motivated as the pandemic drags on.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
A Holistic Approach to Social-Emotional Learning
Register to learn about the components and benefits of holistically implemented SEL.
Content provided by Committee for Children
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
How Principals Can Support Student Well-Being During COVID
Join this webinar for tips on how to support and prioritize student health and well-being during COVID.
Content provided by Unruly Studios

EdWeek Top School Jobs

Customer Support Specialist, Tier 1
Portland, OR, US
Northwest Evaluation Association
Customer Support Specialist, Tier 1
Portland, OR, US
Northwest Evaluation Association
Customer Support Specialist, Tier 1
Portland, OR, US
Northwest Evaluation Association
Principal
Meredith, New Hampshire
Inter-Lakes School District

Read Next

Federal Biden Legal Team Steps Back From Trump Stance on Transgender Female Sports Participation
The Education Department's office for civil rights pulls a letter that said Connecticut's transgender-inclusive policy violates Title IX.
4 min read
Federal Congress Again Tries to Pass Eagles Act, Focused on School Shootings After Parkland
A group of bipartisan Congressional lawmakers is once again trying to get a law passed aimed at preventing school violence.
Devoun Cetoute & Carli Teproff
2 min read
Suzanne Devine Clark, an art teacher at Deerfield Beach Elementary School, places painted stones at a memorial outside Marjory Stoneman Douglas High School on Feb. 14, 2019 during the first anniversary of the school shooting in Parkland, Fla.
Suzanne Devine Clark, an art teacher at Deerfield Beach Elementary School, places painted stones at a memorial outside Marjory Stoneman Douglas High School on Feb. 14, 2019 during the first anniversary of the school shooting in Parkland, Fla.
Wilfredo Lee/AP
Federal Some Districts Extend Paid Leave Policies as They Hope for Passage of Biden Relief Plan
With federal provisions having expired, some school employees have had to dip into their own banks of leave for COVID-19 purposes.
5 min read
Linda Davila-Macal, a seventh grade reading teacher at BL Garza Middle School in Edinburg, Texas, works from her virtual classroom at her home on Aug. 31, 2020.
A teacher leads a virtual classroom from her home.
Delcia Lopez/The Monitor via AP
Federal President Biden Is Walking a 'Careful Tightrope' When It Comes to School Reopenings
CDC guidance and confusion over his rhetoric turn up the pressure, and could overshadow progress in schools and nuanced public opinion.
9 min read
President Joe Biden answers questions during a televised town hall event at Pabst Theater in Milwaukee on Feb. 16, 2021.
President Joe Biden answers questions during a televised town hall event in Milwaukee earlier this month.
Evan Vucci/AP