Federal

Ed. Dept. Releases Guide for Evaluating Online Learning

By Andrew Trotter — July 02, 2008 3 min read
  • Save to favorites
  • Print

The U.S. Department of Education today released its first guide to the evaluation of online-learning programs in K-12 education.

The report is designed to help school leaders gauge the effectiveness of online education, as its use grows rapidly across the United States.

“While online-learning programs that deliver courses have been around for about a decade, this report is the first to fully address the issues in evaluating online programs in K-12 education,” said Susan D. Patrick, the president and chief executive officer of the North American Council for Online Learning, or NACOL, which released its own standards for online programs earlier this year. (“Voluntary Online-Teaching Standards Come Amid Concerns Over Quality,” March 5, 2008)

School districts are turning to online courses, complete grade-level and degree-granting programs, and instructional resources to address missions ranging from Advanced Placement or specialized instruction, to “credit recovery” and alternative education, to providing supplementary resources to teachers and students in regular classrooms. Individual students and private and charter schools are also procuring online learning, often with public funding.

But evaluation methods have lagged far behind the swift growth, varied application, and complex nature of online learning.

“Online [education] adds a number of unique elements—in some cases, we need to build new instruments,” said Timothy J. Magner, the director of the Education Department’s office of technology.

Mr. Magner was here attending the National Educational Computing Conference, where he was to speak about evaluation issues today as part of a panel discussing the report.

Different Evaluations Needed

He noted, for example, that an online course that has students at many different locations raises the question of what are the best types of data collection for measuring a program’s performance. Using online surveys for a widely dispersed population might be most convenient, but it may not be accurate, because technology and supervision and other conditions might vary widely as well; site visits might even be necessary sometimes.

The diverse goals of online instruction also call for different kinds of evaluations, Mr. Magner said.

The contractor that prepared the report, WestEd Inc., based in San Francisco, analyzed seven recent evaluations that were seen to be models of the types of studies needed for online programs and instructional resources. The evaluations were of Alabama Connecting Classrooms, Educators, & Students Statewide Distance Learning; Algebra 1 Online; the Appleton eSchool; the Arizona Virtual Academy; the Chicago Public Schools Virtual Academy; Digital Learning Commons; and Thinkport.

Descriptions and lessons from those evaluations form the heart of the 68-page report.

“The standards for evaluating online resources are different than the more comprehensive criteria that is needed to evaluate an online program, such as a virtual school within a state or district that offers a full course and provides a highly qualified teacher through online teaching,” said Ms. Patrick, who was Mr. Magner’s predecessor as the adviser on educational technology to U.S. Secretary of Education Margaret Spellings.

Ms. Patrick of NACOL, based in Vienna, Va., said she made suggestions based on a draft of the report, urging the department to separate the evaluation issues pertaining to complete online courses and online supplementary resources.

She said the report shows that the Education Department “is focused on research to inform practice, and supports the growth of the important innovation of online learning in K-12 schools.” She added that she hopes the department will publish the evaluation instruments used in the research, to make the report “scalable” for other school districts.

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and K-12 education jubs at the EdWeek Top School Jobs virtual career fair.
Mathematics K-12 Essentials Forum Helping Students Succeed in Math
Student Well-Being Live Online Discussion A Seat at the Table: The Power of Emotion Regulation to Drive K-12 Academic Performance and Wellbeing
Wish you could handle emotions better? Learn practical strategies with researcher Marc Brackett and host Peter DeWitt.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Opinion A D.C. Insider Explains What’s Changed in Education Policy
The biggest thing that people don’t understand about federal education policy? How much the details really matter.
7 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
Federal What Superintendents Think About a Steady Clip of Federal K-12 Changes
A state superintendent and two district leaders shared their thoughts on the latest changes coming from Washington.
4 min read
From left, Quentin J. Lee, superintendent of Talladega City Schools, Keith Konyk, superintendent of Elizabeth Forward School District, and Eric Mackey, Alabama's state superintendent of education, discuss the latest K-12 policy changes at the ISTELive 25 + ASCD Annual Conference 25 on July 2, 2025.
From left, Quentin J. Lee, superintendent of Talladega City Schools in Alabama; Keith Konyk, superintendent of Elizabeth Forward School District in Pennsylvania; and Eric Mackey, Alabama's state superintendent of education, discuss the latest K-12 policy changes at the ISTELive 25 + ASCD Annual Conference 25 on July 2, 2025.
Kaylee Domzalski/Education Week
Federal The Senate Passed a Federal Voucher Program. What's in It?
The measure would create a national program funding private school tuition through tax credits, though states would have to opt in.
7 min read
The Senate side of the Capitol is seen in Washington, early Monday, June 30, 2025, as Republicans plan to begin a final push to advance President Donald Trump's big tax breaks and spending cuts package.
The Senate side of the Capitol is seen in Washington early on June 30, 2025, hours before Republicans narrowly passed President Donald Trump's big tax breaks and spending cuts package. The bill includes the first major federal private school choice program.
J. Scott Applewhite/AP
Federal Senate Narrowly Passes Trump’s Big Tax Breaks and Spending Cuts Bill
The bill goes back to the House, where Speaker Mike Johnson warned off big revisions from his chamber’s version.
5 min read
Senate Majority Leader John Thune, R-S.D., center, joined from left by, Sen. John Barrasso, R-Wyo., the GOP whip, Finance Committee Chairman Mike Crapo, R-Idaho, and Budget Committee Chairman Lindsey Graham, R-S.C., speaks to reporters after passage of the budget reconciliation package of President Donald Trump's signature bill of big tax breaks and spending cuts, at the U.S. Capitol in Washington, D.C., on July 1, 2025.
Senate Majority Leader John Thune, R-S.D., center, joined from left by Sen. John Barrasso, R-Wyo., the GOP whip; Finance Committee Chairman Mike Crapo, R-Idaho; and Budget Committee Chairman Lindsey Graham, R-S.C., speaks to reporters after passage of the budget reconciliation package of President Donald Trump's signature bill of big tax breaks and spending cuts, at the U.S. Capitol on July 1, 2025. The bill includes the first major federal investment in a private school choice program.
J. Scott Applewhite/AP