School Choice & Charters Letter to the Editor

Charter Quality’s the Issue, Not Research Methods

September 22, 2009 1 min read
  • Save to favorites
  • Print

To the Editor:

Your recent online Commentary by Jeanne Allen of the Center for Education Reform (“Charter Laws and Flawed Research,” Sept. 8, 2009) perpetuates a misconception she has about the compositions of “virtual twins” that were used in a report by Stanford University’s Center for Research on Education Outcomes, “Multiple Choice: Charter School Performance in 16 States.”

While Ms. Allen has a distinguished record of advocacy for rigorous and fair study of charter school effectiveness, her continued insistence that the control populations used in the credo study are somehow mythic fabrications does a disservice to the quality of the work and detracts from the important findings that emerge. I write to set the record straight.

Our technique for creating control records collects all the students who attend the traditional public schools from which a given charter school typically gets its students. These students are real students, with real socioeconomic and demographic attributes, and with known past test scores. Then, for each charter school student in our sample, we identify all the traditional public school students who match that student on personal characteristics and on past test scores.

So for one real charter school student with a given past test score, we have multiple real students from traditional schools who look just like the student, including prior performance.

We then gather the subsequent test scores for all the students. Since the traditional public school students are now likely to have a range of subsequent scores, rather than select a single student to serve as the match, we average all the subsequent test scores. It is at this point that “virtual” takes over. We create a single record from the matched traditional schools’ students that includes the set of personal attributes (identical across all the records), prior test performance (identical across all the records), and the average of the real subsequent test experience. This “virtual twin” is very real.

I hope this explanation ends the confusion about the methods used in the study and opens the way to a clearer focus on the important issue of charter school quality.

Margaret E. Raymond


Center for Research on Education Outcomes

Stanford University

Stanford, Calif.

Related Tags:

A version of this article appeared in the September 23, 2009 edition of Education Week as Charter Quality’s the Issue, Not Research Methods


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Classroom Technology Webinar
Academic Integrity in the Age of Artificial Intelligence
As AI writing tools rapidly evolve, learn how to set standards and expectations for your students on their use.
Content provided by Turnitin
Recruitment & Retention Live Online Discussion A Seat at the Table: Chronic Teacher Shortage: Where Do We Go From Here?  
Join Peter DeWitt, Michael Fullan, and guests for expert insights into finding solutions for the teacher shortage.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Reading & Literacy Webinar
The Science of Reading: Tools to Build Reading Proficiency
The Science of Reading has taken education by storm. Learn how Dr. Miranda Blount transformed literacy instruction in her state.
Content provided by hand2mind

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School Choice & Charters Charter School Governance Shapes Those Schools’ Approach to Equity
New research finds that the entities governing charters influence the schools' commitment to equity.
5 min read
Young students file back into school at Somerset Academy Charter South Miami, Thursday, Dec. 8, 2022, in South Miami, Fla.
Students head back to their classrooms at Somerset Academy charter school in Miami in December.
Rebecca Blackwell/AP
School Choice & Charters Q&A Voucher Programs Gain Strength With Help From the Courts, An Expert Says
A school choice expert explains how recent rulings could prevent future voucher programs from getting blocked by opponents.
8 min read
Group of white paper planes going in one direction on a light blue background with one individual red paper plane heading in a different direction
School Choice & Charters Charter School Enrollment Holds Steady After Big Early Pandemic Growth
The numbers show that most students who left their district schools in the first year of the pandemic did not return.
2 min read
Image of an empty classroom.
School Choice & Charters Federal Funding and Charter School Closures: What the Latest Government Data Show
The Government Accountability Office examined closure rates over 15 years and $2.5 billion of federal funding.
2 min read
Illustration of weighing funding against schools remaining open
DigitalVision Vectors/Getty