Opinion
School Choice & Charters Letter to the Editor

Charter Quality’s the Issue, Not Research Methods

September 22, 2009 1 min read
  • Save to favorites
  • Print

To the Editor:

Your recent online Commentary by Jeanne Allen of the Center for Education Reform (“Charter Laws and Flawed Research,” Sept. 8, 2009) perpetuates a misconception she has about the compositions of “virtual twins” that were used in a report by Stanford University’s Center for Research on Education Outcomes, “Multiple Choice: Charter School Performance in 16 States.”

While Ms. Allen has a distinguished record of advocacy for rigorous and fair study of charter school effectiveness, her continued insistence that the control populations used in the credo study are somehow mythic fabrications does a disservice to the quality of the work and detracts from the important findings that emerge. I write to set the record straight.

Our technique for creating control records collects all the students who attend the traditional public schools from which a given charter school typically gets its students. These students are real students, with real socioeconomic and demographic attributes, and with known past test scores. Then, for each charter school student in our sample, we identify all the traditional public school students who match that student on personal characteristics and on past test scores.

So for one real charter school student with a given past test score, we have multiple real students from traditional schools who look just like the student, including prior performance.

We then gather the subsequent test scores for all the students. Since the traditional public school students are now likely to have a range of subsequent scores, rather than select a single student to serve as the match, we average all the subsequent test scores. It is at this point that “virtual” takes over. We create a single record from the matched traditional schools’ students that includes the set of personal attributes (identical across all the records), prior test performance (identical across all the records), and the average of the real subsequent test experience. This “virtual twin” is very real.

I hope this explanation ends the confusion about the methods used in the study and opens the way to a clearer focus on the important issue of charter school quality.

Margaret E. Raymond

Director

Center for Research on Education Outcomes

Stanford University

Stanford, Calif.

Related Tags:

A version of this article appeared in the September 23, 2009 edition of Education Week as Charter Quality’s the Issue, Not Research Methods

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and K-12 education jubs at the EdWeek Top School Jobs virtual career fair.
Mathematics K-12 Essentials Forum Helping Students Succeed in Math
Student Well-Being Live Online Discussion A Seat at the Table: The Power of Emotion Regulation to Drive K-12 Academic Performance and Wellbeing
Wish you could handle emotions better? Learn practical strategies with researcher Marc Brackett and host Peter DeWitt.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School Choice & Charters Opinion The School Choice Landscape Is Shifting
What could two Supreme Court rulings—one recent and one impending—mean for educators and parents?
8 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
School Choice & Charters What the Research Says How School Choice Complicates District Bond Elections
Families who transfer children out of their residential districts may be less likely to vote in bond elections, researchers find.
3 min read
Photograph of a person in jeans walking on a sidewalk and passing a yellow and black voting place sign in the grass.
E+
School Choice & Charters What to Know About the Private School Choice Program Moving Through Congress
A new federal program would offer up to $5 billion in tax credits a year to fuel private school attendance nationwide.
10 min read
Penelope Koutoulas holds signs supporting school choice in a House committee meeting on education during a special session of the state legislature Tuesday, Jan. 28, 2025, in Nashville, Tenn.
Penelope Koutoulas holds signs supporting school choice in a House committee meeting on education during a special session of the state legislature Tuesday, Jan. 28, 2025, in Nashville, Tenn. While a number of states, including Tennessee, have passed new programs funding private school tuition in recent years, the first major federal foray into private school choice is now making its way through Congress.
George Walker IV/AP
School Choice & Charters Then & Now The Trump Admin. Is Reviving This School Choice Option You've Never Heard Of
A little-known provision allows students to transfer out of schools deemed "persistently dangerous." Choice advocates say it's been underused.
8 min read
Image of two school buildings with cones, cameras.
Collage by Liz Yap for Education Week via Canva