Special Report
College & Workforce Readiness

Student Surveys Seen as Imperfect Engagement Measure

By Holly Kurtz — June 02, 2014 3 min read
  • Save to favorites
  • Print

Schools have been using student surveys for decades. But in recent years, increasing interest in student engagement has led to increasing interest in this classic method of assessing belonging, enjoyment, attachment, investment, perseverance, and other assets.

In 2011, the Regional Educational Laboratory Southeast, which was run at the time by the SERVE Center at the University of North Carolina, Greensboro, produced a report listing 21 different survey instruments designed to measure the engagement of upper-elementary and secondary school students.

This is not to say that all of the measures are widely used or useful.

“Most districts have run surveys and haven’t found them very useful,” said Aaron Feuer, the CEO of Panorama Education, a Boston-based data-analytics startup that raised $4 million in seed money last year from Facebook founder Mark Zuckerberg’s Startup:Education and other investors.

Surveys don’t necessarily measure what they purport to assess. For example, student course evaluations, a standard and much-criticized fixture of higher education, might be used to assess teaching though they really measure whether students like the instructor, Mr. Feuer suggested.

“Great teaching is not a popularity contest,” he said.

An additional obstacle is that districts often receive results in the form of one enormous data table that is difficult to interpret. As a result, the reports get thrown into a drawer and forgotten.

Panorama addresses that challenge by providing users with individualized, online reports that permit them to break down the results in a variety of ways. For example, The Colorado Education Initiative, a Denver-based nonprofit that collaborates with the state education department and districts and developed a free, publicly available student survey, contracted with Panorama to create reports for Colorado Student Perception Survey that permit teachers to explore results by class period, survey question, student subgroup, and other categories.

The company has developed and distributed surveys in more than 5,000 schools. Clients have included the Los Angeles school district, the Connecticut state education department, and Aspire, which manages 37 publicly funded, independently operated charter schools.

Other Efforts

The Cambridge, Mass.-based Tripod Project for School Improvement, now more than a decade old, developed another survey that is widely used to measure student engagement and evaluate teachers. The survey was administered to more than 1 million students last year.

As part of a three-part series on student surveys presented by the Washington-based nonprofit American Youth Policy Forum in 2013 and 2014, Pittsburgh Science and Technology Academy teacher Paul Ronevich said that Tripod helped him improve his instruction by providing specific feedback and permitting him to compare himself with others.

Although surveys may be widely used measures of student engagement, one place where they have failed to take hold is in the accountability systems proposed by states under waivers from the federal No Child Left Behind law. Nearly every state has received a waiver, but only a handful, including New Mexico and South Dakota, have used the opportunity for additional flexibility to incorporate student surveys into accountability measures.

During the American Youth Policy Forum session, Elaine Allensworth, the director of the University of Chicago Consortium on Chicago School Research, shed light on some of the difficulties in publicizing and attaching stakes to surveys. She drew on her experiences with the Chicago 5 Essentials Survey, a survey of students and teachers developed by the consortium to gauge school effectiveness. Although used since 1997, the results were not publicly released until 2009. Consortium researchers worried the publicity would lead principals to game the system by encouraging higher ratings, thus compromising the survey’s validity. However, Ms. Allensworth concluded that the publicity instead led to improvements in the schools.

Coverage of school climate and student behavior and engagement is supported in part by grants from the Atlantic Philanthropies, the NoVo Foundation, the Raikes Foundation, and the California Endowment. Education Week retains sole editorial control over the content of this coverage.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Recruitment & Retention Webinar
Substitute Teacher Staffing Simplified: 5 Strategies for Success
Struggling to find quality substitute teachers? Join our webinar to learn key strategies to keep your classrooms covered and students learning.
Content provided by Kelly Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
AI in Education: Empowering Educators to Tap into the Promise and Steer Clear of Peril
Explore the transformative potential of AI in education and learn how to harness its power to improve student outcomes.
Content provided by Panorama Education
English Learners Webinar Family and Community Engagement: Best Practices for English Learners
Strengthening the bond between schools and families is key to the success of English learners. Learn how to enhance family engagement and support student achievement.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

College & Workforce Readiness Can the AP Model Work for CTE? How the College Board Is Embracing Career Prep
The organization known for AP courses and the SAT is getting more involved in helping students explore potential careers.
5 min read
David Coleman, CEO of the College Board, speaks at the organization's annual conference in Austin, Texas, on Oct. 21, 2024.
David Coleman, CEO of the College Board, speaks at the organization's annual conference in Austin, Texas, on Oct. 21, 2024. Long an institution invested in preparing students for college, the College Board increasingly has an eye on illuminating career options.
Ileana Najarro/Education Week
College & Workforce Readiness The Way Schools Offer CTE Classes Is About to Change. Here's How
The revision could lead to significant shifts in the types of jobs schools highlight, and the courses students are able to take.
4 min read
Photo of student working with surveying equipment.
E+
College & Workforce Readiness Even in Academic Classes, Schools Focus on Building Students' Workforce Skills
Schools work on meeting academic standards. What happens when they focus on different sets of skills?
11 min read
Students participate in reflections after a day of learning in Julia Kromenacker’s 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky. on Wednesday, October 16, 2024.
Students participate in reflections after a day of learning in Julia Kromenacker’s 3rd grade classroom at Old Mill Elementary School in Mt. Washington, Ky., on Wednesday, Oct. 16, 2024. The Bullitt County district that includes Old Mill Elementary has incorporated a focus on building more general life skills, like collaboration, problem-solving, and communication, that community members and employers consistently say they want from students coming out of high school.
Sam Mallon/Education Week
College & Workforce Readiness Preparing for the Workforce Can Start as Early as 1st Grade. What It Looks Like
Preparing students for college and career success starts well before high school—and it doesn’t only involve occupation-specific training.
5 min read
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps her student Lucas Joiner on an online learning assignment on Wednesday, October 16, 2024.
Jenna Bray, a 1st grade teacher at Old Mill Elementary School in Mt. Washington, Ky., helps student Lucas Joiner on an online learning assignment on Wednesday, Oct. 16, 2024. The Bullitt County district, which includes Old Mill Elementary, has incorporated a focus on equipping students with more general life skills—like communication, critical thinking, and problem-solving—that employers and community members consistently say they want from students coming out of high school.
Sam Mallon/Education Week