Special Report
College & Workforce Readiness

Data Mining Opens Window on Student Engagement

By Holly Kurtz — June 02, 2014 2 min read
  • Save to favorites
  • Print

Ask students if they always try their hardest in class, and they might say “yes” because that’s what their mother told them to do. Or maybe if the students are a little older, they say “never,” because they are trying on a carefree attitude to impress their friends.

Those are just some of the problems that researchers encounter when they try to measure engagement by surveying students about themselves.

Enter educational data mining. Long used in business settings, the practice is newer to education. It involves using strings of data collected during computerized instruction to identify patterns. Once identified, the patterns can then be used to improve the instruction by, for instance, eliminating a scenario in which students tend to lose interest and stop playing an educational game. The strategy can be used to track when and why students might be off task and to draw broader conclusions about different aspects of instruction, including learner engagement.

For instance, for a study that appeared last year in the peer-reviewed Journal of Educational Data Mining, Jennifer Sabourin, then a doctoral student at North Carolina State University, and her colleagues analyzed data from “Crystal Island,” a computer game that teaches middle school students about microbiology. Based on that data, the researchers were able to tell when students were playing the game as intended and when they seemed to be disengaged because they were indulging in off-task behavior like climbing trees to reach virtual rooftops. As expected, the researchers found that students who were frequently off task learned less.

But the game had another feature that led to a more unexpected conclusion: Every seven minutes, a box popped up onscreen asking students to classify their emotional states. That led researchers to discover that off-task behavior seemed to help some students collect themselves when they got frustrated. After playing around a bit, their frustration lessened and they returned to the game.

Tool for Program Evaluation

Besides its use in studying or assessing the engagement of individual students, data mining can also be a tool for ongoing program or course evaluation. In a 2012 article published in the peer-reviewed journal, Educational Technology & Society, a research team led by Jui-Long Hung, an associate professor of educational technology at Boise State University in Idaho, demonstrated how this might work. The team combined student learning logs, demographic data, and end-of-course evaluation surveys to assess a supplemental, online learning program for K-12 students. The data included information from 7,539 students taking 883 courses in the program. The researchers created an engagement index that assessed how students interacted with each course that included the frequency of logins and clicks and the average number of discussion-board entries. After combining these results with other information, such as students’ grades, the researchers found that more-engaged students got better grades. But in the entry-level courses, engaged and disengaged students alike had lower performance, leading researchers to suggest that these courses might have “structure, design, and/or support issues.”

In their report, Mr. Hung and his co-authors tout the benefits of combining data mining with other information to evaluate engagement. “The result is a much richer and deeper analysis of student performance and teaching, as well as of effective course design, than could ever be accomplished with survey data or behavior mining alone,” they write.

Coverage of school climate and student behavior and engagement is supported in part by grants from the Atlantic Philanthropies, the NoVo Foundation, the Raikes Foundation, and the California Endowment. Education Week retains sole editorial control over the content of this coverage.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
(Re)Focus on Dyslexia: Moving Beyond Diagnosis & Toward Transformation
Move beyond dyslexia diagnoses & focus on effective literacy instruction for ALL students. Join us to learn research-based strategies that benefit learners in PreK-8.
Content provided by EPS Learning
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Cohesive Instruction, Connected Schools: Scale Excellence District-Wide with the Right Technology
Ensure all students receive high-quality instruction with a cohesive educational framework. Learn how to empower teachers and leverage technology.
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
How to Use Data to Combat Bullying and Enhance School Safety
Join our webinar to learn how data can help identify bullying, implement effective interventions, & foster student well-being.
Content provided by Panorama Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

College & Workforce Readiness How Should High School Change? These Districts May Have the Answer
By supporting learning that takes place outside the classroom, districts—and states—are starting to rethink an age-old institution.
12 min read
Image of a teacher drawing outside of the lines of a whiteboard.
<b>Katie Thomas for Education Week</b>
College & Workforce Readiness Interactive How Do Today’s High Schoolers Fare As They Enter Adulthood? View the Data
As graduation rates begin to stabilize, data show some hopeful signs for young people. But experts warn of a disconnect between high school, college, and careers.
9 min read
Student hanging on a tearing graduate cap tassel
DigitalVision Vectors/Getty
College & Workforce Readiness Students at This High School Do Internships. It's a Game Changer
A superintendent challenged his high school to get half of seniors engaged in learning outside the building. Students responded.
9 min read
Agnieszka Crownoever explains the surgical robot to intern Lutrell Kirk, an 18-year-old high school senior, at Northwest Health in Valparaiso, Ind., Tuesday, June 4, 2024.
Agnieszka Crownoever explains how a surgical robot works to intern Lutrell Kirk, an 18-year-old high school senior, at Northwest Health in Valparaiso, Ind., on June 4, 2024. Lutrell and other seniors are part of a program to give them hands-on experiences before graduation.
Eric Davis for Education Week
College & Workforce Readiness As Students Sought FAFSA Help, 4 Million Calls Went Unanswered
A new probe from Congress' investigative arm details what led to the failed rollout of a new federal financial aid form.
6 min read
Secretary of Education Miguel Cardona testifies during a House Committee on Education and Workforce hearing on Capitol Hill, Tuesday, May 7, 2024, in Washington.
Secretary of Education Miguel Cardona testifies during a House Committee on Education and Workforce hearing on Capitol Hill, Tuesday, May 7, 2024, in Washington. New reports from the Government Accountability Office detail what led up to the botched rollout of a new FAFSA form and the resulting fallout.
Mariam Zuhaib/AP