Student Well-Being

Accountability Measures for Traits Like ‘Grit’ Questioned

By Evie Blad — May 19, 2015 4 min read
  • Save to favorites
  • Print

Measurements of so-called noncognitive student traits like self-control, “grit,” and gratitude should not be used for school accountability or teacher-evaluation purposes, two pioneers in the field warned last week.

That’s not because those traits – which often fall under categories like social-emotional learning, character development, and 21st-century skills – aren’t important, said Angela Duckworth, a University of Pennsylvania associate professor of psychology known for her research on grit, and David Yeager, an assistant professor of developmental psychology at the University of Texas at Austin who focuses on growth mindsets.

However, since there are potential flaws in every existing method schools use to measure such traits and skills, they should not be used for high-stakes purposes, Ms. Duckworth and Mr. Yeager write in an essay published May 13 in Educational Researcher.

When tracking interventions designed to boost desirable nonacademic traits and skills in students, “perfectly unbiased, unfakeable, and error-free measures are an ideal, not a reality,” the essay concludes. “Instead, researchers and practitioners have at their disposal an array of measures that have distinct advantages and limitations.”

The researchers’ warning comes at a time when policymakers and educators have embraced a growing body of research that demonstrates how promoting noncognitive qualities can boost student success both inside and outside the classroom.

With the drive to integrate a greater focus on traits like persistence, self-awareness, resilience, and empathy in schools has come a desire to measure those traits and to use those measurements for individual evaluation and school accountability. That’s where things get problematic, the researchers say.

Some schools have started including indicators like grit and gratitude on student report cards; policymakers have discussed including growth in students’ noncognitive skills in teacher evaluations; and some advocates have suggested using such measures for college admissions.

In California, a group of school districts has committed to incorporating social-emotional-learning measures into their school accountability systems as a condition of their waiver from the annual-progress requirements of the No Child Left Behind Act.

But as educators and policymakers seek practical applications for education improvement ideas developed by researchers in psychology, they should be thoughtful and cautious about how they proceed, Ms. Duckworth said in an interview.

“It’s like that Tolstoy quote: ‘Every unhappy family is unhappy in its own way,’ ” she said. “Every measure has its own way of being imperfect.”

The essay uses the example of measuring self-control to explore the advantages and weaknesses of three possible forms of measurement—self-reported questionnaires, teacher-reported questionnaires, and performance tasks.

In recent years, districts around the country have begun tracking student and teacher responses to questions about school climate, peer behavior, and personal attitudes, often cross-referencing the results with achievement data to look for trends. Such questionnaires have the advantages of being inexpensive and relatively easy to develop and administer.

Questions of Interpretation

But they also have limitations that may lead to unreliable results, Ms. Duckworth and Mr. Yeager caution. Among those limitations: Survey participants may interpret questions differently from what researchers intended; teachers may be limited in their ability to answer questions about student growth in internal traits, such as motivation; and surveys may fail to detect incremental changes.

In addition, reference –the comparative examples respondents use to gauge personal growth in some areas –may lead to different results from similar respondents.

“Current data and theory suggest schools that promote personal qualities most able –and raise the standards by which students and teachers at that school make comparative judgments—may show the lowest scores and be punished, whereas schools that are least effective may receive the highest scores and be rewarded for ineffectiveness,” the essay says.

Performance tasks, another way of measuring personal traits, include such exercises as the famous “marshmallow test,” in which students are allowed to choose between eating a small number of treats now or a bigger number if they wait for a period of time. The theory is that the students who delay gratification have more self-control.

But while the tasks themselves may seem like objective measures, the conclusions researchers draw from them are often subjective, and engineered tasks may not reflect how students would respond in real-life situations, the essay says.

Ms. Duckworth and Mr. Yeager aren’t suggesting that researchers and educators abandon efforts to measure students’ social, emotional, and character-based traits. Rather, they write, schools should exercise caution in selecting a measurement type and recognize its limitations.

“Given the advantages, limitations, and medium-term potential of such measures,” Ms. Duckworth and Mr. Yeager state, “our hope is that the broader educational community proceeds forward with both alacrity and caution, and with equal parts optimism and humility.”

Coverage of school climate and student behavior and engagement is supported in part by grants from the Atlantic Philanthropies, the NoVo Foundation, the Raikes Foundation, and the California Endowment. Education Week retains sole editorial control over the content of this coverage.
A version of this article appeared in the May 20, 2015 edition of Education Week as Accountability Measures for Traits Like ‘Grit’ Questioned

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Student Well-Being Weight-Loss Drugs Are the Talk of Social Media, and Teens Are Listening
Weight-loss drugs' popularity are feeding into the concerns that teenagers, particularly girls, have long had about body image.
5 min read
This image provided by Novo Nordisk in January 2023, shows packaging for the company's Wegovy medication. The popular weight-loss drug, which has helped millions of Americans shed pounds, can now be used to reduce the risk of stroke, heart attacks and other serious cardiovascular problems in patients who are overweight or who have obesity, the U.S. Food and Drug Administration said Friday, March 8, 2024.
The federal Food and Drug Administration in December 2022 approved Wegovy, an obesity treatment, for children as young as 12. Weight-loss drugs have been a popular topic of conversation on social media and teens have been paying attention, feeding into concerns <ins data-user-label="Matt Stone" data-time="03/18/2024 9:57:35 AM" data-user-id="00000185-c5a3-d6ff-a38d-d7a32f6d0001" data-target-id="">that </ins>adolescents, particularly girls, have long had about body image.
Novo Nordisk via AP
Student Well-Being Opinion School Sports Matter. How to Make Them Matter More
The skills we hope sports will teach are the very ones that help produce successful graduates and responsible citizens.
8 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Student Well-Being Death of Nonbinary Teen Nex Benedict After School Fight Is Ruled a Suicide, Medical Examiner Says
A summary autopsy report was released more than a month after the death of 16-year-old Nex Benedict.
2 min read
In this image provided by Malia Pila, Nex Benedict poses outside the family's home in Owasso, Okla., in December 2023. A recently released police search warrant reveals more details in the case of Nex Benedict, a nonbinary Oklahoma student who died a day after a high school bathroom fight that may have been prompted by bullying over gender identity.
In this image provided by Malia Pila, Nex Benedict poses outside the family's home in Owasso, Okla., in December 2023. A recently released police search warrant reveals more details in the case of Nex Benedict, a nonbinary Oklahoma student who died a day after a high school bathroom fight that may have been prompted by bullying over gender identity.
Sue Benedict via AP
Student Well-Being Opinion Talking About a Growth Mindset Isn’t Enough. Here’s What Makes a Difference for Students
Teachers can make structured changes that encourage students to challenge themselves.
Cameron Hecht
2 min read
Images shows a stylized artistic landscape with soothing colors.
Getty