Student Well-Being

Accountability Measures for Traits Like ‘Grit’ Questioned

By Evie Blad — May 19, 2015 4 min read
  • Save to favorites
  • Print

Measurements of so-called noncognitive student traits like self-control, “grit,” and gratitude should not be used for school accountability or teacher-evaluation purposes, two pioneers in the field warned last week.

That’s not because those traits – which often fall under categories like social-emotional learning, character development, and 21st-century skills – aren’t important, said Angela Duckworth, a University of Pennsylvania associate professor of psychology known for her research on grit, and David Yeager, an assistant professor of developmental psychology at the University of Texas at Austin who focuses on growth mindsets.

However, since there are potential flaws in every existing method schools use to measure such traits and skills, they should not be used for high-stakes purposes, Ms. Duckworth and Mr. Yeager write in an essay published May 13 in Educational Researcher.

When tracking interventions designed to boost desirable nonacademic traits and skills in students, “perfectly unbiased, unfakeable, and error-free measures are an ideal, not a reality,” the essay concludes. “Instead, researchers and practitioners have at their disposal an array of measures that have distinct advantages and limitations.”

The researchers’ warning comes at a time when policymakers and educators have embraced a growing body of research that demonstrates how promoting noncognitive qualities can boost student success both inside and outside the classroom.

With the drive to integrate a greater focus on traits like persistence, self-awareness, resilience, and empathy in schools has come a desire to measure those traits and to use those measurements for individual evaluation and school accountability. That’s where things get problematic, the researchers say.

Some schools have started including indicators like grit and gratitude on student report cards; policymakers have discussed including growth in students’ noncognitive skills in teacher evaluations; and some advocates have suggested using such measures for college admissions.

In California, a group of school districts has committed to incorporating social-emotional-learning measures into their school accountability systems as a condition of their waiver from the annual-progress requirements of the No Child Left Behind Act.

But as educators and policymakers seek practical applications for education improvement ideas developed by researchers in psychology, they should be thoughtful and cautious about how they proceed, Ms. Duckworth said in an interview.

“It’s like that Tolstoy quote: ‘Every unhappy family is unhappy in its own way,’ ” she said. “Every measure has its own way of being imperfect.”

The essay uses the example of measuring self-control to explore the advantages and weaknesses of three possible forms of measurement—self-reported questionnaires, teacher-reported questionnaires, and performance tasks.

In recent years, districts around the country have begun tracking student and teacher responses to questions about school climate, peer behavior, and personal attitudes, often cross-referencing the results with achievement data to look for trends. Such questionnaires have the advantages of being inexpensive and relatively easy to develop and administer.

Questions of Interpretation

But they also have limitations that may lead to unreliable results, Ms. Duckworth and Mr. Yeager caution. Among those limitations: Survey participants may interpret questions differently from what researchers intended; teachers may be limited in their ability to answer questions about student growth in internal traits, such as motivation; and surveys may fail to detect incremental changes.

In addition, reference –the comparative examples respondents use to gauge personal growth in some areas –may lead to different results from similar respondents.

“Current data and theory suggest schools that promote personal qualities most able –and raise the standards by which students and teachers at that school make comparative judgments—may show the lowest scores and be punished, whereas schools that are least effective may receive the highest scores and be rewarded for ineffectiveness,” the essay says.

Performance tasks, another way of measuring personal traits, include such exercises as the famous “marshmallow test,” in which students are allowed to choose between eating a small number of treats now or a bigger number if they wait for a period of time. The theory is that the students who delay gratification have more self-control.

But while the tasks themselves may seem like objective measures, the conclusions researchers draw from them are often subjective, and engineered tasks may not reflect how students would respond in real-life situations, the essay says.

Ms. Duckworth and Mr. Yeager aren’t suggesting that researchers and educators abandon efforts to measure students’ social, emotional, and character-based traits. Rather, they write, schools should exercise caution in selecting a measurement type and recognize its limitations.

“Given the advantages, limitations, and medium-term potential of such measures,” Ms. Duckworth and Mr. Yeager state, “our hope is that the broader educational community proceeds forward with both alacrity and caution, and with equal parts optimism and humility.”

Coverage of school climate and student behavior and engagement is supported in part by grants from the Atlantic Philanthropies, the NoVo Foundation, the Raikes Foundation, and the California Endowment. Education Week retains sole editorial control over the content of this coverage.
A version of this article appeared in the May 20, 2015 edition of Education Week as Accountability Measures for Traits Like ‘Grit’ Questioned

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Science of Reading: Emphasis on Language Comprehension
Dive into language comprehension through a breakdown of the Science of Reading with an interactive demonstration.
Content provided by Be GLAD
English-Language Learners Webinar English Learners and the Science of Reading: What Works in the Classroom
ELs & emergent bilinguals deserve the best reading instruction! The Reading League & NCEL join forces on best practices. Learn more in our webinar with both organizations.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Student Well-Being A Mental Health Screening Saved Students’ Lives in This District
A district that deployed a universal mental health screening was able to intervene immediately with five students who had suicide plans.
4 min read
Vector illustration of a counselor or psychologist holding a clipboard in one hand and an umbrella above in the other over an anxious woman who is tucking her head into her knees with a tangled line hovering above her head.
iStock/Getty
Student Well-Being Parents Worried About Their Kids' Mental Health See the Fix in New Schooling Options
Parents who say they are considering a change to their children's education identify mental health as a driving factor, a new report shows.
5 min read
Student walking down the stairs at her school.
iStock / Getty Images Plus
Student Well-Being Explainer More Students Are Getting Diabetes. Here's What That Means for the Classroom
More than a half million people under 20 could have the chronic health disorder by 2060, and they'll need support from schools.
8 min read
Conceptual image in blues: female student with diabetes wears glucose monitoring patch
E+/Getty
Student Well-Being Opinion One Thing Teachers Can Do to Signal High Expectations
There are constructive ways for teachers to communicate they believe in a student, a research scientist weighs in.
Camilla Mutoni Griffiths
1 min read
Images shows a stylized artistic landscape with soothing colors.
Getty