Assessment

Girls Edge Out Boys on National Technology Assessment

By Jaclyn Zubrzycki — May 31, 2016 5 min read
  • Save to favorites
  • Print

On the first national assessment of technology and engineering skills, 8th grade girls scored higher on average than 8th grade boys, while suburban and rural students significantly outscored their peers in cities.

But those gaps were significantly smaller than the familiar gaps between wealthier students and their less-affluent peers, and among racial and ethnic groups, that often crop up on national assessments in other subject areas.

The technology and engineering results come from the first new test in a decade from the National Assessment of Educational Progress, also known as NAEP or the “nation’s report card.” The Technology and Engineering Literacy exam, or TEL, was piloted in 2013 and administered to 21,500 students in approximately 840 public and private schools around the country in 2014.

Average Scores by Race/Ethnicity

BRIC ARCHIVE

SOURCE: National Center for Education Statistics

The test was designed to give educators and policymakers a glimpse of students’ skills in what William Bushaw, the executive director of the National Assessment Governing Board, which sets policy for NAEP, referred to as the “T and E in STEM.”

In addition to gauging problem-solving skills, the new test also surveyed students about their in- and out-of-school experiences with technology, engineering, and problem-solving.

The TEL is a harbinger of elements to come in future NAEP exams. Rather than answering a series of multiple-choice questions or writing essays, the 8th grade test-takers worked through a series of virtual scenarios aimed at testing their problem-solving abilities and their ability to use information about technology and engineering. Officials said similar scenarios would likely appear on NAEP in the future. The test was also the first entirely digital NAEP. The National Center for Education Statistics, which administers Naep, plans to administer all its tests digitally by 2017. The NCES avoided some of the technical difficulties that have plagued other computer-based tests by bringing its own Internet service and devices into schools, according to Peggy Carr, the NCES acting commissioner.

Insights From Home and School

Overall, 43 percent of the tested 8th graders scored proficient or above on the test. These results will be a benchmark for future administrations of the TEL. (The next is slotted for 2018 and also will be given only to 8th graders.)

Higher-Performing Students Were More Likely to Engage In Technology and Engineering Activities In and Out of School

BRIC ARCHIVE

SOURCE: National Center for Education Statistics

Carr drew attention to the fact that 45 percent of female students scored proficient or advanced on the test, compared to 42 percent of their male peers. Carr said that made a strong case that “girls are better able to understand and evaluate technology and then use it to solve problems and achieve goals.” On a call with reporters, she said the results counter conventional skepticism about the technology skills of girls and women.

Other observers said such results shouldn’t come as a shock. Stacie Gregory, a research fellow at the American Association of University Women who has studied women in engineering, noted, for example, that while girls and women are underrepresented in top STEM classes and fields, research shows that “the reasons they leave have very little to do with academic performance.”

“It’s often social pressures,” she said.

Jack Buckley, the senior vice president for research at the College Board and a former NCES commissioner, noted that girls had outscored boys on a 2009 NAEP science test that involved simulated tasks. He said the complexity of the TEL scenarios also makes it difficult to determine exactly what skills were being measured. The TEL included questions on everything from information and communication technology to the role of technology in society.

In and Out Of School

The breakdown by geographic area also yielded striking differences in scores: Suburban and rural students scored a full 10 and 8 scale-score points higher on average than students in cities (154 and 152 out of 300, compared to 144 for urban students).

But gaps between socioeconomic and racial groups outstripped the gender and geographic differences: More-affluent students scored 28 points higher on average than lower-income students (163 points out of 300, compared to 135). And while Asian and white students scored 160 points on average, the average Latino student scored 138 points and the average black student, 128 points.

NAGB’s Bushaw said that when considering gaps between other groups of students, it is also worth exploring “gaps of opportunity” for students.

According to the results, 48 percent of students were not taking any technology, computer, engineering, or industrial technology course. But about two-thirds said they had studied the topics in science class.

Many students reported out-of-school experiences in problem-solving: Eighty-seven percent of students said that they had at some point figured out what was wrong with something in order to fix it. Two-thirds said that what they knew about problem-solving and fixing things had been taught by family members, not at school.

And students who had regular out-of-school experiences with learning about technology had higher scores overall, the report notes.

The National Assessment Governing Board spent more than two years developing a framework for what kinds of skills and abilities should be tested in a technology and engineering test. The framework focused on three main topics: technology and society; design and systems; and information and communication technology.

As they take the test, students work through multistep scenarios that range from creating a historically accurate museum exhibit about a drought to developing safe bike lanes. Students are provided with background knowledge before they are asked to complete the task, and are scored separately on each step.

Not everyone has confidence in the new approach to test design, though. Tom Loveless, a senior fellow with the nonprofit Brookings Institution, said he is skeptical of a test that tries to measure skills like problem-solving outside of a particular discipline.

“I question the value of what it’s measuring, … and I wonder if they’re measuring what they think they’re measuring,” he said.

Carr said the NCES plans to introduce similar scenario-based tasks on its other exams in the near future; the first is likely to be in social studies or history.

A version of this article appeared in the June 01, 2016 edition of Education Week as Girls Outperform Boys On First National Test Of Tech, Engineering

Events

Jobs October 2021 Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Data Webinar
Using Integrated Analytics To Uncover Student Needs
Overwhelmed by data? Learn how an integrated approach to data analytics can help.

Content provided by Instructure
Classroom Technology Webinar How Pandemic Tech Is (and Is Not) Transforming K-12 Schools
The COVID-19 pandemic—and the resulting rise in virtual learning and big investments in digital learning tools— helped educators propel their technology skills to the next level. Teachers have become more adept at using learning management

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Data Young Adolescents' Scores Trended to Historic Lows on National Tests. And That's Before COVID Hit
The past decade saw unprecedented declines in the National Assessment of Educational Progress's longitudinal study.
3 min read
Assessment Long a Testing Bastion, Florida Plans to End 'Outdated' Year-End Exams
Florida Gov. Ron DeSantis said the state will shift to "progress monitoring" starting in the 2022-23 school year.
5 min read
Florida Governor Ron DeSantis speaks at the opening of a monoclonal antibody site in Pembroke Pines, Fla., on Aug. 18, 2021.
Florida Gov. Ron DeSantis said he believes a new testing regimen is needed to replace the Florida Standards Assessment, which has been given since 2015.
Marta Lavandier/AP
Assessment Spotlight Spotlight on Assessment in 2021
In this Spotlight, review newest assessment scores, see how districts will catch up with their supports for disabled students, plus more.
Assessment 'Nation's Report Card' Has a New Reading Framework, After a Drawn-Out Battle Over Equity
The new framework for the National Assessment of Educational Progress will guide development of the 2026 reading test.
10 min read
results 925693186 02
iStock/Getty