Maryland PARCC Scores Higher on Paper; Students’ Tech Readiness a Major Factor

By Benjamin Herold — February 23, 2016 4 min read
  • Save to favorites
  • Print

Add Maryland to the list of states to find that students tended to score better when taking the 2014-15 PARCC exams on paper instead of by computer.

Paper results in the state were higher than online results for every tested grade in English/language arts and on higher-level math exams, according to an analysis prepared by the state department of education and presented to the state board of education Tuesday.

Differences between the student populations who took the exams via different modes of administration accounted for a portion of the score discrepancies, according to the analysis. But a bigger factor was students’ readiness for the technology platform, including developing extended written responses on a computer and responding to multimedia content.

“A lot of this has to do with getting our instruction on board [with the new tests and Common Core State Standards they are meant to assess] and making students more aware of what’s required for an adequate response,” said Doug Strader, the assessment director for the Maryland education department, in an interview.

Those findings echo a pattern of score discrepancies by mode of administration found across the multi-state Partnership for the Assessment of Readiness for College and Careers, one of two consortia to develop and administer last year new tests aligned with the common core. The apparent mode-of-administration effect was first reported by Education Week earlier this month.

Colorado, Illinois, and Rhode Island have found similar patterns within their states. The Baltimore County schools, one of the largest districts in Maryland, also found such a pattern, then used statistical techniques to isolate the impact of testing format. The district found that after controlling for student and school characteristics, students were between 3 percent and 9 percent more likely to score proficient on the paper-and-pencil version of the math exam, depending on their grade level. Students were 11 percent to 14 percent more likely to score proficient on the paper version of the E/LA exam.

According to the new analysis from the Maryland education department, 80 percent of the more than 876,000 Maryland students who took the PARCC exams last spring did so online.

In math, the advantage for paper-based test-takers was most pronounced on upper-grade and higher-level tests, such as 8th grade math and Algebra I and II. About 55 percent of students who took the Algebra I exam on paper scored proficient or advanced, for example, compared to fewer than 30 percent of those who took the exam online.

The advantage for paper-based test-takers was found in every grade (3-8 and 10) on the English/language arts exam. Among 4th graders, for example, just over 50 percent of students who took the E/LA test on paper scored proficient or advanced, compared to fewer than 40 percent of those who took the exam online.

Paper-best test-takers tended to be higher-performing on previous state exams, a difference that accounted for about 40 percent of the discrepancy between paper and online results on this year’s PARCC. African-American students, English-language learners, students from low-income families, and students with disabilities did not appear to be significantly disproportionately affected, according to Strader.

And there was “no evidence of technical flaws in the development, administration, scoring, or reporting of the assessment,” according to the state analysis.

That leaves student readiness for technology as the biggest factor explaining the score discrepancies. In other words, scores in some cases reflected not what students know and are able to do, but their familiarity and capabilities with the computer-based platform on which the test was administered.

Test items that required more involved responses—for example, developing a longer written response to be entered via computer—appeared to be the biggest problem in the online version of the exams, according to the state report.

“Through informal discussions with test-takers of both modes, there was a common theme of not knowing what was expected to score well on the extended response items [via computer],” according to the report. “Students shared that they would default to the size of the response box to better determine how much was enough.”

Students also described having little experience “developing extended responses from start to finish with the use of technology,” according to the report.

Several states have dropped the PARCC exams since last school year, but the overall push for more online testing appears to be moving forward unabated.

Maryland schools will again administer the PARCC exams, during a 30-day window between April 4 and June 10. The state expects the test to be fully online by next school year, with the exception of students who require an accommodation.

Like many states, Maryland has delayed using the results of PARCC exams for high stakes, such as student graduation or teacher evaluation, during the transition.

Photo: A student at Marshall Simonds Middle School in Burlington, Mass., reviews a question on a PARCC practice test before 2014 field-testing of the computer-based assessments.--Gretchen Ertl for Education Week-File

See also:

for the latest news on ed-tech policies, practices, and trends.

A version of this news article first appeared in the Digital Education blog.

Commenting has been disabled on effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Evaluating Equity to Drive District-Wide Action this School Year
Educational leaders are charged with ensuring all students receive equitable access to a high-quality education. Yet equity is more than an action. It is a lens through which we continuously review instructional practices and student
Content provided by BetterLesson

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Standards Opinion How the Failure of the Common Core Looked From the Ground
Steve Peha shares insights from his on-site professional-development work about why the common core failed, in a guest letter to Rick Hess.
4 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards Opinion Common Core Is a Meal Kit, Not a Nothingburger
Caroline Damon argues Rick Hess and Tom Loveless sold the common core short, claiming the issue was a matter of high-quality implementation.
5 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards How New Common Core Research Connects to Biden's Plans for Children and Families
A study of national test scores indicate the early phase of the Common Core State Standards did not help disadvantaged students.
5 min read
results 925693186 02
Standards Opinion After All That Commotion, Was the Common Core a Big Nothingburger?
The Common Core State Standards may not have had an impact on student outcomes, but they did make school improvement tougher and more ideological.
3 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty