Reading & Literacy

Homegrown Tests Measure Core Critical-Reading Skills

By Lynn Olson — May 01, 2007 8 min read

Marcia L. Riddick, a 4th grade teacher at the F. Lyman Winship Elementary School here, remembers her initial skepticism about the new assessment tools developed by the nonprofit Boston Plan for Excellence.

“I just heard, ‘another test,’ ” she recalled. “I was thinking, would it be helpful? Was it for us or for the district?”

About This Series

    MAY 2

  • • Palm Readers:
    Teachers in a rural New Mexico district use hand-held computers to assess students’ reading progress and target instruction accordingly.
  • • Critical Thinking:
    Schools in Boston are gaining insight into their students’ thought processes through a locally developed reading-assessment system.

    MAY 9

  • • New Math:
    Teachers in a Texas school have shelved some of their math textbooks and turned to an online curriculum and formative-assessment resource instead.

    MAY 16

  • Teacher Training:
    A California center is using formative assessment to help beginning teachers reflect on and improve their own work and that of their students.

But today Ms. Riddick, who has taught for 11 years, is a convert. “This is a test that’s for teachers,” she said. “It guides our instruction.”

FAST-R, or Formative Assessments of Student Thinking in Reading, was developed by the BPE, a local education foundation, to provide teachers with information about what students are thinking when they try to find evidence and make inferences based on texts. Those two core reading skills are a central part of the state testing program, the Massachusetts Comprehensive Assessment System, or MCAS, and vital to youngsters’ ability to read for understanding.

“They’re not testing skills,” explained Lisa Lineweaver, a senior program officer at the foundation. “They’re core critical-reading skills. If a teacher is putting more time into teaching those, she’s going to be getting kids to be more proficient readers.”

In 2003, the Boston Plan for Excellence contracted with two doctoral students at Harvard University’s graduate school of education to develop the informal, no-stakes reading assessments. The spur came from the foundation’s work with a group of 25 principals who complained that, despite the large number of tests given in the school district, none of them helped improve instruction on a daily basis.

Piloted in 18 schools in the 2003-04 school year, with support from the Menlo Park, Calif.-based William and Flora Hewlett Foundation, FAST-R is now used in more than 50 schools in the 57,000-student Boston district.

No Fixed Test Dates

Each mini-assessment consists of a short reading passage, many drawn from released MCAS documents, followed by 10 multiple-choice questions and an open-response item.

The questions are designed to probe different types and levels of thinking, including whether students can identify evidence explicitly stated in the text, determine the implicit meaning from words in context, and gauge the meaning of a whole passage.

Students’ answers are scored as correct; a “near miss,” meaning the answer is true, based on the text, but irrelevant to the question; a “misread,” meaning it’s based on a misunderstanding of the text; or “out of bounds,” meaning it’s not based on the text but is plausible based on the student’s own prior knowledge.

A teacher receives a color-coded graph for an entire class that shows the pattern of students’ answers next to each question. The graph includes student-level data summaries that show how individual students and the whole class did across all the sets of questions, with information on each student’s race and gender, and whether the student is receiving special education or services for English-language learners.

We used to say, 'Oh, that child is a late bloomer or developmentally not ready.' Now it's more about what else can we do, what else can we try? You don't accept that children are just not going to get it.

Teacher’s guides to each of the total of 55 question sets for grades 3-12 also describe the difficulty of the reading passages in structure, purpose, vocabulary, style, and other features, as well as the grade range. Annotations highlight aspects of the passage that are key to comprehension or might give students trouble.

Schools volunteer for the program. Scores are not reported to the central office. And data are not used to measure school progress. Instead, teams of teachers at the school work with a “data coach,” a veteran teacher employed by the Boston Plan for Excellence, on how to give the exams, analyze results, and adjust instruction.

No fixed rules say when or how teachers give or use the assessments. BPE and district staff members do all data entry, and most teachers receive their data reports one or two weeks after FAST-R is given.

Zeroing In on Learning

At a recent meeting at Winship Elementary School, a roughly 200-student school on a hilltop overlooking the traditionally working-class Brighton neighborhood, a team of teachers and Principal Antonio N. Barbosa met with FAST-R data coach Paula Morgado to discuss what actions they’d taken based on their most recent results and to plan next steps.

Ms. Riddick recounted how, after getting results from the last reading passage, “I wanted to find out what the students were thinking.” So she went over each question with them and took notes about what they said.

Data coach Paula Morgado, at upper right, meets with 5th grade teachers at the Edward Everett Elementary School in Boston to help them interpret and use data gleaned from Formative Assessments of Student Thinking in Reading, or FAST-R, which measures critical-reading skills.

“A lot of them, when they went back to the passage, they saw one clue or one piece of information and, based on that, they chose an answer,” she explained.

Now, she’s trying to encourage them to base their responses on multiple sources of evidence in the text. They’ve practiced some guided reading as a group, so she can model that thinking out loud. And she’s gotten a book on how to teach inferences using higher-level thinking. “I just want to push them a little,” she said.

Ms. Morgado encouraged her and suggested that next time she pick a reading passage that includes more questions requiring students to make inferences from the text, and that is at a slightly higher reading level.

The team also discussed the progress of individual students, whose responses they had been tracking over time, and whether their skills were improving based on the interventions tried. In addition to the assessments themselves, the Boston Plan for Excellence has developed a number of tools to help teachers focus on individual students’ learning.

A “learning-profile worksheet,” for example, helps a teacher gather data about a student’s reading and thinking from at least four different sources, such as student work, observations, conversations with parents, and other assessments, in order to identify patterns.

A “learning-trajectory worksheet” encourages a teacher to anticipate how a student will handle a FAST-R passage before it’s given, identify evidence that confirms or contradicts that prediction, plan for follow-up work, and then track changes in the student’s skills.

But the key, according to Principal Barbosa and others, is not the tools themselves, but the ongoing conversations that teachers have with one another and with the data coaches.

“Just giving out the piece of paper is not going to cut it,” said Mr. Barbosa. “The conversations that take place with the teachers, particularly across grade levels, and with the support teachers there, are then beginning to zero in on student learning.”

‘Opening Up Assessment’

Richard J. Murnane, a professor at Harvard’s education school who has worked with the Boston district, agrees. “I think so much depends on how skilled the faculty is in knowing what to do with the results,” he said.

“The key is getting coaches to see that a key part of the contribution they can and should make is to help teachers make constructive use of these formative assessments,” Mr. Murnane added. “I think that’s really an enormous challenge,” particularly figuring out how to use the detailed information generated to alter instruction and make it better.

Ms. Morgado says her role, and the frequency of her site visits, changes depending on both a school’s needs and its capacity. “A school that has the principal sitting at the meetings, or the literacy coach or an assistant principal, those seem to be the schools where everyone is on the same page, and there are conversations about student work and instruction across the board, not just in a FAST-R meeting,” she said.

The Boston Plan for Excellence has also begun to offer professional development at schools—for entire staffs or smaller groups—on topics that often arise in FAST-R implementation. The foundation also intends to convene a seminar series for staff members from many schools to think about common challenges, such as working with English-language learners, and to share how they’ve been using FAST-R.

Evaluations by the Cambridge, Mass.-based Education Matters, a nonprofit evaluation firm, have found that teachers, principals, and literacy coaches are enthusiastic about the program and the BPE’s support for its use.

Even so, a big challenge is to help new users understand that FAST-R is about more than test-prep. “We really do believe that FAST-R is giving teachers information to help them get kids to the next level,” said Ellen C. Guiney, the executive director of the BPE, “to have the skills that enable kids to get better scores and that they can transfer to their other reading.”

“That said,” she added, “if you were to do a survey of teachers, a lot of them are still doing it because ‘It helps my kids on MCAS.’ When there’s such a dominance of the standardized test, this is an uphill climb.”

The New York City-based Manpower Demonstration Research Center is conducting a multiyear evaluation of FAST-R, based on a randomly selected sample of Boston elementary schools, to track changes in student performance on the MCAS and other measures.

“I’m sure if FAST-R doesn’t show any help on MCAS, it will probably die, which would be too bad,” said Ms. Guiney, “because I do think formative assessment is absolutely a part of the answer to the puzzle of instructional improvement.”

Coverage of new schooling arrangements and classroom improvement efforts is supported by a grant from the Annenberg Foundation.
A version of this article appeared in the May 02, 2007 edition of Education Week as Homegrown Tests Measure Core Critical-Reading Skills

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Equity, Care and Connection: New SEL Tools and Practices to Support Students and Adults
As school districts plan to welcome students back into buildings for the upcoming school year, this is the perfect time to take a hard look at both our practices and our systems to build a
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Classroom Technology Webinar
Here to Stay – Pandemic Lessons for EdTech in Future Development
What technology is needed in a post pandemic district? Learn how changes in education will impact development of new technologies.
Content provided by AWS
School & District Management Live Online Discussion A Seat at the Table: Strategies & Tips for Complex Decision-Making
Schools are working through the most disruptive period in the history of modern education, facing a pandemic, economic problems, social justice issues, and rapid technological change all at once. But even after the pandemic ends,

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Whitepaper
Engage Students with Independent Reading & Choice
This report reviews critical research about the many ways independent reading benefits literacy development and the key qualities of an e...
Content provided by Scholastic
Reading & Literacy Opinion Science of Reading Advocates Have a Messaging Problem
Invoking science isn’t all it takes to be credible, especially on a debate as charged as literacy education, writes Claude Goldenberg.
Claude Goldenberg
5 min read
Tiny boy and girl stand on wide road in front keyhole entrance in book to narrower way
Tetiana5/iStock/Getty Images Plus
Reading & Literacy Spotlight Spotlight on What We Now Know: Literacy
In this Spotlight, review ways students can be supported; evaluate the struggles often seen when tech intertwines with literacy and more.
Reading & Literacy Struggling Readers Score Lower on Foundational Skills, Analysis of National Test Finds
The results paint a more detailed picture of students who are designated below basic on the National Assessment of Educational Progress.
4 min read
Image of library shelves.
Ziviani/iStock/Getty