Education Opinion

Picking an Assessment

By LeaderTalk Contributor — March 27, 2012 4 min read
  • Save to favorites
  • Print

Many school districts are starting to choose common assessments from third party vendors. Some of this is due to new federal or state regulations, and some of this is due to allowing for an assessment that might be more reliable than one created internally. The purpose of this article is to provide practical advice on how to choose an assessment; it is NOT an endorsement of one company over another.

Psychometric Questions
The first aspect to consider when researching assessments is the psychometrics behind the assessment. In other words... How is this test put together? For example, the assessment should be one that contains field tested and leveled questions--the most common being Webb Leveling. Some other questions you should ask include:
1. How do you scale your assessment?
2. Can we get the Pvalue of each question?
3. Does the assessment correlate to the state assessment?
4. Is a metric being used in the background so that the assessment will be tailored to the student dependent on their answers? If so, what goes into the metric? The time it took students to answer to each question?? Right answers?

Standards Questions
Another area to review when selecting a third party assessment is its alignment to the Common Core or your state’s standards in a given subject area. Such an exam will help students and teachers identify areas of strengths and areas in need of improvement. Some guiding questions are:
1. Is there an item map that shows the alignment between the test questions and Common Core or state standards?
2. Who did the alignment of the questions and what is their background?
3. What resources are available to support teachers as they identify students’ needs and develop interventions?

Data Analysis
The assessment is only the first piece of an effective assessment plan. A second piece to the puzzle that is just as important is related to data analysis. Teachers and administrators will need easy to read and understandable data analysis; therefore, asking the right questions to third party vendors is essential. Some questions to ask include:
Is there a way to get the results out of the system via Excel or other flat format?
Does the system come equipped with CBM (Curriculum Based Measurement) reports?
How is RTI supported through the use of the assessment?
Is there a model report accessible to customers to review prior to purchasing the system? Are the reprorts available in color? If so, are the colors standardized throughout the tool? For example, does red consistently indicate an area in need of improvement?
Is there a parent portal or a parent component for school to home communication about student progress?
How soon are reports generated after testing?
Is a benchmarking to other clients or to national norms provided? How many records is the benchmarking based?

Nuts and Bolts
Just as important as all of the above is the backend of the system. You need to make sure that it will fit into your current technology. You will also want to inquire about the company and their history in the industry.
How do we get the students’ information into the system? Is there any automated way? SIF, Web folder, auto extract, etc.
Is your solution Web based or Web enabled (Enabled means it is mostly Web delivered but you may need to install certain files on each computer)?
Can students take the test on both Mac and PC?
If it is Web based, then what browsers work the best and what plugins are necessary?
Will the assessment and management of the reports be accessible and editable on a tablet and/or IPad or Iphone?
Can you provide references? Can we do a site visit to any of them?
How long have you been in this specific marketplace?

The last part that needs to be addressed is the actual implementation of the assessment. Teachers who administer the test will have more confidence doing so if they can experience the tests firsthand. Finally, knowing what the timeline is between signing a contract and obtaining the product should be discussed and confirmed.
1. How is training provided? Onsite training or Web ex? How much professional development is included?
2. What are the credentials of trainers?
3. How quick after the contract is signed should we expect to be up and running?
4. What kind of contract do I need to sign? Make sure the contract does not allow the company to use your district in any promotional material.

There are several aspects to consider when researching third party assessments. The questions noted above provide a glimpse into the types of inquiries educators may make when faced with the decision to purchase of an assessment. Companies in the assessment field are competitive, and educators do not have to settle for anything less than what is best for their districts. Asking challenging questions will help narrow the selection process; thus, you will be well on your way to picking an assessment that will fit the culture and needs of your district.

James Yap and Dr. Teresa Ivey

The opinions expressed in LeaderTalk are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Evaluating Equity to Drive District-Wide Action this School Year
Educational leaders are charged with ensuring all students receive equitable access to a high-quality education. Yet equity is more than an action. It is a lens through which we continuously review instructional practices and student
Content provided by BetterLesson

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Schools Get the Brunt of Latest COVID Wave in South Carolina
In the past few weeks, South Carolina has set records for COVID-19 hospitalizations and new cases have approached peak levels of last winter.
4 min read
Two Camden Elementary School students in masks listen as South Carolina Gov. Henry McMaster talks about steps the school is taking to fight COVID-19, Wednesday, Sept. 15, 2021, in Camden, S.C. McMaster has adamantly and repeatedly come out against requiring masks in schools even as the average number of daily COVID-19 cases in the state has risen since early June. (AP Photo/Jeffrey Collins)
Education More States Are Requiring Schools to Teach Native American History and Culture
Advocates say their efforts have gained some momentum with the nation’s reckoning over racial injustice since the killing of George Floyd.
3 min read
A dancer participates in an intertribal dance at Schemitzun on the Mashantucket Pequot Reservation in Mashantucket, Conn., Saturday, Aug. 28, 2021. Connecticut and a handful of other states have recently decided to mandate students be taught about Native American culture and history. (AP Photo/Jessica Hill)
Education Judge's Temporary Order Allows Iowa Schools to Mandate Masks
A federal judge ordered the state to immediately halt enforcement of a law that prevents school boards from ordering masks to be worn.
4 min read
Iowa Gov. Kim Reynolds speaks to reporters following a news conference, Thursday, Aug. 19, 2021, in West Des Moines, Iowa. Reynolds lashed out at President Joe Biden Thursday after he ordered his education secretary to explore possible legal action against states that have blocked school mask mandates and other public health measures meant to protect students against COVID-19. Reynolds, a Republican, has signed a bill into law that prohibits school officials from requiring masks, raising concerns as delta variant virus cases climb across the state and schools resume classes soon. (AP Photo/Charlie Neibergall)
Education Hurricane Ida Deals New Blow to Louisiana Schools Struggling to Reopen
The opening of the school year offered teachers a chance to fully assess the pandemic's effects, only to have students forced out again.
8 min read
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021. Louisiana students, who were back in class after a year and a half of COVID-19 disruptions kept many of them at home, are now missing school again after Hurricane Ida. A quarter-million public school students statewide have no school to report to, though top educators are promising a return is, at most, weeks away, not months.
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021.
John Locher/AP