B. 6. Item Revision

Test Revision

Fifth and last stage of test development where a test's content or format is modified to improve effectiveness

Cross-Validation

The revalidation of a test on a sample of test takers other than those on whom test performance was originally found to be valid predictor of some criterion

Training, Anchor Protocol, & Scoring Drift

Forms of quality assurance during test revision

Training

Form of written guidelines for test administration

Anchor Protocol

A test protocol scored by a highly authoritative scorer that is designed as a model for scoring and a mechanism for resolving scoring discrepancies

Scoring Drift

A discrepancy between scoring in an anchor protocol and the scoring of another protocol

Differential Item Function (DIF)

Wherein an item functions differently in one group of test takers as compared to another group of test takers known have the same level of the underlying trait

DIF Analysis

When test developers scrutinize group-by-group item response curves

DIF Items

Items that test-takers from different demographic groups with the same underlying skill level answer differently from one another