[CHAPT-7] PSYCH ASSESSMENT

UTILITY

The practical value of using a test to aid in decision

PSYCHOMETRIC SOUNDNESS

The state of a test when its reliability and validity coefficients are acceptably high for a particular purpose.

INDEX OF RELIABILITY

how consistently a test measures what it measures;

INDEX OF VALIDITY

can tell us something about whether a test measures what it purports to measure

INDEX OF UTILITY

tell us something about the practical value of the information derived from scores on the test.

UTILITY

the higher the criterion-related validity of test scores for making a particular decision, the higher the ____ of the test is likely to be.

COSTS

Expenditures associated with testing or not testing, which can also include losses like a drop in public confidence.

BENEFIT

Profits, gains, or advantages derived from a successful testing program, which can be economic or noneconomic.

UTILITY ANALYSIS

A family of techniques entailing a cost

EXPECTANCY DATA

Information (often in a table) that provides an indication of the likelihood that a testtaker will score within some interval of scores on a criterion measure.

UTILITY GAIN

An estimate of the benefit (monetary or otherwise) of using a particular test or selection method.

PRODUCTIVITY GAIN

An estimated increase in work output expected through the use of a particular test.

CUT SCORE (Cutoff Score)

A reference point derived as a result of a judgment and used to divide a set of data into two or more classifications to base decisions on.

RELATIVE CUT SCORE (Norm Referenced Cut Score)

A reference point set based on norm-related considerations (group performance) rather than on the relationship of test scores to a criterion.

FIXED CUT SCORE (Absolute Cut Score)

A reference point typically set with reference to a judgment concerning a minimum level of proficiency required to be included in a particular classification, regardless of others' scores.

MULTIPLE CUT SCORES

The use of two or more cut scores with reference to one predictor for the purpose of categorizing test takers.

MULTIPLE HURDLES

A multistage selection process where a cut score is in place for each predictor used, and passing each stage is necessary to advance to the next.

COMPENSATORY MODEL OF SELECTION

An assumption that high scores on one attribute can "balance out" or compensate for low scores on another attribute.

ANGOFF METHOD

A method for setting fixed cut scores where an expert panel makes and averages judgments concerning how a person with a specific trait or ability would respond to test items.

KNOWN GROUPS METHOD (Contrasting Groups)

A method that sets a cut score by collecting data from groups known to possess and not possess a trait, setting the cutoff where the two groups are best separated.

ITEM MAPPING METHOD

An IRT-based technique that entails the arrangement of items in a histogram, where judges determine if a minimally competent individual would answer them correctly to set a cut score.

BOOKMARK METHOD

An IRT-based method where experts place a "bookmark" between items arranged by difficulty to separate those with minimal required knowledge from those without, serving as the cut score.

METHOD OF PREDICTIVE YIELD

A norm-referenced method proposed by Thorndike for identifying cut scores based on the number of positions to be filled.

DISCRIMINANT ANALYSIS

A family of statistical techniques typically used to shed light on the relationship between certain variables and two or more naturally occurring groups.