Psychological Assessment Reliability, Validity, Utility

Vocabulary flashcards related to psychological assessment reliability, validity, and utility.

Reliability

The dependability or consistency of a test or instrument.

Reliability Coefficient

An index of reliability that indicates the ratio of true score variance to total variance on a test.

Classical Test Theory

A theory that presumes a test score reflects both the testtaker's true score and measurement error.

Error of Measurement

The component of the observed test score that does not relate to the testtaker's ability.

Type I Error

A false-positive error that occurs when a true null hypothesis is incorrectly rejected.

Type II Error

A false-negative error that occurs when a false null hypothesis is not rejected.

Variance

The measure of variability among test scores.

True Variance

Variance attributed to true differences in ability.

Error Variance

Variance arising from irrelevant or random factors.

Measurement Error

Factors associated with the measurement process that impact the variable being assessed.

Random Error

Unpredictable fluctuations affecting the measurement process.

Systematic Error

Consistent errors in measuring a variable that relate proportionately to its true value.

Item Sampling

Variation among items within a test or between tests affecting test taker scores.

Test Administration

Factors such as motivation, attention, and environment that affect test scores.

Test-Retest Reliability

A reliability estimate obtained by correlating pairs of scores from the same individuals on two administrations of a test.

Parallel Forms Reliability

Reliability estimate assessing test scores from different forms of the same test.

Split-Half Reliability

Reliability assessed by correlating two scores from equivalent halves of a single test.

Spearman-Brown Formula

Estimates internal consistency reliability based on the correlation of two test halves.

Inter-item Consistency

Measure of the degree of correlation among all items on a scale to assess homogeneity.

K-R 20 and K-R 21

Measures of internal consistency for dichotomous and uniformly difficult items respectively.

Average Proportional Distance

A measure of internal consistency focusing on differences between item scores.

Inter-scorer Reliability

Consistency between two or more scorers regarding a measure.

Kappa Statistics

A statistic used to measure inter-scorer reliability and agreement among multiple raters.

Validity

A judgment on how well a test measures what it is intended to measure.

Content Validity

Judgment on how adequately a test samples behaviors representative of the behavior universe.

Criterion-Related Validity

Judgment of how well test scores can predict an individual's standing on a criterion measure.

Concurrent Validity

Extent to which test scores obtained align with criterion measures at the same time.

Predictive Validity

The relationship between test scores and criterion measures obtained at a future time.

Validity Coefficient

A measure of the relationship between test scores and scores on a criterion measure.

Construct Validity

Judgment of appropriateness of inferences drawn from test scores regarding a construct.

Bias

Factors in a test that systematically prevent accurate measurement.

Utility

The practical value or usefulness of testing to improve decision-making.

Expectancy Data

Data that indicate the probability a test taker will achieve specific results on a criterion measure.

Taylor-Russel Tables

Estimates how inclusion of a particular test improves selection efficiency.

Brogden-Cronbach-Gleser Formula

Calculates the dollar amount of utility gain from using a selection instrument.