1/38
Vocabulary practice flashcards covering psychometric norms, standard score transformations, classical test theory, reliability estimation, validity types, item analysis, and test development principles.
Standard Scores (z-scores)
Linear raw-score transformations that express an individual's score in terms of distance from the mean in standard deviation units, preserving equal intervals across the distribution and enabling direct comparison across different tests.
Percentile Rank
A raw-score transformation indicating the exact percentage of scores in a normative distribution that fall below a specific raw score on an ordinal, non-interval scale.
Percentile Distortion
The scaling phenomenon where small raw score differences near the center of a normal distribution result in exaggerated percentile rank jumps, whereas large raw score differences in the extreme tails produce minimal percentile rank changes.
Empirical Rule of Normal Distributions
The mathematical properties of a normal curve stating that approximately 68.26% of scores fall within ±1SD, 95.44% within ±2SD, and 99.74% within ±3SD from the mean.
Deviation IQ Score
A standardized score distribution with a mean of 100 and a standard deviation of 15, calculated using X′=z(15)+100 (for example, a score of −1SD equals 85).
T-Score
A standardized score distribution with a mean of 50 and a standard deviation of 10, calculated using T=z(10)+50 (for example, a score of −1SD equals 40).
CEEB Score
A standardized score distribution commonly used in college entrance examinations with a mean of 500 and a standard deviation of 100, calculated using CEEB=z(100)+500 (for example, a score of −1SD equals 400).
Standardized Test
An assessment constructed by professionals featuring uniform administration and objective scoring guidelines, direct score comparability across examinees, and norm-referenced interpretation via representative standardization samples.
Test Reliability (r11 or rxx)
The consistency or repeatability of test scores across administrations, alternate forms, or internal items, mathematically defined as the ratio of true score variance to total observed score variance (σX2σT2).
Classical Test Theory (CTT)
A psychometric measurement framework holding that an observed test score (X) is the sum of an examinee's true score (T) and unsystematic measurement error (e), expressed as X=T+e.
CTT Measurement Error Assumptions
Theoretical assumptions asserting that measurement errors are random unsystematic fluctuations, have a theoretical mean of zero (Me=0), and are uncorrelated with true trait scores (rTe=0).
Standard Error of Measurement (SEM)
The standard deviation of the theoretical normal distribution of test scores an individual would obtain if tested repeatedly, computed as SEM=sx1−r11, which quantifies the average amount of unsystematic measurement error.
Confidence Interval (Psychometrics)
A band of error placed around an observed score (X) where an examinee's true score is likely to fall, calculated as X±1(SEM) for 68%, X±2(SEM) or 1.96SEM for 95%, and X±3(SEM) for 99%.
Test-Retest Reliability
A reliability estimation method using a single test form administered across two separate sessions to evaluate score stability over time, with administration time and temporal fluctuations serving as the primary source of error.
Alternate-Forms Reliability
A reliability estimation method correlating scores between two equivalent test forms; administered immediately to evaluate item sampling error, or delayed across two sessions to evaluate both item sampling and temporal changes.
Split-Half Reliability
An internal consistency method that correlates scores from two halves of a single test administered on one occasion and applies the Spearman-Brown correction (rSB) to compensate for shortened test length.
Coefficient Alpha (Cronbach's Alpha)
An internal consistency reliability coefficient yielding the mean reliability across all possible split-half combinations, specifically designed for tests with multipoint or Likert-type items.
Kuder-Richardson Formula 20 (KR-20)
A specialized internal consistency formula for dichotomously scored items (such as Right/Wrong or True/False) when items vary in item difficulty.
Kuder-Richardson Formula 21 (KR-21)
A simplified internal consistency formula for dichotomously scored items that assumes all items possess equal difficulty.
Interscorer Reliability
A consistency estimate obtained by correlating ratings across independent examiners, commonly applied to subjectively scored tests or behavioral observations to evaluate scorer consistency.
Item Sampling Error
Measurement error arising from selecting a particular subset of items from the population of all possible questions, evaluated in immediate alternate-forms, split-half, and internal consistency estimates.
Administration Time Error
Measurement error caused by temporal fluctuations in testing environments (such as noise or temperature) or internal states of examinees (such as fatigue, illness, or practice effects) across testing occasions.
Item Characteristic Curve (ICC)
A curve in Item Response Theory plotting latent trait level (θ, on a scale from −3 to +3) against the probability of answering correctly (0.0 to 1.0), illustrating item difficulty at p=0.5 and item discrimination by its slope.
Item Information Function (IIF)
A psychometric function plotting trait level against the precise amount of measurement precision an item contributes, showing that easy items provide precision at low trait levels and difficult items provide precision at high trait levels.
Validity Coefficient (rxy)
A correlation coefficient computed between test scores (X) and an external criterion variable (Y), whose square (rxy2) represents the coefficient of determination or criterion variance accounted for by the test.
Content Validity
The primary form of validity for achievement tests, ensuring that test items adequately sample and represent the universe of knowledge, skills, and material students were expected to master.
Criterion-Related Validity
The degree to which test scores correlate with an external criterion variable, evaluated through either predictive validity (forecasting future criteria) or concurrent validity (criteria collected at the same time).
Predictive Validity
A subtype of criterion-related validity determined by correlating test scores with a criterion measure obtained at a future date (such as SAT or GRE scores predicting college GPA).
Concurrent Validity
A subtype of criterion-related validity determined by correlating test scores with a criterion measure collected simultaneously.
Construct Validity
The primary form of validity for personality tests, evaluating whether test scores align with theoretical expectations regarding abstract psychological traits.
Convergent Validity
A component of construct validity demonstrated when a new test correlates significantly (r≥.50) with established tests that measure the same or theoretically related constructs.
Discriminant Validity
A component of construct validity demonstrated when a test exhibits low or non-significant correlations with measures of distinctly different, unrelated constructs.
Reliability Ceiling on Validity
The mathematical principle stating that test unreliability acts as an upper bound on validity, defined by the formula rxy≤rxx⋅ryy; a test cannot be valid if it lacks reliability.
Item Reliability
The correlation between an individual test item score and the total test score (point-biserial correlation rpb), which assesses an item's contribution to internal consistency.
Item Validity
The correlation between an individual item score and an external criterion variable (point-biserial correlation rpb), which is prioritized over item reliability when predicting complex, multi-faceted criteria.
Item Difficulty Index (p)
The proportion of examinees answering an item correctly, ranging from 0.0 to 1.00, where values below the lower bound are difficult, between the lower bound and 0.70 are moderately difficult, and above 0.70 are easy.
Item Discrimination Index (d)
A metric ranging from −1.00 to +1.00 indicating how effectively an item differentiates high from low performers; items with d≥.30 are acceptable, d=.20−.29 are marginal, d=.10−.19 are very marginal, and d<.09 are poor.
Item Difficulty Lower Bound (L.B.)
The cutoff defining acceptable difficulty for multiple-choice items accounting for guessing chance (g=k1) and sample size (N), computed as L.B.=g+N1.645g(1−g).

Chance Sampling Margin for Item Difficulty Lower Bound
The statistical sampling error term added to chance performance (g) in the formula L.B.=g+N1.645g(1−g), which accounts for sample size (N) and guessing probability (g=k1).