1/64
Looks like no tags are added yet.
The extent to which a test measures what it claims to measure.
Validity
The consistency or stability of test scores across time, forms, or raters.
Reliability
The degree to which a test measures the theoretical construct it is intended to assess.
Construct Validity
The extent to which a test represents all facets of the construct being measured.
Content Validity
The extent to which a test's scores are related to an external criterion.
Criterion-Related Validity
How well test scores predict future outcomes.
Predictive Validity
How well test scores correlate with other measures of the same construct administered at the same time.
Concurrent Validity
The consistency of scores when the same test is administered to the same individuals at two different points in time.
Test-Retest Reliability
The degree of agreement among different raters or evaluators.
Inter-Rater Reliability
The extent to which items within a test measure the same construct, often assessed using coefficients like Cronbach’s alpha.
Internal Consistency
The process of administering a test under consistent conditions and using established norms to interpret scores.
Standardization
Reference scores derived from a standardization sample, used for comparing individual test performance.
Norms
The original, untransformed score obtained directly from a test.
Raw Score
A transformed score that allows comparison across tests or populations, often using standard deviations and means.
Scaled Score
An estimate of the amount of error inherent in an individual’s test score.
Standard Error of Measurement (SEM)
The process of evaluating individual test items for their difficulty, discrimination, and overall contribution to test quality.
Item Analysis
The proportion of test-takers who answer a test item correctly; used to assess how easy or hard the item is.
Item Difficulty
The degree to which an item differentiates between high and low performers on the overall test.
Item Discrimination
When a test is too easy, leading many test-takers to achieve near-perfect scores, limiting the ability to distinguish among higher abilities.
Ceiling Effect
When a test is too difficult, causing many test-takers to score near the lowest possible score, limiting the ability to distinguish among lower abilities.
Floor Effect
The extent to which a test appears to measure what it is supposed to measure, based on superficial inspection.
Face Validity
A statistical method used to identify underlying dimensions or factors within a set of test items.
Factor Analysis
A common scaling method in survey research where respondents rate their level of agreement with statements.
Likert Scale
A theoretical concept or trait that a test aims to measure (e.g., intelligence, anxiety).
Construct
Systematic errors in test scores that unfairly favor one group over another.
Bias
When test items have different levels of difficulty for different groups, despite equal ability levels.
Differential Item Functioning (DIF)
A measure of variability that indicates the average difference between test scores and the mean score.
Standard Deviation (SD)
A score that indicates the percentage of scores in a norm group that fall below a given score.
Percentile Rank
A standardized score that represents the number of standard deviations a raw score is from the mean.
Z-Score
A standardized score with a mean of 50 and a standard deviation of 10.
T-Score
A measure of reliability obtained by correlating scores on two halves of a test.
Split-Half Reliability
A testing method where the difficulty of questions is adjusted based on the test-taker’s responses.
Adaptive Testing
Preliminary testing of a new test on a small sample to identify issues before full-scale implementation.
Pilot Testing
The ability of a test to correctly identify individuals who have a specific condition or trait.
Sensitivity
The ability of a test to correctly identify individuals who do not have a specific condition or trait.
Specificity
A model used to analyze test items based on their difficulty, discrimination, and guessing parameters.
Item Response Theory (IRT)
An unobservable characteristic or quality inferred from test performance.
Latent Trait
Occurs when a test reflects the values, norms, and knowledge of a particular culture, making it unfairly advantageous for individuals from that culture and disadvantageous for those from others.
Cultural Bias
When the construct being measured is defined or operationalized differently across groups, resulting in invalid comparisons.
Construct Bias
Arises when test items are more relevant or familiar to certain groups than others, leading to an uneven playing field.
Content Bias
Happens when the sample used to standardize the test does not accurately represent the broader population, leading to skewed norms.
Sampling Bias
A tendency of test-takers to respond in a particular way, regardless of their true feelings or abilities.
Response Bias
Answering in a manner perceived to be socially acceptable.
Social Desirability Bias
Tendency to agree with statements regardless of their content.
Acquiescence Bias
Preferring extreme options on scales (e.g., always selecting 'strongly agree' or 'strongly disagree').
Extreme Response Bias
Avoiding extreme options and choosing middle responses instead.
Central Tendency Bias
When test items or interpretations favor one gender over another, often stemming from stereotypes or unbalanced representation.
Gender Bias
Occurs when the language of the test is more accessible to certain groups, disadvantaging non-native speakers or those with limited vocabulary.
Language Bias
The risk that individuals may underperform on a test due to anxiety about confirming negative stereotypes about their social group.
Stereotype Threat
When raters or evaluators give undue weight to an initial piece of information (e.g., first impressions or early responses) when assessing performance.
Anchoring Bias
When the evaluator's positive impression of one characteristic influences their evaluation of other characteristics, leading to skewed judgments.
Halo Effect
The opposite of the halo effect, where a negative impression of one characteristic negatively influences evaluation of others.
Horn Effect
The tendency to favor information or interpretations that confirm pre-existing beliefs or hypotheses.
Confirmation Bias
Overweighting recent or easily recalled events or information when interpreting test responses or patterns.
Availability Bias
Occurs when a test predicts outcomes differently for different groups, even when scores are the same.
Differential Prediction Bias
Variations in test performance caused by differences in how the test is administered (e.g., paper vs. computer, group vs. individual).
Mode of Administration Bias
When the testing environment disproportionately impacts certain groups, such as noise levels, location, or other situational factors.
Ecological Bias
When a rater consistently scores individuals more favorably than warranted.
Leniency Bias
When a rater consistently scores individuals more harshly than warranted.
Severity Bias
Unconscious attitudes or stereotypes that influence judgments and decisions without the evaluator being aware of them.
Implicit Bias
When overlapping social categories (e.g., race, gender, socioeconomic status) lead to compounded disadvantages in testing.
Intersectionality Bias
Advantages given to individuals who are more familiar with test-taking strategies, regardless of their actual knowledge or ability.
Test-Wiseness Bias
When test content or interpretations are more appropriate for certain age groups, disadvantaging others (e.g., younger or older individuals).
Age Bias
Biases stemming from cognitive limitations, such as overgeneralization or faulty logic in interpreting test results.
Cognitive Bias
Errors that arise from the measurement tool itself, leading to systematic overestimation or underestimation of true scores.
Measurement Bias