Validity Lecture Notes Flashcards

Flashcards based on lecture notes about validity in testing and measurement.

Validity

Judgment or estimate of how well a test measures what it purports to measure in a particular context.

Validation

Process of gathering and evaluating evidence about validity.

Ecological Momentary Assessment (EMA)

In-the-moment and in-the-place evaluation of targeted variables.

Face Validity

What a test appears to measure to the person being tested rather than what the test actually measures.

Content Validity

Judgment of how adequately a test samples behavior representative of the universe of that behavior that the test was designed to sample.

Test Blueprint

Structure of the evaluation plan regarding the types of information to be covered by the items.

Criterion-Related Validity

Judgment of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interest—the criterion.

Criterion Contamination

Criterion measure that has been based, at least in part, on predictor measures.

Concurrent Validity

Index of the degree to which a test score is related to some criterion measure obtained at the same time (concurrently).

Predictive Validity

Index of the degree to which a test score predicts some criterion measures obtained at a future time.

Base Rate

Extent to which a particular trait, behavior, characteristic, or attribute exists in the population.

Hit Rate

Proportion of people a test accurately identifies as possessing or exhibiting a particular trait, behavior, characteristic, or attribute.

Miss Rate

Proportion of people the test fails to identify as having, or not having, a particular characteristic or attribute.

False Positive

A miss wherein the test predicted the testtaker DID possess the particular characteristic or attribute being measured when in fact the testtaker DID NOT.

False Negative

A miss wherein the test predicted the testtaker DID NOT possess the particular characteristic or attribute being measure when in fact the testtaker ACTUALLY DID.

Validity Coefficient

Correlation coefficient that provides a measure of a relationship between test scores and scores on the criterion measure.

Incremental Validity

Degree to which an additional predictor explain something about the criterion measure that is not explained by predictors already in use.

Construct Validity

Judgment about the appropriateness of inferences drawn from test scores regarding individual standings on a variable called a construct.

Homogeneity

How uniform a test is in measuring a single concept.

Convergent Validity

The test undergoing construct validity has high correlation with an older, more established test that is proven to measure the same or similar construct.

Divergent Validity

The test undergoing construct validity has low or negative correlation with an older, more established test that is proven to measure a construct that is opposite or different from the construct being measured.

Multitrait-Multimethod Matrix

The matrix or table that results from correlating variables within and between methods.

Factor Analysis

Class of mathematical procedures designed to identify factors or specific variables that are typically attributes, characteristics, or dimensions on which people may differ.

Factor Loading

Conveys information about the extent to which the factor determines the test score or scores.

Bias

A factor inherent in a test that systematically prevents accurate, impartial measurement.

Rating Error

Judgment resulting from the intentional or unintentional misuse of a rating scale.

Leniency/Generosity Error

Tendency to score higher than what is deserved.

Severity/Strictness Error

Tendency to score lower than what is deserved.

Central Tendency Error

Tendency to score average; score cluster in the middle of the rating continuum.

Halo Effect

Tendency to give a particular ratee a higher rating than they objectively deserve because of the rater’s failure to discriminate among conceptually distinct and potentially independent aspects of a ratee’s behavior.

Test Fairness

Extent to which a test is used in an impartial, just, and equitable way.