L6 Validity

Validity

Judgment or estimate of how well a test measures what it purports to measure in a particular context.

Inference

A logical result or deduction.

Validation

Process of gathering and evaluating evidence about validity.

Test Developer

Provide validity evidence in the test manual.

Test Users

Conduct local validation studies.

1. content validity

2. construct validity

3. criterion-related validity

Trinitarian View of Validity

Face Validity

What a test appears to measure to the person being tested rather than what the test actually measures (”sa unang tingin”).

Content Validity

Describes a judgment of how adequately a test samples behavior representative of the universe of that behavior that the test was designed to sample.

Criterion-Related Validity

Judgment of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interest—the criterion.

Criterion

The standard against which a test or test score is evaluated.

Concurrent Validity

Index of the degree to which a test score is related to some criterion measure obtained at the same time (concurrently).

Predictive Validity

Index of the degree to which a test score predicts some criterion measures obtained at a future time, usually after some intervening event has taken place.

Validity Coefficient

Correlation coefficient that provides a measure of a relationship between test scores and scores on the criterion measure.

Incremental Validity

In the context of predicting some criterion through multiple predictors.

Construct Validity

Judgment about the appropriateness of inferences drawn from test scores regarding individual standings on a variable called a construct.

Construct

An informed, scientific idea developed or hypothesized to describe or explain behavior.

Expectancy Data

Provide information that can be used in evaluating the criterion-related validity of a test.

Expectancy Table

Shows the percentage of people within specified test-score intervals who subsequently were placed in various categories of the criterion (for example, placed in “passed” category or “failed” category).

Homogeneity

How uniform a test is in measuring a single concept.

Factor Analysis

Class of mathematical procedures designed to identify factors or specific variables that are typically attributes, characteristics, or dimensions on which people may differ.

Exploratory Factor Analysis

Estimating or extracting factors; deciding how many factors to retain; rotating factors to an interpretable orientation.

Confirmatory Factor Analysis

Tests the degree to which a hypothetical model (which includes factors) fits the actual data.

Factor Loading

Conveys information about the extent to which the factor determines the test score or scores.

Bias

A factor inherent in a test that systematically prevents accurate, impartial measurement.

Rating Error

Judgment resulting from the intentional or unintentional misuse of a rating scale.

Test Fairness

Extent to which a test is used in an impartial, just, and equitable way.