MODULE 6: VALIDITY

Validity

It refers to the ACCURACY of the test; an estimate of how well a test measures what it purports to measure in a particular context.

It shows evidence about the appropriateness of inferences drawn from test scores.

Inference

a logical result or deduction. Making a conclusion from a test score.

Validation

the process of gathering and evaluating evidence about validity. Both test developer and test user play a role in this process.

Construct Underpresentation

This means that the test does not cover all parts of the construct.

Construct Irrelevant Variance

the test measure some characteristics other than what it suppose to measure.

Internal Validity

degree of control among variables; it refers to the extent to which a a test accurately measures what it suppose to measure, without being affected by confounding variables.

Face Validity

refers to how much a test appears to measure what it claims to, from the perspective of the test taker. What the test "looks like".

External Validity

it refers to the degree to which the results of test can be generalized to other people, settings, or situations.

Content validity

the degree to which the questions or items on a test are representative of the universe of behavior the test is designed to sample.

A match between the content of the test and the content of all the possible contents of the domain.

The test should sample a broad range of behaviors relevant to the construct.

“Do the test items cover and represent all the content that should be included in the test that will measure the construct?”

Test Blueprint

It is a plan that outlines the content areas and type of questions to be included in a test.

It ensures the test is well structured and represents the subject matter accurately. A table of specifications is used.

Table of Specification

it tells how many percent of each topic will be placed in the test.

Criterion Related Validity

refers to how well a test predicts or correlates with an outcome or criterion.

A judgment of how adequately a test score can be used to infer an individual's most probable standing on some measure of interest.

Criterion

the standard on which a judgment or decision may be made.

A direct and independent measure of what the test is designed to predict.

Characteristics: relevant, valid, uncontaminated

Predictive Validity

ability of the test to predict a future outcome or behavior.

Example: College Exam Test (SAT) or Aptitude Test

Concurrent validity

the degree to which a test score is related to some criterion measure obtained at the same time.

It checks how well the test aligns with the established, external benchmark at the same point in time.

Example: A new self-esteem scale demonstrates correlates strongly with the Rosenberg Self-Esteem Scale

Construct Validity

Also called conceptual validity; it measures the appropriateness of inferences drawn from test scores regarding the construct

Concerned with whether a test is genuinely measuring what it claims to measure based on the theoretical definition of the construct.

Example: If a survey is designed to measure self-esteem, means the test items really reflect the actual idea of self-esteem — not something similar like confidence.

Convergent Validity

refers to how well a test CORRELATES with other tests that asses the SAME CONSTRUCT.

Discriminant/Divergent Validity

the extent to which a test DOES NOT CORRELATE with other tests that measure a DIFFERENT CONSTRUCT.

Bias

a factor inherent in a test that systematically prevents accurate, impartial measurement. It prevents a test from accurately measuring what it's supposed to, leading to unfair results for certain groups.

Rating Error

a judgement resulting from the intentional or unintenional misuse of rating scale.

Leniency Error

rater's tendency to rate everything at the positive end of the scale.

Severity Error

a type of rating error in which the ratings are consitently overly negative.

Central Tendency Error

a rater place most items in the middle of a rating scale.

Halo Effect

a tendency to give a particular person a higher rate than he objectively deserves because of a favorable overall impression.

Test Fairness

extent to which a test is used in an impartial just and equitable way.

Incremental validity

it assess wether the new test adds useful information beyond what is already know or measured by other test.