Test Content Validity

What is a reliable test?

One that we can trust to measure each person in approximately the same way each time it is used

What is a valid test?

A test that measures what it intends to measure

Evidence of validity is based on __

Test content (content validity), response processes, internal structure (construct validity), relations with other variables (criterion-based validity) and consequences of testing

How is evidence of test content validity measured?

By examining and evaluating of content of test questions, format, item wording and tasks required and determining if the content is representative of the concepts that the test is designed to measure

What is content validity?

Extent to which the content is representative of concepts the test is designed to measure

How is evidence of response process measured?

By observing test takes as they respond to the test and/or interviewing them when they complete the test an

How is evidence of construct validity measured?

By whether the conceptual framework used in test development could be demonstrated using appropriate analytical techniques

How is evidence of criterion-related validity measured?

By looking at the correlating test scores with other measures to determine and if those scores are related to other measure to which we would expect them to relate and unrelated to other measures to which we would not expect them to relate

How is evidence of the consequences of testing measured?

By looking at both the intended and unintended consequences might occur during psychological measurement

What is face validity?

The extend to which a test appears to measure what is claims to measure

What are the 3 traditional forms a validity?

Content validity, criterion-related validity and construct validity

What does content validity require?

A clear definition and observable behaviors

What are 2 methods of obtaining evidence of content validity?

During test development and post hoc

What is post hoc?

Evaluating the content of a test after the test is developed to yield a quantitative value and can be done test developer or user

What are the steps during test development?

Defining the testing universe, developing the test specifications, establishing a test format and constructing test questions