Psy598 - validity

Content validity

How well a test measures what it is supposed to measure, based on how its result relate to other things we expect it to be connected to

Construct validity

The extent to which a test truly measures the idea (theoretical construct) its supposed to measure - intelligence, anxiety, motivation

Concurrent validity

the degree to which the measures gathered from one tool agree with the measures gathered from other assessment techniques

Predictive validity

Refers to the function of a test in predicting a particular behavior or trait.

Convergent validity

Subtype of construct validity - The test correlates highly with other tests measuring the same construct

Discriminant validity

Subtype of construct validity - The test does not correlate with tests measuring different constructs

Convergent and discriminant validity

The subjection of a Multitrait-multimethod matrix to a set of criteria that specify which correlations should be large and which small in terms of a psychological theory of the constructs

Criterion-related validity

How well one measure predicts an outcome based on another measure

Factor analysis

A mathematical method of summarising a matrix of values (such as the inter-correlation of test scores) in terms of a smaller number of values (factors) from which the original matrix can be reproduced

Incremental validity

Assesses whether a new psychometric assessment has more predictive ability than exisiting methods of assessment

Method variance

The variability among scores on a psychological test or other assessment device that arise because of the form as distinct from the content of the test

multitrait-multimethod matrix

The pattern of correlations resulting from testing all possible relationships among two or more methods of assessing two or more constructs

Standard error of estimates

An index of the amount of error in predicting one variable from another

Validity

The extent to which evidence supports the meaning and use of a psychological test

Face validity

Does the test appear to measure what its supposed to

External validity

How well the results of a study can be generalised to other people, settings or times

Internal validity

How confidently we can say that the independent variable caused the change in the dependent variable, without interference from confounding variables

Cutting point

The test score or point on a scale, in the case of another assessment device that it used to split those being tested or assessed into two groups predicted to show or not show some behaviour or interest

Valid negative decision

a decision that correctly allocates a test taker or person being assessed to the category of those predicted not to show some behaviour of interest on the basis of their score on a test or other assessment device

Valid positive decision

a decision that correctly allocates a test taker or person being assessed to the category of those predicted to show some behaviour of interest on the basis of their score on a test or other assessment device

False negative decision

a decision that incorrectly allocates a test taker or person being assessed to the category of those predicted not to show some behaviour of interest on the basis of their score on a test or other assessment device

False positive decision

a decision that incorrectly allocates a test taker or person being assessed to the category of those predicted to show some behaviour of interest on the basis of their score on a test or other assessment device

Base rate

The proportion of individuals in the population who show the behaviour of interest in a given psychological testing or assessment situation

Selection ratio

The proportion of those tested or assessed who can be allocated to the category of showing the behaviour of interest in a given psychological testing or assessment situation