Measuring and Validity

Face validity

The judgment of experts on how well a measurement instrument appears to measure what it is intended to measure.

Content validity

Ensuring that a measurement instrument covers all aspects of the construct it is supposed to measure.

Convergent validity

Checking if the measurements of one instrument align with those of another instrument measuring the same concept.

Divergent validity

Verifying that the measurements of an instrument do not align with those of instruments measuring different concepts.

Criterion validity

Examining if the measurements of a variable correlate with those of a different variable as expected.

Correlation coefficient

A tool used to measure the strength and direction of a relationship between two variables.

Systematic error

Errors in the experimental procedure that can impact the validity of the results.

Random error

Errors that affect the reliability of measurements.

Test-retest reliability

Ensuring that measurements with the same instrument are consistent over multiple tests, indicating stability over time.

Inter-rater reliability

Consistency of measurements when different researchers use the same instrument.

Internal reliability

Consistency of participant responses to different questions measuring the same concept, often assessed using Cronbach's alpha.

Cronbach’s alpha values that indicate internal validity

• Below 0.7 = low internal validity

• Above 0.8 = high internal validity

Survey modes

Different methods of conducting surveys such as face-to-face, mail, telephone, internet, mixed-mode, and panel surveys.

Mixed mode surveys

Using different modes for data collection or combining modes for different survey aspects.

Panel surveys

Longitudinal studies that interview the same respondents over time to study long-term effects.

Coding

The process of creating a variable or scale score from survey responses, including options like summing item scores or averaging them.