Validity in Measurement - Lecture Notes

15 question-and-answer flashcards covering key concepts on measurement validity, face validity, reactivity, and methods to address reactivity.

What is the definition of measurement validity in social sciences?

The extent to which a measurement tool actually measures the theoretical construct it is intended to measure.

Why do social scientists rely on operational definitions when studying theoretical concepts?

Because many constructs cannot be directly observed, operational definitions allow them to be investigated empirically through specific measurable indicators.

What problem arises from the use of operational definitions for theoretical concepts?

A potential gap between the theoretical construct and the operational measure, raising questions about validity.

Give two example pairs of construct, variable, and measuring tool from the lecture.

Arousal – heart rate – pulse meter; Intelligence – performance on the WISC standardized test.

List any four types of validity mentioned in the lecture.

Face validity, content validity, predictive validity, concurrent validity (others include criterion, postdictive, construct, convergent, discriminant).

What is face validity?

The degree to which a measure appears, on its face, to assess the intended variable, based on common sense and expert judgment.

How is face validity typically evaluated?

Through subjective impressions of judges, experts, or respondents rather than statistical analyses.

Name one advantage and one limitation of face validity.

Advantage: useful during tool development; Limitation: it is impressionistic and may not correspond to actual validity.

Can an instrument have validity without face validity? Provide an example from the lecture.

Yes; for instance, the Rorschach test or eye-movement patterns during sleep stages may be valid despite lacking obvious face validity.

Define reactivity in the context of measurement.

A measure is reactive if the act of measurement alters the behavior or responses being measured.

How can high face validity contribute to reactivity?

When participants realize what is being measured, their awareness may bias their behavior or responses, threatening validity.

Differentiate between specific and nonspecific reactivity and give an example of each.

Specific reactivity stems from knowing the researcher’s hypothesis (e.g., attitude questionnaires influencing later behavior); nonspecific reactivity comes from merely being in an experimental setting (e.g., changes during ERP studies).

What role can the experimenter play in reactivity?

Experimenter expectations or behavior can influence participant responses, a form of specific reactivity.

List two unobtrusive (non-reactive) measurement techniques discussed.

Physical traces like wear on museum carpets, archival records such as website traffic logs (other examples: graffiti analysis, social-media posts).

What are three habituation strategies for reducing reactivity?

Using the same experimenter and setting, providing long baseline or control periods, and giving participants training or practice to familiarize them with the task.