6 -Validity, Reliability, and Questionable Research Practices

Flashcards about Validity, Reliability, and Questionable Research Practices.

What is Construct Validity?

How well a measure relates to the theoretical concept being studied, involving describing concepts, developing measures, and empirically testing relationships.

What is Content Validity?

How well a measure relates to all facets of a given construct, such as both positive and negative symptoms of a condition.

What is Internal Validity?

How well a measure accounts for the manipulated change, reflecting the strength of the causal relationship and potential influence of confounding factors.

What are threats to Internal Validity?

Factors that can decrease internal validity, including participant selection, motivation, maturation, experimenter training, equipment decay, and lack of random assignment.

What is External Validity?

The generalizability of findings to conceptually similar circumstances. High external validity may lead to less control for confounds.

Define Population Validity

The extent to which the experimental sample findings can be generalized to a defined population.

What does WEIRD stand for?

Western, Educated, Industrialized, Rich, and Democratic, referring to the demographic that much of psychology literature is based on.

What is Ecological Validity?

How well psychology findings generalize to the real world or other settings.

Define Reliability in research.

The consistency of measurements if taken multiple times.

What is Test-Retest Reliability?

The consistency of a measure across different times.

What is Internal Consistency?

The consistency of a measure across items within the measure.

What is Interrater Reliability?

The consistency of a measure across different researchers or observers.

Define P-Hacking

Manipulating data or analyses to achieve a statistically significant p-value.

Define HARKing

Hypothesizing After the Results are Known. Presenting a post hoc hypothesis as if it were an a priori hypothesis.

What is the file drawer problem?

The phenomenon where positive or significant results are more likely to be published than negative results, leading to publication bias.

What is Registration in research?

Two related approaches (Pre-registration and Registered Reports) to prevent QRPs.