Module 8 - Quasi-Experimental/Factorial Designs

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/31

encourage image

There's no tags or description

Looks like no tags are added yet.

32 Terms

1
New cards

Quasi-Experimental Research

Resembles experimental research, but is not true experimental research

-IV manipulation is present, but control group is missing or random assignment isn’t used

Conducted when random assignment is difficult or impossible

2
New cards

Types of Quasi-Experimental Designs

  1. One-Group Designs

  2. Non-Equivalent Group Designs


3
New cards

One Group Designs

Studies a single treatment group experiencing an experimental condition

-Outcome/DV is measured after intervention, or at multiple time points (before and after)

-Comparison happens within the SAME GROUP OVERTIME

No random assignment since there’s one group and no control/comparison

-Makes it more weak when providing causal explanation

4
New cards

Types of One-Group Designs

-One-group Posttest Only Design

-One-group Pretest-Posttest Only Design

-Interrupted Time Series Design

5
New cards

One-Group Posttest Only Design

Treatment is implemented (or IV manipulated), dependent variable is then measured once AFTER the treatment

-Very Weak: Insufficient evidence for causality, no way of knowing if outcome would have happened anyway

6
New cards

One-Group PreTest-Posttest Design


Single group has DV measured before and after treatment implemented

-Effect is inferred from difference between two scores

Weak to Moderate: Provides a “within-group comparison” but vulnerable to many internal validity threats (history, maturation, etc)

-Improvement over one-group posttest design

7
New cards

Internal Validity Threats in One-Group Designs

-History - Other things happened between pre/post test causing a change in DV scores

-Maturation - Participants changed between pre/posttest due to growth/learning

-Testing - Act of measuring the DV during pretest affects participant response on posttest

-Instrumentation - change of characteristics of instrument used to measure

-Regression to the Mean - Individuals who score extremely high/low tend to score less extremely on the next occasion

-Spontaneous Remission - Tendency for psychological problems to improve over time, with NO form of treatment

8
New cards

Interrupted Time Series Design

Set of measurements for one group taken at regular intervals overtime, which is interrupted by treatment/intervention

Moderate - Can account for pre-existing trends

-Remains vulnerable to coinciding events

9
New cards

Nonequivalent Group Design

Compare two or more groups: one experiences the introduced condition, and another doesn’t (or get a different one).

-Because people aren’t randomly assigned, the groups are likely to differ or be “non-equivalent” from the start

-Groups often come from already-established groups or from people’s own choices

Key Feature: There is a separate control or comparison group, but the group cannot be assumed to be equivalent before the intervention and may differ in ways other than the IV

10
New cards

Types of Nonequivalent Group Designs

  1. Posttest Only Non-equivalent Groups

  2. Pretest-Posttest Non-equivalent Groups

  3. Interrupted Time-Series Non-Equivalent Groups (Control Series)

  4. Pretest-Posttest with Switching Replication

  5. Switching Replication w/ Treatment Removal


11
New cards

Posttest Only Nonequivalent Group Design

Two (or more) nonrandomly formed groups compared after one receives a condition. No pretest

Weal: Unsure if groups already different on DV before conditions (due to lack of pretest)

12
New cards

Pretest-Posttest Nonequivalent Groups Design

Pre-Existing groups measured before and after condition, compare changes across groups

Moderate - Can see if change in treatment group was bigger than the natural change in the comparison group

13
New cards

Interrupted Time-Series Design w/ Nonequivalent Groups

Multiple measurements for two groups, before and after conditions introduced

-Compares changes in outcomes across groups

Moderate-to-Strong - Better evidence than pretest/posttest

-Has a comparison group so events that affect both groups (ex; history) can be ruled out because it accounts for general trends/interval variations

14
New cards

Pretest-Posttest w/ Switching Replication

One group receives intervention, the control group waits

-The control group then receives intervention after (staggered introduction)

Strong - Includes a “built-in” replication provides evidence for the effect in two different samples; outside event is unlikely to coincide with both staggered introductions

15
New cards

Switching Replication w/ Treatment Removal

Treatment is removed from the first group at the same time it is added to the second group (when the intervention’s effects are reversible)

-Strong - demonstrating arrival of an effect in two groups and its reversal upon removal

16
New cards

Internal Validity Threats in Non-Equivalent Group Designs

  1. Group Selection Bias

  2. Differential History (History x Group)

  3. Differential Maturation (Maturation x Group)

  4. Differential Attrition (Attrition x Group)


17
New cards

Group Selection Bias

Initial difference between groups in ways that could affect the DV, and confound the IV

-If groups differ on variables that affect DV, any observed effects may reflect initial differences rather than intervention

18
New cards

Differential Maturation (Maturation x Group)

Groups undergo naturally occurring changes or developments at different rates, independently of the intervention

19
New cards

Differential History (History x Group)

An external event affects the groups differently

20
New cards

Differential Attrition (Attrition x Group)

Participants drop out of the study at different rates or for systematically different reasons across conditions, potentially making the remaining groups less comparable

21
New cards

Exchangeability Assumption

Degree to which participants in different conditions are comparable (not systematically different) in ways that could affect the DV

-If we were to exchange participants between conditions, would we expet similar outcomes within each condition

“How Did They End Up There” Test - Are the reasons that determine which condition participants end up in also likely to affect DV independently of intervention?

-If Yes = Potential confounding = less plausible exchangeability

-If No = More plausible exchangeability = more credible causal inference

22
New cards

If Exchangeability is Strong enough

  1. Assignment works AS IF it were random with respect to the DV

  2. Observed differences in DV less likely to be caused by confounding variables

  3. Causal interpretation of results becomes more credible


23
New cards

Factorial Designs

Include more than one IV, each level of one IV is combined with each level of the others to produce all possible combinations

-If a study has two IVs with two levels each, it is a “2×2 factorial design”

Typically has Random Assignment

24
New cards

Between-Subjects Factorial Design

All of the IVs are manipulated between subjects (participants tested in a SINGLE condition)

25
New cards

Mixed Factorial Design

Design which manipulates one IV between subjects and another IV within subjects

26
New cards

Non-Manipulated Independent Variables

IV is measured but NOT manipulated

-Non-manipulated IVs are usually participant variables (gender, self-esteem) and are therefore between-subject factors

-Still have one IV that is manipulated

27
New cards

Results in Factorial Designs

  1. Main Effects

  2. Interaction Effects

  3. Simple Effects


28
New cards

Main Effect

Effect of one IV on the DV, averaging across the levels of the other IV

-One main effect is considered for each IV in the study

29
New cards

Interaction Effect

Effect of one IV depends on the level of the other IV

Types of Interactions:

  1. Spreading Interaction

  2. Cross-Over Interaction


30
New cards

Spreading Interactions

Presence of an effect of one IV at ONE level of the other IV

-Weak effect/no effect of the IV at any other levels of the other IV

31
New cards

Cross-Over Interaction

IV has an effect at both levels, but the effects are in the opposite directions

<p>IV has an effect at both levels, but the effects are in the opposite directions</p>
32
New cards

Simple Effects

Breaking down the interaction to determine precisely what is going on

-Allows researchers to determine the effects of each IV at each level of the other IV

-When interactions are detected, researchers must conduct analyses to determine where that interaction is coming from