Experimental Designs
Hypothesis Testing
- Hypothesis: Increasing knowledge of a group reduces prejudice.
- Independent Variable (IV): A movie that promotes empathy (e.g., Selma, 12 Years a Slave).
- Dependent Variable (DV): Reduction in racial prejudice towards African Americans.
- Inclusion Criteria: Participants who are not African American.
One-Shot Study
- Method: Show the film to a sample of university students.
- Result: Prejudice scores are lower than the norm.
- Problem: Cannot confirm the film caused the reduction; students might have already had lower scores.
Control Group
- Method: Randomly assign university students to two groups: one watches the film, the other doesn't.
- Compare prejudice scores between the two groups.
- Issue: If groups aren't equal in initial prejudice levels, it can skew results.
- External Validity: Using only university students limits the generalizability of findings.
Within-Group Test (Pre-test, Post-test)
- Method: Compare a group of students' prejudice scores before and after watching the film.
- Finding: Post-test scores are lower.
- Issue: Participants may provide socially desirable responses due to awareness of the film's subject matter and testing effects.
Control Group with Pre- and Post-Tests
- Method: Randomly allocate students into two groups (e.g., 20 in each group).
- Both groups take pre-test and post-test.
- One group watches the film between tests.
- Finding: Change scores (difference between pre- and post-test) are lower in the control group.
- Problem: Pre-test may sensitize students to the study's purpose, influencing their responses.
Four-Group Solomon Design
- Allows for partialling out the impact of the pre-test.
- Groups:
- Group 1: Pre-test, Film, Post-test
- Group 2: Pre-test, Post-test (no film)
- Group 3: Film, Post-test (no pre-test)
- Group 4: Post-test (no pre-test or film)
- Comparisons:
- Compare post-test scores of groups with and without pre-tests to assess the pre-test impact.
- Can equate groups using pre-test scores (highest score to lowest, distributing across groups).
- Advantage: Can compare the impact of the pre-test and different scores across time between groups.
- Disadvantage: Requires a larger sample size compared to simpler designs.
- Example: 20 people per group in a Solomon design requires 80 participants, whereas a simpler design might accommodate 80 people in fewer groups, thus a more statistically powerful design.
Experimental Designs
- Between-Subjects Design: Different participants in each group.
- Within-Subjects Design: Comparing the same participants before and after the intervention.
- Mixed Design: Examining changes across time between groups.
Advantages of Between-Group Designs
- Suitable for intact groups: such as gender or religion.
- Appropriate for irreversible interventions: such as teaching someone to swim.
- Avoids carryover effects: where one treatment influences the outcome of another such as comparing Cognitive Behavioural Therapy and medication for depression.
- Solution: Compare CBT for one group, medication for another. A third group could receive both.
- Useful for treatments requiring a long period of time, to reduce dropouts.
Naturally Intact vs. Artificially Derived Groups
- Naturally Intact Groups: Groups based on existing characteristics (e.g., gender, religion).
- Artificially Derived Groups: Groups created by the researcher based on measured variables (e.g., age split at 50, religiosity based on a median split of questionnaire scores).
Example: Aggressive Behavior and Violent Movies
- Independent Variable: Sex at birth (males vs. females).
- Dependent Variable: Aggressive behavior.
- Hypothesis: Boys will show more aggressive behavior than girls after seeing a violent movie (Guardians of the Galaxy).
- Illustrates using naturally occurring groups as the IV.
Socioeconomic Status & IQ Examples
- Using median split to create high/low socioeconomic status groups or high/low IQ groups.
Random Assignment
- Ideal for creating control groups, but not always possible or ethical.
- Ethical Considerations: Cannot force pregnant women to consume alcohol or assign individuals to male/female groups.
Quasi-Experimental Design
- Used when random assignment is not possible.
- Example: Studying people with head injuries (naturally occurring group).
- Control for other factors: such as sex, education, and trauma of the experience.
- Consult with experts (and literature) to determine which factors to control for.