Advanced Statistics: Repeated Measures ANOVA and Post-Hoc Analysis for Clinical Therapy
Case Study: Depression Therapy and Repeated Measures ANOVA
Context and Data Source: The analysis centers on an example from page 395 of the textbook, focusing on depression scores across different time points. This is a practical application of the Repeated Measures Analysis of Variance (ANOVA).
The Utility of ANOVA: While a t-test can compare two points (e.g., before and after), ANOVA is required when there are three or more groups or time points. In clinical research, this allows for the evaluation of therapy longevity.
Experimental Design: The factor is Time, and there are k=3 time points:
Before Therapy: Baseline depression level.
After Therapy: Depression level immediately following the conclusion of treatment.
Six-Month Follow-Up: Depression level six months after treatment to determine if the therapeutic effects "stick."
Participants: The study includes n=5 participants, each measured at every time point (N=15 total scores).
The Problem of Efficacy: A therapy is deemed truly successful not just if depression drops immediately, but if it stays low. If depression rebounds to original levels after treatment ends, the therapy's success is limited as it only works while the patient is actively in it.
Preliminary Calculations (Step 0)
Provided Values: In an exam or lab (such as Lab 3.3), certain values like the Sum of Squares (SS) for each group are often provided to save time. For this problem:
SS1 (Before): 273.2
SS2 (After): given in the context of calculations.
SS3 (6-Month): given in the context of calculations.
Participant Totals (P): A new element in Repeated Measures is the P value, which is the sum of scores for a single participant across all time points.
P1=179
P2=151
P3=191
P4=187
P5=185
Treatment Totals (T):
T1=373
T2=258
T3=261
Grand Total (G): The sum of all scores. This can be calculated in two ways to check for errors:
G=T1+T2+T3=892
G=P1+P2+P3+P4+P5=892
Calculation of Means (M):
M1=nT1=5373=74.6
M2=51.6
M3=52.2
Identifying Severity: Comparing the P values identifies which individuals have the most severe depression across the study. In this data, Person 3 exhibits the highest total scores (191), while Person 2 has the mildest depression (151).
Hypothesis Testing (Steps 1-4)
Step 1: Hypotheses:
Null Hypothesis (H0): Time spent in therapy has no effect on depression scores (μ1=μ2=μ3).
Alternative Hypothesis (H1): Time spent in therapy has an effect on depression scores; at least one average score is different.
Step 2: The ANOVA Table: In Repeated Measures, the "Within-Treatments" variance is split into two components: Participants (individual differences) and Error (random noise).
Step 3: F-Critical: Using the table for α=0.05 with dfnumerator=2 and dfdenominator=8, the critical value is 4.46.
Step 4: Decision: Since the obtained F (69.58) is substantially larger than the critical value (4.46), we reject the null hypothesis. There is a significant effect of therapy over time.
Effect Size and APA Documentation (Step 5)
Eta Squared (η2): This measures the proportion of variance explained by the therapy. In Repeated Measures, individual differences (SSparticipants) are removed from the denominator to get a cleaner look at the treatment effect.
η2=SSbetween+SSerrorSSbetween
η2=1718.53+98.81718.53=0.946
Interpretation: The effect size is roughly 95%. This is considered "absurdly large" in real-world psychology (where 25% is the threshold for a large effect), but serves as a clear indicator of a strong relationship in this word problem.
APA Style Summary: F(2,8)=69.58,p<0.05,η2=0.95
Pairwise Comparisons (Step 6: Tukey’s HSD)
Calculating Tukey's HSD: This determines the minimum difference required between two means to be considered statistically significant.
q-Value: Found using k=3 and dferror=8. At the 0.05 level, q=4.04.
HSD Formula: HSD=q×nMSerror=4.04×512.35=6.35
Pairwise Results:
Before vs. After: ∣74.6−51.6∣=23.0 (Significant, as 23.0>6.35).
Before vs. 6-Month: ∣74.6−52.2∣=22.4 (Significant, as 22.4>6.35).
After vs. 6-Month: ∣51.6−52.2∣=0.6 (Not Significant, as 0.6<6.35).
Interpretation and Pattern Analysis
Success Visualization: In this study, the ideal success pattern is a sharp decrease in depression scores that remains low over time.
Observed Pattern: Depression dropped from 74.6 to 51.6 and remained essentially flat at the follow-up (52.2).
Clinical Conclusion: The therapy is successful. It caused a significant reduction in depression that was maintained six months after treatment concluded. The slight increase of 0.6 points in the follow-up is not statistically significant and can be attributed to random noise (sampling error).
Participant Variability: By using a Repeated Measures design, researchers can distinguish between variance caused by the therapy and variance caused by individual differences in baseline depression (e.g., Person 3 being more depressed than Person 2 regardless of treatment).