ANOVA
Analysis of Variance (ANOVA)
Definition:
ANOVA is used to test differences between the means of three or more groups simultaneously.
It assesses whether group means differ on a particular score or variable.
Test Statistic:
The statistic used for ANOVA is the F-test.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Different Flavors of ANOVA
Simple Analysis of Variance (One-Way ANOVA):
Applied when one factor or treatment variable is being investigated across more than two groups (levels).
Focuses on the influence of one independent variable on a dependent variable.
Factorial Design:
Used when exploring multiple treatment factors.
It allows for the analysis of two or more independent variables.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Factorial Design ANOVA
Definition:
Factorial Design ANOVA examines the effects of more than one treatment or factor simultaneously.
It involves multiple independent variables and one dependent variable.
Example:
A 3x2 factorial design, which means three levels of one factor and two levels of another.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Example of Factorial Design ANOVA
Scenario: Evaluation of preschool hours on gender:
Parameters:
Gender: Male, Female
Hours in Preschool: 5 hours/week, 10 hours/week, 20 hours/week
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Computing the F Statistic
Understanding Variation:
A significant variation between samples suggests differences between groups, while little variation within samples indicates consistency among them.
Assumption: Variation relates to the group factor (e.g., treatment, gender).
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Hypotheses in ANOVA
Null Hypothesis (H0):
Specifies that the means of the groups are equal:
H0: 1 = 2 = 3
Research Hypothesis:
Indicates that at least one group mean is different from the others.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Source Table for ANOVA
Source Table Example:
The breakdown of sum of squares (SS), degrees of freedom (df), mean square (MS), and F-value:
Between Groups:
SS: 1,133.07
df: 2
MS: 566.54
F: 8.799
Within Groups:
SS: 1,738.40
df: 29
MS: 64.39
Note: The F value for two groups is equivalent to the square of the t-value (F = t²).
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Degrees of Freedom (df)
Calculating Degrees of Freedom:
Numerator: Number of groups minus one: k - 1
Example with 3 groups: 3 - 1 = 2
Denominator: Total number of observations minus the number of groups: N - k
Example with 30 participants: 30 - 3 = 27
Representation: F(2, 27)
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Interpretation of Results
Example Statement:
For F(2, 27) = 8.80, p < .05
Breakdown of the statement:
F indicates the test performed.
Degrees of freedom: 2 (between-group) and 27 (within-group estimates)
Obtained F-value: 8.80
p-value significance: less than 0.05, indicating statistical significance.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Single-Factor Analysis of Variance Data
Data Requirement:
Description on how to prepare data for a single-factor ANOVA.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Post Hoc Analysis
Importance:
If a significant difference is found, post hoc analysis is necessary to determine which specific groups have different means.
Conducting multiple t-tests is not appropriate after finding a significant ANOVA result.
Post Hoc Procedure:
Tukey’s Honest Significant Difference (HSD) is typically utilized for follow-up comparisons among group means.
Note: Detailed methodologies for this are covered in Chapter 18.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Introduction to Factorial Analysis of Variance
Functionality:
Used when testing more than one factor or independent variable.
This methodology provides insights into not only the individual effects of each factor but also their interactions.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Types of Factorial ANOVA
Two Types:
Without Replication:
One factor is not tested multiple times across the same subjects.
With Replication:
Multiple measurements are taken on the same subjects across one factor.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Data Analysis for Factorial ANOVA
Example Questions Addressed:
Is there a difference in weight loss effects between high-impact and low-impact exercise programs?
Is there a difference in weight loss effects based on gender (male vs. female)?
Do the effects of the exercise program differ between genders?
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
The Main Effect
Definition:
A main effect occurs when an independent variable significantly impacts the outcome variable.
Source Table:
ANOVA summary table that presents sources of variance.
Interaction Effect:
This refers to the effect that occurs when the impact of one independent variable varies depending on the level of another independent variable.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Hypotheses in Factorial ANOVA
Null and Research Hypotheses:
These are akin to the hypotheses explored in standard ANOVA, focusing on the equality of means and the differences among them.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Main Effects Analysis
Source Table Example:
Illustration of Main Effects:
Impact:
Sum of Squares: 429.025
df: 1
Mean Square: 429.025
F: 3.011
Significance: .091
Gender:
Sum of Squares: 3222.025
df: 1
Mean Square: 3222.025
F: 22.612
Significance: .000
Interaction (Impact x Gender):
Sum of Squares: 27.225
df: 1
Mean Square: 27.225
F: .191
Significance: .665
Error:
Sum of Squares: 5129.700
df: 36
Mean Square: 142.492
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Plotting the Main Effects
Purpose:
Visual representation of main effects (without interaction) to aid in understanding.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Interaction Effects Analysis
Source Table Example:
Breakdown for interaction effects:
Treatment:
Sum of Squares: 265.225
df: 1
Mean Square: 265.225
F: 2.44
Significance: .127
Gender:
Sum of Squares: 207.025
df: 1
Mean Square: 207.025
F: 1.908
Significance: .176
Interaction (Treatment x Gender):
Sum of Squares: 1050.625
df: 1
Mean Square: 1050.625
F: 9.683
Significance: .004
Error:
Sum of Squares: 3906.100
df: 36
Mean Square: 108.503
Total: 224321.000
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Plotting Interaction Effects
Purpose:
Visual representation of interaction effects to interpret the data effectively.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Using Excel for Two-Factor With Replication
Dialog Box:
Guide on how to set up and analyze two-factor ANOVA with replication using Excel.
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016
Conclusion and Further Reading
Path to Wisdom & Knowledge
Source: Salkind, Statistics for People Who (Think They) Hate Statistics, Excel 2016, 4th Edition, SAGE Inc. © 2016