1/26
Vocabulary terms and statistical concepts covering one-way and factorial Analysis of Variance (ANOVA), assumptions, components of variance, Mean Squares, F-ratios, post-hoc testing, and effect size.
Analysis of Variance (ANOVA)
A statistical hypothesis-testing procedure that provides a single omnibus F test designed to evaluate differences among two or more population means without inflating Type I error.
Experimentwise Error
The probability of committing at least one Type I error when conducting multiple statistical tests (such as multiple t-tests) from a single experiment,
Experimentwise Error (con’t)
If three tests were conducted, each at α = .05, the overall probability of making at least one Type I error would be approximately .14, nearly 3 times the original (intended) alpha level.
Omnibus F Test
A single overall test provided by ANOVA that is designed to detect any differences among group means while holding the Type I error rate at the specified alpha (α) level.
Factor
An independent variable (IV) in an ANOVA design consisting of two or more conditions or treatment groups.
e.g. Control and experimental groups
Levels
The individual treatment conditions or specific values that make up an independent variable (factor).
e.g. Determine if teaching method (IV) affects student performance (DV).
IV: Teaching method (3 levels): 1. Traditional 2. Collaborative 3. Coaching
One-Way ANOVA (Single-Factor ANOVA)
An analysis of variance that evaluates the effects of a single independent variable with two or more levels (levels×1 factor×levels×or×more).
Two-Way ANOVA (Two-Factor ANOVA)
A factorial ANOVA design that assesses the simultaneous effects of two independent variables, each containing two or more levels (×2 levels).
e.g. Determine if teaching method (IV) and time of day (IV) have effects on student performance (DV).
IVs:
Teaching method (3 levels): 1. Traditional 2. Collaborative 3. Coaching
Time of day (2 levels): 1. Morning 2. Afternoon
DV: Student performance (interval/ratio)
Three-Way ANOVA (Three-Factor ANOVA)
Two factors, each with more than 3 levels
Between-Subjects ANOVA
The type of ANOVA conducted when the study samples across treatment conditions are independent of each other.
Within-Subjects ANOVA (Repeated-Measures ANOVA)
The type of ANOVA conducted when the study samples are correlated, such as when the same participants are tested across all treatment conditions.
Assumptions of between-subjects ANOVA
Sampling error is distributed normally around the mean in each treatment population.
Assumptions of between-subjects ANOVA (con’t)
Homogeneity of variance: the population variances of the treatment groups are equal.
Assumptions of between-subjects ANOVA (III)
Observations in a sample are independent of each other.
Homogeneity of Variance
An assumption of between-subjects ANOVA stating that the population variances of the different treatment groups are equal.
Between-treatments variance
Measures differences caused by:
Systematic treatment effects
Random unsystematic factors
Within-treatments variance
Measures differences caused by random unsystematic factors
Total Variance (Total Sum of Squares, SST)
The total variability among all scores in a data set, partitioned into between-groups variance and within-groups variance (SST=SSB+SSW).
Between-Groups Variance (SSB)
The component of variance reflecting differences among the group means
Between-Groups Variance (SSB) [con’t]
Caused by both systematic treatment effects and random, unsystematic factors.
Within-Groups Variance (SSW)
An estimate of the average variability within each separate group, representing error variance
Within-Groups Variance (SSW) [con’t]
It’s caused solely by random, unsystematic factors not controlled by the researcher./
Mean Squares (MS)
Always positive variance estimates computed by dividing a sum of squares (SS) by its associated degrees of freedom (df); these values are always positive.
Mean Square Between (MSB)
The always positive between-groups variance estimate which reflects both treatment effects and error (T+E).
F Ratio (Fobserved)
The test statistic for ANOVA, defined as the ratio of between-groups variance to within-groups variance
Tukey HSD Test
A post-hoc multiple-comparison procedure conducted after a significant omnibus F test to identify which specific pairs of means differ significantly, calculated as HSD=qcritical×nMSW.
Eta-Squared (η2)
A measure of effect size in ANOVA that quantifies the proportion of total variance in the dependent variable accounted for by the independent variable, calculated as η2=SStotalSSbetween.