Independent Sample T-Tests
INDEPENDENT SAMPLE T-TESTS
Introduction
Course: PSY207 - Psychological Statistics
Instructor: Tim Pruitt, Ph.D.
Types of Samples for Mean Comparisons
Independent Samples
Also known as: Between-subjects or Between-groups.
Characteristics:
- Observations are mutually exclusive with no overlap or connection.
Dependent Samples
Also known as: Within-subjects or Within-groups.
Characteristics:
- Observations have some overlap or connection to each other.
- Examples include repeated measures and matched groups.
Key Features
Separate groups of participants are used for different treatment conditions.
Random assignment is employed to place participants in treatment conditions.
Only one score is obtained for each participant.
Data Requirements for Independent Sample t-Tests
Data should be of interval or ratio scale.
Observations (scores) within each sample must be independent:
- Since the samples consist of different participants, they maintain independence.
Assumptions of Independent t-Test
Core Assumptions
Random Sampling: The sample must represent the population.
Normality: The data should be approximately normally distributed (this is more flexible with larger samples).
Equal Variances: The populations must have equal variances, known as homogeneity of variance.
- If the variances are significantly different, they are termed heterogeneous.
Sample Variability Measures
Calculation of Variability
Sample Variance (
): Calculated using the sums of squares (SS).
Sample Standard Deviation (
): The square root of the sample variance.
Pooled Variance
Definition & Requirement
Pooled Variance combines variance estimates from each sample. It requires that:
- Variance from each sample is approximately equal.
- A rule of thumb is: one variance should not be more than twice the other.
Calculation Formulas
Pooled Variance (
) is calculated as:
-
Pooled Standard Deviation (
):
-
Pooled Standard Error
Calculation
Pooled Standard Error (
) can be calculated using:
- With pooled variance:
-
- With pooled standard deviation:
-
Unpooled Standard Error
Usage
An unpooled standard error is used when sample variances are significantly dissimilar:
-Importance of the unpooled method includes preventing inaccuracies in estimates and minimizing Type I and Type II error rates.
Hypothesis Testing in t-Tests
Models for Null and Alternative Hypotheses
Null Hypothesis (H0): Assumes no difference in means (
).
Alternative Hypothesis (H1): Assumes difference exists (
).
Test Statistic Computation
The test statistic formula:
Degrees of Freedom
Degrees of Freedom Calculation
Combined degrees of freedom from each sample:
-If variances are unequal, the calculation may require more advanced statistical software (e.g., SPSS, JASP).
- A conservative measure might involve using:
-
Effect Size Measures
Cohen’s d Definition
Cohen's d is calculated as:
Variance Accounted For (r²)
Calculation:
Interpretation Ranges
Cohen's d:
- d < |0.2|: Small - |0.2| < d < |0.8|: Medium - d > |0.8|: LargeVariance Accounted For (r²):
- r² = 0.01: Small
- r² = 0.09: Medium
- r² = 0.25: Large
Confidence Intervals in t-Tests
Estimation of Differences
Confidence intervals estimate the difference between population means (
):
- Formula:
Note on Presentation
Alternative intervals can be generated for each group, especially useful in graphical presentations.
Always use a two-tailed critical value when assessing significance.
Statistical Software Outputs
Interpretation
Outcomes from statistical software might present findings such as non-significant differences between treatment and control groups (e.g., p > .05).
Noteworthy tests include:
- Levene’s Test: Used to test homogeneity of variances. If significant (p < .05), use an alternative (Welch's t-test).
- Shapiro-Wilk Test: Determines normality of each group.
Comedian Example Study
Context and Data
Study on the likability of comedians based on content type:
- Neutral Comedian:
- Mean Rating (M): 5.2,
- Variance (s²): 2.17,
- Sample Size (n): 15.
- Offensive Comedian:
- Mean Rating (M): 2.75,
- Variance (s²): 2.21,
- Sample Size (n): 12.
Hypothesis Statements
Null Hypothesis (H0): No difference between offensive and neutral comedians.
Alternative Hypothesis (H1): A difference exists between offensive and neutral comedians.
Calculating Degrees of Freedom
t Critical Value Determination
For a two-tailed test at α = .01,
The critical t value:
Test Statistic Calculation
Calculate Estimated Standard Error:
Using pooled variances, where:
-Conduct t-test:
-
Decision Rule
Since the calculated t value (-4.30) is less than the critical t value (-2.787), reject H0.
Effect Size Calculation
Calculate Cohen’s d:
Confidence Interval at 99%
Lower CI:
Upper CI:
Overall Interpretation
The results indicate a significant difference in likability between comedians based on their content, with a large effect size reported.
Caffeine Reaction Time Example
Hypothesis: Caffeine increases reaction speed.
Group Data:
- Caffeinated Group:
- Mean (M): 681.2 ms, Standard Deviation (s): 35.44, Sample Size (n): 8.
- Control Group:
- Mean (M): 710.5 ms, Standard Deviation (s): 51.26, Sample Size (n): 9.If significant at α = .05, effect size and CI r² and 95% CI should be calculated accordingly.