Independent Samples Comparisons: Parametric t-Tests and the Wilcoxon-Mann-Whitney Test
Overview of Independent Samples Comparisons
Comparing the means of two populations using independently collected sample data is one of the most fundamental hypothesis-testing procedures in statistics.
Independent sampling implies that the selection of observations in the first sample has no operational influence on or connection to the observations selected in the second sample.

Motivating Example 1: Human Hematocrit by Sex
Hematocrit measures the volume percentage of red blood cells in whole blood.
Research context: A clinical comparison evaluating hematocrit concentrations between 17-year-old biological males and females.
Sample sizes: males and females.
Male sample statistics: Mean = , Standard Deviation () = .
Female sample statistics: Mean = , Standard Deviation () = .
Core question: Determine whether the numerical difference between the sample means reflects an underlying true difference in population parameters () or simple random sampling error.
Motivating Example 2: Psychoactive Treatment in Blowflies
Research context: An experimental study evaluating feeding behavior modifications caused by the psychoactive agent Pargyline in blowflies.
Treatment group: blowflies administered Pargyline.
Control group: blowflies administered isotonic saline.
Response variable: Amount of sucrose solution consumed over a interval ().
Control sample statistics: Mean = , Standard Deviation () = .
Pargyline sample statistics: Mean = , Standard Deviation () = .
Scientific question: Determine if Pargyline significantly stimulates sucrose consumption compared to saline control.
Mathematical Framework of the Independent Samples t-Test
Hypothesis Formulation:
Non-directional (two-tailed) hypotheses evaluate whether any divergence exists between the two population means:
Null Hypothesis ():
Alternative Hypothesis ():
General Test Statistic Formula:
The general test statistic measures the distance between the observed difference in sample means and the hypothesized difference under the null model, scaled by the standard error of that difference:
Under standard testing conditions, the hypothesized null difference is set to zero (), yielding the operational test statistic:
Standard Error of the Difference Between Means:
The standard error (), sometimes abbreviated as , is computed as:
Hematocrit Standard Error Application: Using standard deviations and with sample denominators and :
Assumptions and Variance Homogeneity Testing via the F-Distribution
Parametric Assumptions:
Both samples are randomly selected and mutually independent.
The underlying populations are normally distributed.
Homoscedasticity: The population variances are equal ().
Equal Variance Standardization:
When standard deviations are equal (), sample variances are combined into a single pooled variance estimate (), enhancing standard error precision and boosting test power:
When sample sizes are balanced (), this simplifies algebraically:
The F-Distribution and the F-Test for Equal Variances:
The F-statistic evaluates equality of variance by calculating a ratio of sample variances:
The F-distribution is bounded from to , non-symmetric, and skewed to the right. Its exact probability density profile depends upon numerator degrees of freedom () and denominator degrees of freedom ().

As displayed in the distribution density models:
For , of the distribution lies above .
For , of the distribution lies above .
Standard calculation convention assigns the larger sample variance to the numerator, guaranteeing an empirical .
Hypotheses for Variance Equality:
Null hypothesis:
Alternative hypothesis:
Strategic Risk: Because statistical power is maximized when the equal-variance assumption holds, researchers deliberately protect against a Type II error (failing to detect unequal variances when they truly differ). Setting the significance threshold higher than typical values (e.g., or ) is common practice.

Determining Degrees of Freedom
Welch-Satterthwaite Approximation:
When population variances cannot be assumed equal, the degrees of freedom () are calculated using the Welch-Satterthwaite equation:
Individual group standard errors are defined as:
Comparative Strategies for Degrees of Freedom:
Most conservative manual approach: Take the smaller of and (). This minimizes Type I error risk.
Least conservative approach: Sum individual degrees of freedom, using .
The Welch-Satterthwaite formula produces an intermediate value strictly positioned between the conservative and least conservative bounds.

Step-by-Step Two-Sample t-Test: Lizard Malaria Parasitemia
Study Setup and Empirical Data:
A study examined whether infection with the malarial parasite Plasmodium reduces red blood cell concentrations in lizards.
Sample: field-caught lizards, separated by malarial infection status.
Red blood cell count units: .
Sample parameters:
Noninfected lizards: , ,
Infected lizards: , ,
Hypotheses Formulation:
Directional alternative hypotheses testing for cell count reduction:
Directional null:
Directional alternative:
Non-directional equivalent formulation:
Significance level: .
Step 1: Preliminary F-Test for Homogeneity of Variance:
Ratio computation (larger variance in numerator):
Numerator degrees of freedom: .
Denominator degrees of freedom: .
Statistical inference: The calculated is far below critical table thresholds. Thus, fail to reject . Equal variance can be assumed.
Step 2: Calculating the Standard Error of the Difference:
Evaluating independent standard errors:
Step 3: Determining the Decision Threshold (Critical Value of t):
Using the conservative approach for manual calculation: .
For a two-tailed test at with , Table IV yields critical values:
Decision rule: Reject the null hypothesis only if calculated or .
Step 4: Computing the t-Statistic:
Substituting sample values into the test statistic:
Step 5: Statistical Conclusion:
Since is well within the interval , fail to reject .
Conclusion: There is insufficient evidence to conclude that infected and noninfected lizards possess different red blood cell concentrations.
Error Analysis: While this conclusion could represent a Type II error (false negative), setting explicitly controls the maximum risk of committing a Type I error (false positive).
Nonparametric Alternative: The Wilcoxon-Mann-Whitney Test
Characteristics of Nonparametric Testing:
Used when continuous outcome data violate the distributional assumption of normality.
Function as distribution-free procedures based on relative ranks rather than raw parametric measurements.
Trade-off: Nonparametric tests exhibit lower statistical power than the independent-samples t-test when population normality is satisfied, but remain valid when normality fails.
Case Study: Soil Respiration in Forest Canopy Gaps:
Measurement: Soil respiration expressed as microbial output in .
Environmental habitats:
Growth zone: Underneath a dense, closed forest canopy ().
Gap zone: Underneath an opening in the forest canopy ().
Raw observations:
Growth ():
Gap ():
Normality Assessment via Probability Plots:

Growth distribution summary: Mean = , Standard Deviation = , Sample size , Anderson-Darling () = , . The extreme right-skew demonstrates non-normality.

Gap distribution summary: Mean = , Standard Deviation = , Sample size , Anderson-Darling () = , .
Formulation of Hypotheses:
Non-directional framing:
Null hypothesis (): Gap and growth areas do not differ with respect to soil respiration rates.
Alternative hypothesis (): Gap and growth areas do differ with regard to soil respiration rates.
Directional framing:
Null hypothesis (): Growth areas either do not differ from Gap areas in soil respiration rates, or show lower rates.
Alternative hypothesis (): Growth areas tend to show higher soil respiration rates than Gap areas.
Ranking Procedure and Counting Inversions ( and ):
For each observation in a given sample, tally how many observations in the opposing sample have a smaller value. Exact ties are credited as .
Sorted Growth () | Number of Gap Obs Smaller | Sorted Gap () | Number of Growth Obs Smaller |
|---|---|---|---|
(exceeds ) | |||
(exceeds previous plus ) | |||
(exceeds 6 values, ties ) | |||
(exceeds all Gap obs) | |||
(exceeds all Gap obs) | |||
(exceeds all Gap obs) | (exceeds ) | ||
(exceeds all Gap obs) | (exceeds , ties ) | ||
— | — | (exceeds ) | |
Sum | Sum |
Verification Identity for Hand Calculation:
The sum of and must strictly equal the product of the two sample sizes:
Test Statistic and Critical Evaluation:
The Wilcoxon-Mann-Whitney test statistic () is defined as the larger of the two sums:

In Table 6 (Critical Values of U), for sample sizes and at a two-tailed significance level of , the critical value is .
Inference Decision: Because calculated , reject the null hypothesis ().
Substantive conclusion: Soil respiration values are distributed significantly differently between growth and gap environments.
Directional evaluation: The empirical median of the growth areas is substantially higher, supporting the one-tailed claim that growth zones exhibit elevated soil respiration compared to gap zones.
Computational Output via Minitab:
Minitab output analysis:
Growth (): Median =
Gap (): Median =
Point estimate for is
Confidence Interval for :
Rank sum statistic:
Two-tailed test significance: (unadjusted), (adjusted for ties).
Both the manual rank comparison () and the software-based Mann-Whitney test confirm rejection of the null hypothesis at .
Lecture
For a T-test for independent samples, you will be testing for a difference in means. So the hypothesis will be something like:
OR
OR
Test Statistic: ; BUT YOU HAVE THE POWER OF MINITAB
TWO BIG QUESTIONS:
What is ?
If the populations can be assumed to have the same variance, you can utilize the formula:
OR IF the samples are also the same size
Test statistic to determine if the variance is the same: The f statistic - the ratio of two variance, should range closer to 1. Put the larger variance on the numerator. Numerator and denominator of degrees of freedom. You gain greater power if you fail to reject the null hypothesis and so you want to guard AGAINST a type II error, so alpha should be high.
What are the appropriate degrees of freedom?
Typically use the most conservative and choose the lower of the two.
The least conservative would be
You CAN be wrong, but you have CONTROLLED the likelihood of being wrong by setting alpha.
Solving Problems on Minitab
Run a normality test to see if you CAN run a t test.
Need to see the variance of both data sets to see if they have a similar variance.
Go to stat and then ANOVA
Go to test for equal variances
Run the t-test: go to 2-sample t-test which IS for independent samples.