Lecture: Independent Samples T-Tests

Experimental Design Foundations

Experimental research relies on structured methodologies to assess causal relationships by manipulating independent variables and observing their effects on dependent variables.

Between-Subjects vs. Within-Subjects Designs

Experimental designs are categorised primarily based on how participants are allocated across experimental conditions:

  • Between-Subjects Design (Independent Groups):

    • Different participants are assigned to each experimental condition.

    • Each participant contributes exactly one independent data point to the dataset; there is no overlap and no repeated measurements across conditions.

    • Example: Comparing the research methods examination scores of Year 1 students directly against the scores of Year 2 students.

    • Strengths: Eliminates order effects, practice effects, and fatigue effects because participants experience only a single condition.

    • Weaknesses: Statistically less powerful due to unsystematic individual differences (participant variance) between the distinct groups.

Between-subjects design featuring different participants allocated to separate experimental conditions
  • Within-Subjects Design (Repeated Measures):

    • The same participants take part in all experimental conditions.

    • Each participant serves as their own control, providing repeated measurements across levels of the independent variable.

    • Example: Measuring the same cohort of students on their Research Methods performance versus their Social Psychology performance.

    • Strengths: Statistically more powerful because individual baseline differences are held constant, reducing error variance.

    • Weaknesses: Highly susceptible to order effects, carryover effects, practice, and fatigue.

Within-subjects design featuring a single participant completing multiple experimental conditions

Continuous and Scale Data Characteristics

Inferential mean comparisons require the dependent variable to be continuous. In SPSS, continuous measurements are classified under the Scale measure:

  • Interval Data: Measured along a continuum where intervals between adjacent values are equal, but there is no absolute, non-arbitrary zero point (e.g., temperature in Celsius).

  • Ratio Data: Continuous measurement possessing an absolute true zero, allowing meaningful ratio comparisons (e.g., speed, time, word recall counts).

  • Parametric Representation: Continuous data are summarized through measures of central tendency and dispersion, specifically the mean (μ\mu or Xˉ\bar{X}) and standard deviation (σ\sigma or SDSD).

  • Skewed Data Representation: When distributions deviate from normality, data are summarized using the median and interquartile range (IQRIQR).

Theoretical Logic of T-Tests

Evaluating Differences in the Context of Variance

A common statistical question is whether the observed difference between two sample means is statistically significant or merely the product of random sampling variation. Evaluating whether two means differ requires evaluating the magnitude of the difference relative to the spread (variance) of the underlying distributions.

Two overlapping sample distributions illustrating moderate mean difference amidst wide background spread

When two distributions display substantial spread and overlap heavily, identifying whether an individual score belongs to Condition 1 or Condition 2 is uncertain. Conversely, when the variance within each condition is narrow, the distributions show minimal overlap, making the identical numerical mean difference substantially more likely to reflect a genuine, statistically significant effect.

Two distinct sample distributions with narrow variance exhibiting minimal overlap between conditionsOverlapping distributions showing an individual data score falling within the shared region

The tt Statistic as a Variance Ratio

The tt statistic represents a signal-to-noise ratio comparing between-condition variance to within-condition variance:

t=Variance explained by the IVUnexplained variance (error / individual differences)t = \frac{\text{Variance explained by the IV}}{\text{Unexplained variance (error / individual differences)}}

  • Numerator (Between-Condition Variance): The difference between group means, attributed to the manipulation of the independent variable.

  • Denominator (Within-Condition Variance): Uncontrolled variability resulting from individual differences, measurement error, and environmental noise.

  • Null Hypothesis Significance: The tt-test evaluates how likely the observed mean difference would occur if the null hypothesis (H0H_0) were true (i.e., if the true population distributions overlapped completely). If tt is sufficiently large, the observed effect is unlikely to be an artifact of chance, yielding a low probability value (p<0.05p < 0.05).

Statistical Assumptions and Diagnostic Testing

Parametric vs. Non-Parametric Frameworks

Every inferential statistical procedure relies on specific mathematical assumptions regarding the distribution and structure of the data:

  • Parametric Tests: Statistical techniques that estimate population parameters and require data to meet stringent criteria (e.g., continuous measurement, normal distribution, homogeneity of variance). They have higher statistical power to detect an effect when their assumptions are fulfilled.

  • Non-Parametric Tests: Distribution-free tests that make fewer distributional assumptions. They transform continuous raw scores into ranks or assess medians, and serve as direct alternatives when parametric assumptions are violated.

The Assumption of Normality

Parametric tests require the continuous dependent variable to be normally distributed within each condition. A normal distribution exhibits a symmetrical bell-shaped curve where the highest frequency of observations clusters around the central mean, tapering off symmetrically toward the positive and negative tails.

Galton board demonstration showing random physical dispersion yielding a normal distribution curve

Deviations from normality invalidate parametric probability calculations. Common violations include:

  • Negative Skew: Scores cluster at the upper end of the scale, creating an elongated tail toward the negative (lower) values (e.g., a test that is excessively easy, creating a ceiling effect).

  • Positive Skew: Scores cluster at the lower end of the scale, creating an elongated tail toward the positive (higher) values (e.g., a test that is excessively difficult, creating a floor effect).

  • Bimodal Distributions: The distribution features two distinct peaks, indicating that the sample comprises two distinct sub-populations.

Comparison of non-normal distributions including negative skew, positive skew, and bimodal curves alongside a normal distribution

The Shapiro-Wilk Test of Normality

While visual inspection of histograms provides an initial evaluation of distribution shape, formal inferential tests determine whether empirical data deviate significantly from a theoretical normal curve. The Shapiro-Wilk (WW) test is the preferred metric, particularly for small-to-moderate sample sizes (compared to the alternative Kolmogorov-Smirnov test).

  • Statistical Question: What is the probability that the observed distribution occurred by chance from a normally distributed population?

  • Hypothesis Formulation:

    • H0H_0: The sample distribution is not significantly different from a normal distribution (Data=Normal Distribution\text{Data} = \text{Normal Distribution}).

    • H1H_1: The sample distribution is significantly different from a normal distribution (Data≠Normal Distribution\text{Data} \neq \text{Normal Distribution}).

  • Decision Criterion:

    • p>0.05p > 0.05 (Non-Significant): Retain H0H_0. There is no significant difference between the data and a normal distribution; the assumption of normality is met.

    • p<0.05p < 0.05 (Significant): Reject H0H_0. The data deviate significantly from a normal distribution; the assumption of normality is violated.

Step-by-Step Execution of Normality Testing in SPSS

To conduct normality testing in SPSS:

  1. Navigate the top menu: Analyze > Descriptive Statistics > Explore....

SPSS navigation pathway to the Explore menu via Descriptive Statistics
  1. In the Explore dialog box, move the continuous dependent variable into the Dependent List: field.

  2. For between-subjects designs with multiple conditions, transfer the categorical independent variable into the Factor List: field.

  3. Click the Plots… button on the right-hand side.

Explore dialog box showing variable placement in the Dependent List and Factor List
  1. Under the Descriptive panel, uncheck Stem-and-leaf and check Histogram.

  2. Check the checkbox for Normality plots with tests.

  3. Click Continue, then click OK.

Explore Plots configuration dialog showing Histogram and Normality plots with tests selected

Interpreting Normality Test Outputs and Histograms

The SPSS output window displays two primary tables for assessing distribution shape:

  • Descriptives Table: Displays the Mean, 95%95\% Confidence Interval for Mean (Lower and Upper Bound), 5%5\% Trimmed Mean, Median, Variance, Standard Deviation, Minimum, Maximum, Range, Interquartile Range, Skewness, and Kurtosis.

Descriptives statistics table generated from SPSS Explore output
  • Tests of Normality Table: Features columns for both the Kolmogorov-Smirnov and Shapiro-Wilk tests, listing the test Statistic (WW), degrees of freedom (df\text{df}), and significance value (Sig., which denotes the pp-value).

SPSS Tests of Normality table displaying Kolmogorov-Smirnov and Shapiro-Wilk statistics and significance values
Exemplar Normality Comparisons
Normal Dataset (Assumption Met):   Statistic = 0.987, df = 100, Sig. = 0.425  (p > 0.05 -> Normal)
Skewed Dataset (Assumption Failed): Statistic = 0.931, df = 41,  Sig. = 0.015  (p < 0.05 -> Non-normal)
Comparative histograms and Shapiro-Wilk tables displaying normally distributed data versus significantly skewed data

One-Sample T-Test

Purpose and Experimental Setup

A One-Sample T-Test evaluates whether the mean of a single continuous sample differs significantly from a known, predetermined threshold, benchmark, or population mean (e.g., assessing whether a cohort of students performs significantly better than a known national average of 7070).

  • Independent Variable: None (no experimental manipulation or control group).

  • Dependent Variable: One continuous variable measured once per participant.

  • Comparative Reference: A single, fixed numerical test value.

Formal Assumptions

  1. Independence of Data: Each observation is independent; each participant contributes exactly one measurement.

  2. Continuous Measurement: The dependent variable is measured at the interval or ratio level.

  3. Normality: The sample distribution is normally distributed (p>0.05p > 0.05 on the Shapiro-Wilk test).

Worked Example: Motorway Driving Speeds

An investigation measured the driving speeds of N=30N = 30 motorists on a UK motorway to test whether speeds significantly exceeded the legal motorway speed limit of 70 MPH70\,\text{MPH}.

  • Sample size: N=30N = 30

  • Observed sample mean and standard deviation: 80.04±6.22 MPH80.04 \pm 6.22\,\text{MPH}

  • Hypothesized test value (μ0\mu_0): 70 MPH70\,\text{MPH}

Data Setup in SPSS
  • Data View: Structured with one row per participant.

  • Variable View: A single continuous column titled Speed, set to Scale under the Measure property.

SPSS Data View showing raw continuous speed measurements for participants
Verifying Normality

Running Analyze > Descriptive Statistics > Explore... on the Speed variable produces:

  • Shapiro-Wilk: Statistic =0.953= 0.953, df=30\text{df} = 30, Sig. =0.209= 0.209.

  • Kolmogorov-Smirnov: Statistic =0.152= 0.152, df=30\text{df} = 30, Sig. =0.076= 0.076.

  • Evaluation: Because p=0.209>0.05p = 0.209 > 0.05, the speed data are not significantly different from a normal distribution; the assumption of normality is met.

Tests of Normality table confirming the normality of the continuous speed variable

SPSS Procedure for One-Sample T-Tests

  1. Navigate to Analyze > Compare Means > One-Sample T Test....

SPSS menu pathway to execute a One-Sample T Test
  1. In the One-Sample T Test dialog box, transfer the dependent variable (Speed) into the Test Variable(s): box.

  2. In the Test Value: box at the bottom, enter the comparative benchmark (e.g., 70).

  3. Click OK.

One-Sample T Test setup dialog box with test variable and test value defined

Interpreting and Reporting One-Sample T-Test Results

The test generates two primary output tables:

  • One-Sample Statistics:

    • N=30N = 30

    • Mean=80.0403\text{Mean} = 80.0403

    • Std. Deviation=6.22106\text{Std. Deviation} = 6.22106

    • Std. Error Mean=1.13580\text{Std. Error Mean} = 1.13580

  • One-Sample Test:

    • Test Value=70\text{Test Value} = 70

    • t=8.840t = 8.840

    • df=29\text{df} = 29

    • Sig. (2-tailed)=.000\text{Sig. (2-tailed)} = .000 (reported as p<0.001p < 0.001)

    • Mean Difference=10.04033\text{Mean Difference} = 10.04033

    • 95%95\% Confidence Interval of the Difference: Lower =7.7174= 7.7174, Upper =12.3633= 12.3633

One-Sample T Test output tables displaying descriptive statistics and inferential test values
Results Reporting Structure

Formal reporting of statistical analyses must follow this sequence:

  1. Data Handling: Clarify data screening, extraction of descriptive parameters, and treatment of outliers.

  2. Descriptive Statistics: State the mean and standard deviation (M±SDM \pm SD), including measurement units.

  3. Test Identification & Assumptions: State the test utilized and confirm the status of assumption checks.

  4. Inferential Statistics: Report the test statistic, degrees of freedom, and exact probability: t(df)=t-value,p=p-valuet(\text{df}) = t\text{-value}, p = p\text{-value}.

Standard Model Report: "The mean speed of the participants was 80.04±6.22 MPH80.04 \pm 6.22\,\text{MPH}. The data met the assumptions of a one-sample tt-test, which revealed that this was significantly faster than the speed limit of 70 MPH70\,\text{MPH} (t(29)=8.84,p<0.001t(29) = 8.84, p < 0.001".

Non-Parametric Alternative: One-Sample Wilcoxon Signed-Rank Test

Rationale and Operational Differences

When continuous single-sample data violate the assumption of normality, the parametric One-Sample T-Test is invalid. In this scenario, the non-parametric equivalent is the One-Sample Wilcoxon Signed-Rank Test.

  • Mechanism: Non-parametric tests evaluate the median rather than the mean. Because the mean is sensitive to extreme values and skewness, the median provides a more robust indicator of central tendency for non-normal distributions.

  • Null Hypothesis: The population median of differences between data points and the hypothesized test value equals zero (or the sample median equals the hypothesized median).

SPSS Step-by-Step Procedure

  1. Navigate to Analyze > Nonparametric Tests > One Sample....

SPSS menu pathway to access One-Sample Nonparametric Tests
  1. In the tabbed interface, select the Fields tab.

  2. Ensure the dependent variable (Speed) is positioned in the Test Fields: window.

  3. Select the Settings tab.

  4. Select the radio button for Customize tests.

  5. Check the box for Compare median to hypothesized (Wilcoxon signed-rank test).

  6. In the Hypothesized median: field, enter the comparative value (70).

  7. Click Run.

Settings tab in One-Sample Nonparametric Tests configuring the Wilcoxon signed-rank test

Interpreting Output and Median Visualization

The output window provides an automated hypothesis test summary alongside test statistics and median plots:

  • Hypothesis Test Summary:

    • Null Hypothesis: The median of Speed equals 70.0070.00.

    • Test: One-Sample Wilcoxon Signed Rank Test.

    • Significance (Sig.): .000.000.

    • Decision: Reject the null hypothesis.

  • Test Summary Metrics:

    • Total N=30\text{Total } N = 30

    • Test Statistic=463.000\text{Test Statistic} = 463.000

    • Standard Error=48.618\text{Standard Error} = 48.618

    • Standardized Test Statistic(Z)=4.741\text{Standardized Test Statistic} (Z) = 4.741

    • Asymptotic Sig. (2-sided test)=.000\text{Asymptotic Sig. (2-sided test)} = .000

  • Graphical Representation: Contrasts the observed sample median (80.0680.06) against the hypothetical benchmark median (70.0070.00).

SPSS Nonparametric Hypothesis Test Summary and Wilcoxon Signed Rank Test summary tableOne-sample Wilcoxon signed-rank histogram contrasting hypothetical median against observed median

Independent-Samples T-Test

Purpose and Experimental Design Requirements

An Independent-Samples T-Test (Between-Subjects T-Test) compares the means of two mutually exclusive, unrelated groups to evaluate whether their population means differ significantly.

  • Design Structure: Between-subjects design with independent groups.

  • Independent Variable: Exactly one categorical factor comprising exactly two levels (dichotomous groups, such as experimental vs. control, noise vs. silence).

  • Dependent Variable: Exactly one continuous variable measured once per participant.

Assumptions Checklist

  1. Independence of Observations: Data points must be collected from separate participants; no participant belongs to more than one group.

  2. Continuous Measurement: The dependent variable must be interval or ratio.

  3. Adequate Sample Size: A minimum sample size of N=12N = 12 participants per condition (N≥24N \ge 24 across two groups).

  4. Normality: The dependent variable must be normally distributed within each condition independently.

  5. Homogeneity of Variance: The variance of the continuous dependent variable must be equal (homogeneous) across both experimental groups.

Homogeneity of Variance & Levene's Test

Homogeneity of variance evaluates whether the dispersion of data points around the group mean is comparable across both conditions.

Visual representation of unequal variances violating the assumption of homogeneity of varianceVisual representation of equal variances satisfying the assumption of homogeneity of variance

Evaluating homogeneity of variance involves three diagnostic steps:

  1. Descriptive Comparison: Examining descriptive dispersion metrics across conditions (SDSD, variance, standard error, confidence intervals). Extreme disparities suggest potential violations.

  2. Graphical Inspection: Visualizing distributions using histograms or boxplots to ensure equal dispersion width.

  3. Inferential Testing via Levene's Test: Formal hypothesis testing for the equality of variances:

    • H0H_0: σ12=σ22\sigma_1^2 = \sigma_2^2 (Variances between Condition 1 and Condition 2 are equal).

    • H1H_1: σ12≠σ22\sigma_1^2 \neq \sigma_2^2 (Variances between Condition 1 and Condition 2 are significantly different).

  • Interpretation: A non-significant result (p>0.05p > 0.05) indicates homogeneity of variance is met; a significant result (p<0.05p < 0.05) indicates homogeneity of variance is violated.

Quantile-Quantile (Q-Q) Plots

A Normal Q-Q Plot graphs the quantiles of the observed sample distribution directly against the theoretical quantiles expected from a standard normal distribution:

  • Ordered empirical observations are plotted along the x-axis, while expected normal values are plotted along the y-axis.

  • If data points fall roughly along the straight diagonal reference line, the data conform to the specified distributional properties.

  • Systematic curved departures, S-shapes, or severe scattering indicate skewness, kurtosis, or variance discrepancies.

Normal Q-Q plot illustrating observed data points plotted linearly along the expected normal diagonal reference line

Worked Example: Environmental Noise and Word Recall

An experiment tested whether environmental background noise impairs verbal memory retention:

  • Sample: N=24N = 24 participants allocated into two independent groups (n=12n = 12 per condition).

  • Condition 1 (Noise): Participants memorized a list of words in a noisy environment.

  • Condition 2 (Silence): Participants memorized the identical list of words in complete silence.

  • Dependent Variable: Total number of words correctly recalled (Score).

Data Setup in SPSS
  • One row per participant (2424 rows total).

  • Column 1: Condition (Independent Variable, coded as 1 = Noise, 2 = Silence).

  • Column 2: Score (Dependent Variable, continuous scale).

SPSS Data View with coded Condition column and continuous Score column
Testing Assumptions: Normality per Group

Normality must be evaluated separately for each condition by placing Score in the Dependent List: and Condition in the Factor List:.

  • Noise Condition (n=12n = 12):

    • Shapiro-Wilk: Statistic =0.938= 0.938, df=12\text{df} = 12, p=0.467p = 0.467

    • Kolmogorov-Smirnov: Statistic =0.192= 0.192, df=12\text{df} = 12, p=0.200∗p = 0.200^*

  • Silence Condition (n=12n = 12):

    • Shapiro-Wilk: Statistic =0.963= 0.963, df=12\text{df} = 12, p=0.825p = 0.825

    • Kolmogorov-Smirnov: Statistic =0.164= 0.164, df=12\text{df} = 12, p=0.200∗p = 0.200^*

  • Conclusion: Both Shapiro-Wilk significance values exceed 0.050.05, satisfying the assumption of normality for each condition.

SPSS Tests of Normality table displaying Shapiro-Wilk statistics for Noise and Silence conditions

SPSS Step-by-Step Procedure

  1. Navigate to Analyze > Compare Means > Independent-Samples T Test....

SPSS menu pathway to access the Independent-Samples T Test dialog
  1. Move the continuous dependent variable (Score) into the Test Variable(s): list.

  2. Move the categorical factor (Condition) into the Grouping Variable: box.

Independent-Samples T Test dialog box with Score in Test Variables and Condition in Grouping Variable
  1. Click the Define Groups… button.

  2. In the Use specified values input fields, type the numerical codes assigned to each condition (e.g., Group 1: 1, Group 2: 2).

Define Groups sub-dialog configuring numerical codes 1 and 2 for group comparisons
  1. Click Continue, then click OK.

Evaluating Assumptions: Normality & Levene's Test Outputs

The Independent-Samples T-Test output includes Levene's Test for Equality of Variances alongside inferential test statistics:

  • Levene's Test Results:

    • F=0.177F = 0.177

    • Sig. (pp) =0.678= 0.678

    • Interpretation: Because p=0.678>0.05p = 0.678 > 0.05, the variances between the noise and silence conditions do not differ significantly. The assumption of homogeneity of variance is met.

Levene's Test for Equality of Variances table showing non-significant F and Sig values

Interpreting Results and Reporting Standards

Because Levene's test is non-significant, read statistics from the Equal variances assumed row.

  • Group Statistics:

    • Noise (n=12n = 12): Mean=7.2500\text{Mean} = 7.2500, SD=2.49089SD = 2.49089, Std. Error=0.71906\text{Std. Error} = 0.71906

    • Silence (n=12n = 12): Mean=13.8333\text{Mean} = 13.8333, SD=2.75791SD = 2.75791, Std. Error=0.79614\text{Std. Error} = 0.79614

  • Independent Samples Test Output (Equal variances assumed):

    • t=−6.137t = -6.137

    • df=22\text{df} = 22

    • Sig. (2-tailed)=.000\text{Sig. (2-tailed)} = .000 (p<0.001p < 0.001

    • Mean Difference=−6.58333\text{Mean Difference} = -6.58333

    • Std. Error Difference=1.07279\text{Std. Error Difference} = 1.07279

    • 95%95\% Confidence Interval of the Difference: Lower =−8.80817= -8.80817, Upper =−4.35850= -4.35850

Complete Independent Samples Test table displaying Levene's test and t-test statistics for equal variances assumed and not assumedBar chart displaying mean words recalled in Noise versus Silence conditions with error bars representing 1 standard deviation

Standard Model Report: "The mean number of words recalled was calculated for the noise (M=7.25,SD=2.49M = 7.25, SD = 2.49) and silence conditions (M=13.83,SD=2.76M = 13.83, SD = 2.76). The data met the assumptions for an independent-samples tt-test, which revealed that significantly fewer words were recalled in the noise condition compared to the silence condition (t(22)=−6.14,p<0.001t(22) = -6.14, p < 0.001".

Adjusting for Violations of Homogeneity of Variance

When Levene's test is significant (p<0.05p < 0.05), the assumption of homogeneity of variance is violated. Rather than abandoning the parametric framework, SPSS provides an automated correction via Welch's tt-test.

  • Procedure: Read directly from the second row: Equal variances not assumed.

  • Effect on Degrees of Freedom: The degrees of freedom are adjusted downward to a non-integer decimal value to compensate for unequal variances (df=21.776\text{df} = 21.776 in this dataset).

  • Comparative Row Metrics:

    • Equal variances assumed: t(22)=−6.137,p<0.001t(22) = -6.137, p < 0.001

    • Equal variances not assumed: t(21.776)=−6.137,p<0.001t(21.776) = -6.137, p < 0.001

SPSS Independent Samples Test highlighting the Equal variances assumed versus Equal variances not assumed rows

Non-Parametric Alternative: Mann-Whitney U Test

Indications for Use

When data violate other parametric assumptions—such as non-normal distributions in one or both conditions, sample sizes smaller than N=12N = 12 per group, or ordinal-level measurement—the Mann-Whitney U Test is the required non-parametric alternative for between-subjects comparisons.

  • Mechanism: Rather than comparing group means, the Mann-Whitney U test pools all observations across groups, converts continuous scores into ranks (11 to NN), and evaluates differences in the mean ranks (and medians) between groups.

SPSS Step-by-Step Procedure (Legacy Dialogs)

  1. Navigate to Analyze > Nonparametric Tests > Legacy Dialogs > 2 Independent Samples....

SPSS menu pathway navigating through Nonparametric Tests and Legacy Dialogs to 2 Independent Samples
  1. In the Two-Independent-Samples Tests dialog box, move the continuous dependent variable (Score) into the Test Variable List:.

  2. Move the independent variable (Condition) into the Grouping Variable: box.

  3. Click Define Groups… and enter group codes (1 and 2). Click Continue.

  4. Under the Test Type options, check the box for Mann-Whitney U.

  5. Click OK.

Two-Independent-Samples Tests dialog box with Mann-Whitney U selected under Test Type

Interpreting Mann-Whitney U Outputs and Reporting

The output displays rank distributions and inferential test statistics:

  • Ranks Table:

    • Noise (n=12n = 12): Mean Rank=6.92\text{Mean Rank} = 6.92, Sum of Ranks=83.00\text{Sum of Ranks} = 83.00

    • Silence (n=12n = 12): Mean Rank=18.08\text{Mean Rank} = 18.08, Sum of Ranks=217.00\text{Sum of Ranks} = 217.00

    • Total N=24\text{Total } N = 24

  • Test Statistics Table:

    • Mann-Whitney U=5.000\text{Mann-Whitney } U = 5.000

    • Wilcoxon W=83.000\text{Wilcoxon } W = 83.000

    • Z=−3.883Z = -3.883

    • Asymp. Sig. (2-tailed)=.000\text{Asymp. Sig. (2-tailed)} = .000

    • Exact Sig. [2*(1-tailed Sig.)]=.000\text{Exact Sig. [2*(1-tailed Sig.)]} = .000

    • Decision: When exact significance is available, report the exact two-tailed value (p<0.001p < 0.001). The significant result indicates that word recall was significantly lower in the noise condition compared to the silence condition.

Mann-Whitney Test output tables displaying Ranks breakdown and inferential Test Statistics

Statistical Decision Summary & Core Pairings

Research Objective

Parametric Test

Required Assumptions

Diagnostic Test

Non-Parametric Equivalent

Compare 1 Sample to Benchmark

One-Sample T-Test

Independent observations, Continuous scale, Normal distribution

Shapiro-Wilk (p>0.05p > 0.05)

One-Sample Wilcoxon Signed-Rank Test

Compare 2 Independent Groups

Independent-Samples T-Test

Independent observations, Continuous scale, n≥12n \ge 12 per group, Normal distribution per group, Homogeneity of variance

Shapiro-Wilk (p>0.05p > 0.05), Levene's Test (p>0.05p > 0.05)

Mann-Whitney U Test (or Welch's tt-test if only homogeneity fails)

Key Reporting Rules in APA Style

  • Report descriptive statistics as Mean and Standard Deviation (M±SDM \pm SD) for parametric tests, and Median and Interquartile Range (Mdn,IQR\text{Mdn}, IQR) or Mean Ranks for non-parametric tests.

  • Italicize statistical notation: tt, pp, FF, UU, WW, ZZ, NN, nn, df\text{df}.

  • Degrees of freedom are presented in parentheses immediately following the test statistic: t(29)=8.84t(29) = 8.84.

  • Report probability values to three decimal places. When SPSS displays Sig. = .000, report as p<0.001p < 0.001 (never as p=0.000p = 0.000).

  • Always report two-tailed (two-sided) significance values unless a directional hypothesis has been pre-specified.