Power Analysis with Known Sample Size

Known Sample Size

Situations with Known Sample Size

  • Existing Data Source: Using a pre-existing dataset for secondary analysis where the sample size is already determined.
  • Fixed Number of Subjects: Limited number of subjects available for data collection within a specific timeframe.
    • Example: Gathering data on patients in a clinic with a low rate of specific cases (e.g., one or two patients per week).
  • Specialized Patient Populations: Working with uncommon groups where obtaining a large sample is difficult.
  • Smaller Studies: Conducting research with inherent limitations on sample size.

Solving for Minimum Detectable Effect Size

  • When to Use: Appropriate when the sample size is known.
  • Scenarios:
    • Repurposing an existing intervention for a new study population where the effect size is uncertain.
    • Investigating a truly novel effect where there's no prior estimate.
    • Literature reports a wide range of effect sizes across multiple studies.
  • Assumptions:
    • Known sample size.
    • Power (e.g., 80% or 90%).
    • Type I error rate (alpha) of 0.05.
    • Two-sided test.
  • Process: Calculate the smallest effect size that can be detected given the assumptions.
  • Value: Provides context on the sensitivity of the study.

Solving for Power

  • When to Use: Appropriate when the sample size and expected effect size are known.
  • Process: Calculate the statistical power based on the known sample size and estimated effect size.
  • Interpretation:
    • Sufficient Power (>= 80%): Confidence in proceeding with the study.
    • Insufficient Power (< 80%): Re-evaluate the study design, and consider increasing the sample size if possible.

A Priori vs. Post Hoc Power Analyses

  • A Priori Power Analysis:
    • Definition: Power calculations performed before data collection or analysis.
    • Recommendation: Crucial for proper study design.
  • Post Hoc Power Analysis (Observed Power):
    • Definition: Power calculations performed after data analysis.
    • Criticism: Widely criticized and not recommended.
    • Issue: Often requested by reviewers/editors but provides limited value.

General Recommendation

  • Perform power calculations routinely during the planning and design phases of research studies.