P-Values and Statistical Power

Flashcards covering key vocabulary related to p-values, statistical errors, power, and effect size.

P-value

The probability of getting a test statistic equal to or further away from the null expectation given the null is true.

Type I Error

Incorrectly rejecting a true null hypothesis.

Type II Error Rate

Probability of accepting a false null hypothesis.

Type II Error Rate

Also known as False Negative Rate.

Power

The likelihood of not committing type II error.

Type II Error Rate

How often we fail to reject the null hypothesis if the null is false.

Delta x

Effect Size = (x - 0)

1 - Power

The probability of being wrong when the null is false.

Cohen's d

Thresholds for interpreting the effect size: 0.2, 0.5, 0.8

Cohen's w

Thresholds for interpreting the effect size: 0.1, 0.3, 0.5

Cramer's V or Phi

Thresholds for interpreting the effect size: 0.1, 0.3, 0.5

r

Thresholds for interpreting the effect size: 0.2, 0.5, 0.8

Odd Ratio (OR)

Thresholds for interpreting the effect size: 1.5, 2, 3

Risk Ratio (RR)

Thresholds for interpreting the effect size: 2, 3, 4

Cohen's f

Thresholds for interpreting the effect size: 0.1, 0.25, 0.4

Eta Square (n
usquare)

Thresholds for interpreting the effect size: 0.01, 0.06, 0.14

Omega square (w square)

Thresholds for interpreting the effect size: 0.1, 0.3, 0.5

Average spearman Rho

Thresholds for interpreting the effect size: 0.1, 0.3, 0.5

n square

Thresholds for interpreting the effect size: 0.02, 0.13, 0.26

r square

Thresholds for interpreting the effect size: 0.04, 0.25, 0.64