Hypothesis testing notes
Hypothesis Testing
Null and Alternate Hypotheses
Hypotheses: Possible outcomes concerning a new design or claim.
- Example: A new engine design to reduce particulate matter.
- Outcome 1: Design reduces particulate matter.
- Outcome 2: Design does not reduce particulate matter.
- Example: A new engine design to reduce particulate matter.
Null Hypothesis (H0): States that a parameter is equal to a specific value (\mu0).
Alternate Hypothesis (H1): States that the parameter differs from the value specified in the null hypothesis (\mu0).
Types of Alternate Hypotheses
Left-Tailed: The parameter is less than the value specified in the null hypothesis.
- Example: H1: \mu < \mu0
Right-Tailed: The parameter is greater than the value specified in the null hypothesis.
- Example: H1: \mu > \mu0
Two-Tailed: The parameter is not equal to the value specified in the null hypothesis.
- Example: H1: \mu \neq \mu0
One-Tailed Hypotheses: Left-tailed and right-tailed hypotheses.
Examples of Stating Null and Alternate Hypotheses
Example 1: Cereal boxes labeled as containing 20 ounces. An inspector thinks the mean weight may be less.
- Null Hypothesis (H_0): \mu = 20
- Alternate Hypothesis (H_1): \mu < 20 (Left-tailed test)
Example 2: Last year's mean monthly rent was $800. A real estate agent believes this year's mean rent is higher.
- Null Hypothesis (H_0): \mu = 800
- Alternate Hypothesis (H_1): \mu > 800 (Right-tailed test)
Example 3: Standardized test scores have a mean of 70. Modifications are made, and an educator believes the mean may have changed.
- Null Hypothesis (H_0): \mu = 70
- Alternate Hypothesis (H_1): \mu \neq 70 (Two-tailed test)
Reasoning in Hypothesis Testing
Analogy to a Criminal Trial:
- Null hypothesis is like the defendant (assumed true/innocent).
- Data/evidence is presented.
- If evidence strongly contradicts the null hypothesis, we reject it (similar to finding the defendant guilty).
Sample Mean and Variation:
- Example Exam Score:
- H_0: \mu = 80
- H_1: \mu \neq 80
- If sample mean \bar{x} = 78, it's close to 80, so the null hypothesis is plausible.
- If sample mean \bar{x} = 50, it's far from 80, so we might reject the null hypothesis.
- Example Exam Score:
Key Question: How big does the difference need to be before we reject H_0?
- Hypothesis testing methods consider sample size and distribution spread.
Stating Conclusions in Hypothesis Testing
Possible Outcomes:
- Reject the null hypothesis.
- Fail to reject the null hypothesis (do not accept the null hypothesis).
Reject the Null Hypothesis: Conclude that the alternate hypothesis is true.
Fail to Reject the Null Hypothesis: There is not enough evidence to conclude the alternate hypothesis is true. The null hypothesis might be true.
- It means the evidence was not strong enough to reject it.
Example 1 (Cereal Boxes):
- H_0: \mu = 20
- H_1: \mu < 20
- If H_0 is rejected: Conclude the mean weight of cereal is less than 20 ounces.
Example 2 (Cereal Boxes):
- H_0: \mu = 20
- H_1: \mu < 20
- If H_0 is not rejected: There is not enough evidence to conclude the mean weight is less than 20 ounces.
Type I and Type II Errors
Type I Error: Rejecting the null hypothesis when it is actually true.
Type II Error: Failing to reject the null hypothesis when it is actually false.
Correct Decisions:
- Rejecting the null hypothesis when it is false.
- Failing to reject the null hypothesis when it is true.
Example (Dean's Salary Study):
- H_0: \mu = 50,000
- H_1: \mu > 50,000
- Scenario 1: True mean is \mu = 50,000, and the Dean rejects H_0. This is a Type I error.
- Scenario 2: True mean is \mu = 55,000, and the Dean rejects H_0. This is a correct decision.
- Scenario 3: True mean is \mu = 55,000, and the Dean does not reject H_0. This is a Type II error.
Flounder Example: Stating Null and Alternate Hypotheses
- Sample of 100 flounder, sample mean weight is 21.5 grams.
- Test how strong the evidence is that the mean weight differs from 20 grams.
- H_0: \mu = 20
- H_1: \mu \neq 20 (Two-tailed alternate hypothesis)