Introduction to Hypothesis Testing and Testing a Population Mean
Core Principles of Hypothesis Testing
Definition and Purpose: Hypothesis testing is a procedure that uses sample evidence and probability models to make statements regarding a population and subsequently check the validity of those statements.
The Three-Step Scientific Method Link: The process of statistics mirrors the scientific method: * Step 1: Make a statement regarding the nature of the population. * Step 2: Collect data (evidence) to test that statement. * Step 3: Analyze the data to assess the plausibility of the initial statement.
The Foundation: Statistics is built upon foundational steps that culminate in hypothesis testing, which is described as the "roof on the house" of the discipline.
Defining the Hypotheses
The Null Hypothesis (): * Pronounced as "\text{ naught}". * Represents the statement to be tested. * Symbolizes "no change," "no effect," or "no difference." * It is the status quo—everything is exactly what it was thought to be. * Requirement: The null hypothesis is always an equality statement ( or ).
The Alternative Hypothesis ( or ): * Denoted as or sometimes . * The statement for which we are trying to find evidence to support. * Data is used to either support or disprove the alternative. * Assumption: We assume the null hypothesis is true throughout the test until evidence suggests otherwise.
Types of Hypothesis Tests
Two-Tailed Test: * Symbolized by "not equal to" (). * Used when the researcher believes a change occurred but does not know the direction (greater or less than). * Confidence Intervals: These are effectively two-tailed hypothesis tests.
Left-Tailed Test: * Symbolized by "less than" (). * The focus is on values appearing to the left on a distribution curve.
Right-Tailed Test: * Symbolized by "greater than" (). * The focus is on values appearing to the right on a distribution curve.
Consistency of the Null: Regardless of the tail type, the null hypothesis () is always set up the same way as an equality statement.
Parameters of Interest and Symbols
Proportion (): Used when dealing with percentages or probabilities. * Example: Medco Pharmaceutical antibiotic side effects (headaches). * *
Mean (): Used when dealing with averages (e.g., speed, time, or money). * Example: Test if a mean speed is greater than . * *
Standard Deviation (): Hypothesis tests can also be conducted on the variability of a population, following the same logic as means and proportions.
Decision Errors: Type I and Type II
Theoretical Framework: In reality, the truth is unknown, but a conclusion must be made based on evidence.
Type I Error (): * Occurs when you reject the null hypothesis when it is actually true. * Cheating Example: Accusing a friend of cheating when they were actually playing fair. This results in a "wrongfully accused" situation and is often more detrimental (likely leading to a mad or lost friend). * Hypothesis tests are typically built around controlling the probability of a Type I error.
Type II Error (): * Occurs when you fail to reject the null hypothesis (do not accuse) when the alternative is true (they were cheating). * Cheating Example: Your friend was cheating, but you failed to catch or accuse them. The friend is not mad; they "got away with it."
Correct Decisions: * Rejecting the null when the alternative is true. * Not rejecting the null when the null is true.
Statistical Significance and the P-Value
Level of Significance (): * The probability of making a Type I error. * The same used in confidence intervals. * Common Values: is the gold standard. However, it can be adjusted based on risk: * Low risk (e.g., Tylenol extra strength test): Might increase to . * High risk (e.g., Chemotherapy drug with fatal side effects): Might decrease to .
P-Value: * The probability that you "live in the tail" (the probability of obtaining the test statistic or one more extreme, assuming the null is true). * Decision Rule: If , reject the null hypothesis.
Stating Conclusions
The "No Accept" Rule: Statistically, we never accept the null hypothesis. We either "Reject the null" or "Fail to reject the null."
Phrasing for Rejection (): "There is sufficient evidence to support the claim that [Alternative Hypothesis]."
Phrasing for Failure to Reject (): "There is not sufficient evidence to support the claim that [Alternative Hypothesis]."
Connection to the Alternative: Conclusions are always phrased in terms of whether there is support for the alternative, not the truth of the null.
Requirements for Testing a Population Mean (Step 0)
Before conducting a test, specific conditions must be met:
Randomness: The sample must be obtained via Simple Random Sample (SRS) or a randomized experimental design (random assignment to groups to reduce bias).
Normality: One of the following must be true: * The sample size is large (). * The population is stated to be normally distributed. * The data shows a linear trend on a Normal Probability Plot (plotting values against -scores).
Independence: The sample size should be less than of the population () so that sampling without replacement has no significant effect.
Step-by-Step Hypothesis Testing Procedure
Step 0: Check conditions (Randomness, Normality, Independence).
Step 1: Determine the null () and alternative () hypotheses.
Step 2: Select the level of significance ().
Step 3: Compute the test statistic. For a mean, we use the -statistic: * * Note: We use because we are estimating two parameters from the sample: the sample mean () and the sample standard deviation ().
Step 4: Determine the p-value (using Excel functions like
T.DIST).Step 5: Make a decision (Reject or Do Not Reject ).
Step 6: State the conclusion in context.
Case Study: Wyoming Student Debt
Scenario: The national mean student debt is . A sample of individuals in Wyoming shows a mean of with a standard deviation of . We want to know if Wyoming's debt is less than the national average.
Step 0 (Conditions): * Random: Stated in the problem (Check). * Normality: , which is (Check).
Step 1 (Hypotheses): * *
Step 2 ():
Step 3 (Test Statistic): * * Numerator (negative) indicates the sample mean is less than the population mean. * The result is a negative -value, which is consistent with a left-tailed test.