Business Econometrics Notes
Business Econometrics (BUS-G350)
Kelley School of Business - Indiana University
Lecture 5 Outline
Hypothesis Testing
Scientific Method Definition and Details
Research Paper: Predictive Analytics for Business
Hypothesis Testing
Aim: Assess hypothesis about population
Example Hypothesis:
Population mean expenditure: π = $105
Hypothesized mean: πβ = $105
Data Collection: Collect sample and calculate the sample mean (πΜ ).
Suppose πΜ = $107.
Question: Does π = $105 still hold?
Formal Hypothesis Test Procedure
Collect a random sample.
Compute the sample mean (πΜ ).
Compare sample mean (πΜ ) to hypothesized mean (πβ).
Decision Rule:
Reject the hypothesis if it is βtoo far awayβ from the sample mean.
Otherwise, βfail to rejectβ the hypothesis.
Determining "Too Far Away"
Key Question: How far is βtoo far awayβ?
Need further information to make a determination.
Central Limit Theorem (CLT)
Key Insight:
If sufficient data is present, then the sampling distribution of the sample mean is approximately normally distributed:
XΜ hicksim N(π, rac{πΒ²}{N})
This insight allows us to create a test statistic.
Specifically, we will use the t-statistic.
t-Statistic Formula
Definition: t = rac{XΜ - ΞΌβ}{S_{XΜ }}
Where:
πΜ : Sample Mean
π_{XΜ }: Standard Error of the Sample Mean
π: Sample Standard Deviation
π: Sample Size
πβ: Hypothesized population mean
t-Statistic Analysis
Comparison to Standardization:
When N is large, by the CLT we have
XΜ hicksim N(π, rac{πΒ²}{N})
Distribution of t-Statistic Under the Null Hypothesis
If the null hypothesis is true: t = rac{XΜ - π}{S/ ext{sqrt}(N)}
If N is large, then:
Deductive Logic of Hypothesis Testing
Premises:
If the hypothesis is true.
If N > 30.
Conclusion:
Then
Steps in Hypothesis Testing
Compute t-statistic.
Determine if t-statistic appears to come from the standard normal distribution:
If yes, consistent with hypothesis, fail to reject.
If no, inconsistent with hypothesis, reject the hypothesis.
Understanding "Too Far Away"
If the hypothesis holds, then:
This allows for the calculation of p-values.
p-Value Definition
Definition: The probability of obtaining a t-statistic as extreme as the one observed.
p-Value Calculation Steps:
Compute t-statistic (t).
Place t and -t on standard normal x-axis.
Calculate probability > t and < -t.
Summate to find p-value.
Hypothesis Testing Example
Given:
πβ = 105,
πΜ = 107,
π = 10,000,
π = 1.
Example t-statistic calculation:
Interpretation of the p-Value
t-stat: 200.
p-value:
Difficult to calculate manually; traditionally done via βtable lookup.β
Current methods utilize statistical software to automate calculations.
p-value < 0.001
Interpretation: Hypothesis is likely false; reject hypothesis.
Cut-off Values for p-Values
Establish significance levels for hypothesis testing:
Reject hypothesis if p < 10% (10% significance).
Reject hypothesis if p < 5% (5% significance).
Reject hypothesis if p < 1% (1% significance).
Rejection Region
The graphical representation of rejection regions in hypothesis testing denoting where the null hypothesis can be rejected based on significant t-values.
Hypothesis Testing Errors
Type I Error: Rejecting the null hypothesis when it is true.
Type II Error: Failing to reject the null when it is false.
Both capture misinterpretations of conclusions.
Scientific Method Overview
Interest in causal relationships: Does A cause B?
If affirmative, degree of causation?
Process:
Formulate a hypothesis (e.g., βThis drug reduces cancer risk.β).
Conduct an experiment in a controlled environment.
Experiment: A structured investigation to test hypotheses.
Treatment: Something administered to at least one participating group.
Treatment Effect: Change in outcome as a result of treatment.
Conclusion Drawing from Data
Analysis Steps:
Compare outcomes between treated and untreated groups.
Typically, build confidence intervals for the treatment effects and/or conduct hypothesis tests.
Average Treatment Effect (ATE)
Objective: Find causal effect of treatment (T).
Assign participants randomly to either:
Treatment group (ππ = 1)
Control group (ππ = 0).
Formula for ATE: