Probability, Normal Curves, Sampling Distributions, and Confidence Intervals
Probability Foundations and Set Operations
Definition of Probability:
Probability represents the likelihood of an event occurring.
Mathematical bounds: (or to ), where signifies no chance of occurrence and (or ) signifies absolute certainty.
Notation: denotes the probability that event occurs.
Classical Probability Formula:
is the number of ways event can occur.
is the total number of possible outcomes in the sample space .
Complement Rule:
The complement of event (denoted as or ) consists of all outcomes in the sample space where does not happen.
The sum of an event and its complement always equals certainty: .
Example: If the probability of snow is , then .
Basic Probability Example:
In a class consisting of students, are coffee drinkers and are non-coffee drinkers.
Probability of randomly selecting a coffee drinker:
Two-Way Contingency Tables:
Used to categorize individuals across two categorical variables simultaneously.
Reference distribution of students classified by academic standing (Year through ) and coffee consumption:
Year : coffee drinkers, non-coffee drinkers (Total = students).
Year : coffee drinkers, non-coffee drinkers (Total = students).
Year : coffee drinkers, non-coffee drinkers (Total = students).
Year : coffee drinker, non-coffee drinker (Total = students).
Year : coffee drinker, non-coffee drinkers (Total = student).
Column Totals: Total coffee drinkers = ; Total non-coffee drinkers = .
Grand Total: .
Marginal Probability Calculation:
Addition Rules for Union ( / ):
General Addition Rule (accounts for overlapping outcomes to avoid double-counting):
Special Addition Rule (for mutually exclusive / disjoint events where ):
Tabular Example: Probability of choosing a year student OR a coffee drinker:
Method 1 (summing individual mutually exclusive cells):
Method 2 (using general formula):
Joint Probability ( / ):
Represents the probability that both event and event occur simultaneously (the intersection/overlap).
Tabular Example: Probability of choosing a year student and a coffee drinker:
Multiplication Rule for Independent Events:
Special Multiplication Rule: If events and are independent, the occurrence of one does not affect the occurrence of the other:
Multi-event independence example: If the probability of snow on any given day is () independently over consecutive days:
Conditional Probability and Independence
Definition of Conditional Probability:
The probability of an event occurring given that another event has already occurred.
Represents a restriction of the sample space to a specific subset.
Key indicator phrases signaling a conditional probability include: "out of", "if", "given", and "among".
Conditional Probability Notation and Anatomy:
Notation: , read as "the probability of event given event ".
Event is the event of interest (represented in the shaded numerator).
Event is the given condition or restriction (represented in the outlined denominator).
Conditional Probability Formulas:
Definition formula:
General Multiplication Rule for any two events:
Mathematical Condition for Independence:
Two events and are statistically independent if and only if: (Equivalently: )
Worked Contingency Table Applications (-Student Reference Table):
Example 1: Probability of selecting a year student out of the coffee drinkers:
Restriction (denominator): Coffee drinkers ( total).
Event of interest (numerator): year coffee drinkers ( students).
Tabular calculation:
Formal formula verification:
Example 2: Probability of selecting a non-coffee drinker if they are a year student:
Restriction (denominator): year students ( total: coffee, non-coffee).
Event of interest (numerator): Non-coffee drinkers among years ( student).
Tabular calculation:
Normal Probability Distributions and the Empirical Rule
Core Properties of the Normal Distribution:
Continuous probability distribution characterized by a symmetric, unimodal, bell-shaped density curve.
Centered at the population mean (or sample mean ), with spread determined by the standard deviation (or sample standard deviation ).
Notation: , where is the continuous random variable.
Perfect symmetry: Exactly of the data lies to the left of the mean , and lies to the right.
Area as probability: The total area under the density curve equals (or total probability). The area under the curve between any two points equals the probability that the random variable falls within that interval.
The Empirical Rule (-- Rule for Bell-Shaped Distributions):
Within standard deviation of the mean ():
Captures approximately of the data.
Subdivided into from to , and from to .
Within standard deviations of the mean ():
Captures approximately of the data.
Adds in the interval from to , and from to .
Within standard deviations of the mean ():
Captures approximately of the data.
Adds in the interval from to , and from to .
Extreme Tails (beyond standard deviations):
Exactly of data falls below , and falls above .
Cumulative Probability and Interval Operations:
Left-tail cumulative probability: Software functions (such as Minitab cumulative distribution function) return the area to the left: .
Right-tail probability: Computed via complement: .
Interval probability: Computed via subtraction: .
Application Example A — Student Heights ():
Distribution parameters: Mean , standard deviation .
Empirical Rule scale marks: (), (), (), (), (), (), ().
Probability less than or equal to : ( probability that a randomly chosen student is tall or shorter).
Probability greater than or equal to : ( probability that a student is at least tall).
Probability between and : ( probability that a student's height is between and ).
Inverse Normal Calculation ( Percentile):
Given a left-tail area of , find cutoff such that .
Output: . Thus, of students are below .
Inverse Complement Application:
Find the height cutoff where of students are taller.
Left-tail equivalent: .
Cutoff remains .
Application Example B — Sample Distribution of Heights (, , ):
Distribution model: .
Scale marks: (), (), (), (), (), ().
Left-tail calculation: ().
Right-tail calculation: ().
Middle-interval calculation: ().
Percentile calculation: Finding such that yields .
The Standard Normal Distribution and Normality Assessment
Definition of the Standard Normal Distribution:
A specific normal distribution where the center is zero () and spread is one ().
Notation: .
Standardization and the -Score:
A -score transforms any value from a normal distribution into standard normal units.
Formula (population parameters):
Formula (sample statistics):
Definitional meaning: The -score represents the exact number of standard deviations an individual raw observation is located away from the mean.
Probability Calculations for :
Continuous interval probability formula: .
Tail probability examples:
Percentiles of using Inverse Normal Technology:
Calculator/software syntax:
invnorm(area to left, 0, 1).Percentile determination:
Area to the left = ; area to the right = .
Output: .
Criteria for Assessing Normality of Data:
Given information: Explicitly told in the problem statement that the population is normally distributed.
Graphical shape: A histogram of sample data is symmetric and bell-shaped.
Normal Probability Plot (NPP):
A scatter plot graphing observed data values against corresponding expected normal values.
Condition for normality: The data is deemed approximately normally distributed if the NPP is fairly linear.
In formal statistical tests of the NPP, normality is supported when the associated -value is greater than ().
Sampling Distributions for Proportions and Means
Nature of a Sampling Distribution:
A sample statistic varies from sample to sample, making it a random variable with its own probability distribution.
A sampling distribution represents the distribution of values taken by a statistic across all possible distinct random samples of a fixed size drawn from the same population.
Sampling Distribution of the Sample Proportion () — Categorical Data:
Context: Categorical data measuring success () versus failure ().
Point estimate statistic: , where is the number of individuals possessing the characteristic, and is sample size.
Center (Mean of sample proportions):
Spread (Standard error of sample proportions): where is the probability of success and is the probability of failure.
Shape and Normality Condition:
The distribution of is approximately normal if:
Complete model notation: .
Worked Example — High School Statistics Enrollment:
Background: The National Center for Education Statistics reports that the proportion of US high school students taking high school statistics is (). A random sample of students is taken.
Normality check: . Because , the shape is approximately normal.
Center: .
Spread: .
Probability calculation for :
Sampling Distribution of the Sample Mean () — Numerical Data:
The Central Limit Theorem (CLT):
Regardless of the underlying population shape, the sampling distribution of the sample mean becomes approximately normal as the sample size increases.
Operational threshold: is sufficiently large to assume approximate normality.
Conditions to Assume Normality for :
Sample size , OR
Directly told that the underlying population is normal (), OR
The Normal Probability Plot (NPP) of the raw data is linear.
Center (Mean of sample means):
Spread (Standard error of sample means): As sample size increases, the standard error spread decreases.
Complete model notation: .
Worked Example — Pre-Calculus Final Exam Scores:
Background: Population mean score is with standard deviation . A random sample of students is selected.
Normality check: , satisfying the CLT requirement for normality.
Center: .
Spread: .
Probability calculation for :
Confidence Intervals for Population Proportions
Theoretical Principles:
Point Estimate: A single statistic that serves as the best estimate of a parameter. For categorical proportions, the sample proportion serves as the point estimate for .
Interval Estimation Rationale: Because varies from sample to sample, a single point estimate cannot be expected to provide a complete picture of the population parameter. A confidence interval builds an interval of plausible values around the point estimate.
Confidence Level (): The theoretical proportion of intervals that will contain the true population parameter if repeated samples of size are drawn indefinitely.
Precision vs. Confidence Trade-off: Increasing the level of confidence requires a larger critical value, resulting in a wider interval.
Mathematical Structure of Confidence Intervals for :
General format:
Specific formula:
Margin of error component: .
Critical value : Represents the number of standard errors away from center; depends exclusively on the chosen confidence level and corresponds to an area of in each tail ( is total tail area).
Common Critical Values () via
invnorm:Confidence: Tail area
Confidence: Tail area
Confidence: Tail area
Normality Verification Check:
Condition required to apply the normal distribution to the interval:
Fully Worked Example — Pass/Fail Grade Option:
Context: In a random sample of RIT students, support a pass/fail grading option. Construct a confidence interval for the population proportion .
Point estimate:
Normality check:
Standard error calculation:
Margin of error ( confidence, ):
Interval boundaries:
Upper bound:
Lower bound:
Confidence Interval:
Standard Interpretation Template:
Formulation: "We are confident that the population proportion of is between and ."
Contextual statement: "We are confident that the population proportion of RIT students who support the pass/fail grade option is between and ."
Rules for Evaluating Claims from Confidence Intervals:
"Less than" claim: Supported only when the entire confidence interval lies strictly below the claimed value.
"More than" claim: Supported only when the entire confidence interval lies strictly above the claimed value.
"Equal to" claim: Supported/plausible if the value of interest falls inside the confidence interval boundaries.
Confidence Intervals for Population Means
Parameter and Point Estimate:
Parameter: Population mean (applied to numerical data, continuous measurements, means).
Point Estimate: Sample mean (the midpoint of the confidence interval).
The Student's -Distribution:
Need for a new distribution: In practice, the population standard deviation is unknown and must be estimated using the sample standard deviation .
Extra variability: Estimating both with and with from the same sample introduces additional variability. The standard normal curve () does not account for this extra variability; intervals constructed using would fail to capture at the specified rate (e.g., intervals using would contain in fewer than out of samples).
Defining Characteristics of :
Centered at and symmetric.
Similar in shape to the standard normal curve, but shorter at the peak and more spread out in the tails to absorb the extra variability.
Shape changes dynamically with sample size based on degrees of freedom ():
As degrees of freedom () increase, the -distribution curve approaches the standard normal distribution.
Critical value notation: Uses instead of , determined via a -table or
invt(area to left, df).
Mathematical Structure of Confidence Intervals for :
General formula:
Midpoint: .
Margin of error component: .
Normality condition: OR the Normal Probability Plot (NPP) is linear.
Fully Worked Example — Caloric Content in Frozen Dinners:
Given sample statistics: , , .
Objective: Construct a confidence interval for the population mean calories .
Normality check: , fulfilling the CLT normality condition.
Degrees of freedom: .
Critical value: For confidence, tail area is .
Calculator syntax:
invt(0.025, 40)yields critical value .Standard error calculation:
Margin of error calculation:
Interval boundaries:
Upper bound:
Lower bound:
Confidence Interval:
Conclusion and Contextual Interpretation:
"We are confident that the population mean calories in this brand of frozen dinners is between and ."
Follow-Up Claim Analysis Based on the CI :;
Claim: "Can the company claim that the dinners have less than calories?"
Evaluation: No. The claim requires the entire interval to be below , but the interval extends up to .
Claim: "Can we conclude that the dinners have more than calories?"
Evaluation: Yes. The entire interval lies strictly above ().
Claim: "Can we state that the dinners have (are equal to) calories?"
Evaluation: Yes. The value falls within the interval boundaries of and .
Summary of Center, Spread, Normality Checks, and Software Procedures
Normal Probability Distribution ():
Data type: Numerical observations.
Center: Mean (or ).
Spread: Standard deviation (or ).
Normality verification: Explicitly stated/told in problem setup, histogram is symmetric and bell-shaped, or NPP is fairly linear ().
Notation: .
Standard Normal Distribution ():
Data type: Standardized numerical units.
Center: Mean = .
Spread: Standard deviation = .
Normality verification: Explicitly stated/told.
Notation: .
Sampling Distribution of Proportions ():
Data type: Categorical data (proportions, success rates).
Center: Mean = .
Spread: Standard error .
Normality verification: (or explicitly told).
Notation: .
Sampling Distribution of Means ():
Data type: Numerical data (sample averages).
Center: Mean = .
Spread: Standard error .
Normality verification: Sample size , population explicitly stated as normal, or NPP is linear.
Notation: .
Confidence Intervals for Proportions ():
Data type: Categorical data (percentages, proportions of a whole, yes/no queries).
Center (Point estimate): .
Spread (Standard error): .
Normality verification: .
Calculation formula:
Minitab menu path:
Stat>Basic Statistics>1 Proportion.
Confidence Intervals for Means ():
Data type: Numerical data (means, continuous measurements).
Center (Point estimate): .
Spread (Standard error): .
Normality verification: Sample size or NPP of raw data is linear.
Degrees of freedom: .
Calculation formula:
Minitab menu path:
Stat>Basic Statistics>1 Sample t.
Calculator and Software Technology Syntax Summary:
Normal cumulative probability:
normalcdf(lower_bound, upper_bound, center, spread).Standard normal cumulative probability:
normalcdf(lower_bound, upper_bound, 0, 1).Normal cutoff values:
invnorm(area_to_left, center, spread).Standard normal critical values:
invnorm(area_to_left, 0, 1).Student's critical values:
invt(area_to_left, df).