9/22/26:Discrete Random Variables and Probability Distribution Functions
Foundations of Discrete Random Variables and Probability Distributions
Probability Measure Overview:
- Probability provides a quantitative measure of how likely an event is to occur.
- Values always lie on a closed interval between and , or as a decimal between and inclusive ().
- Classical probability is computed by defining the sample space and taking the ratio of successful outcomes to total possible outcomes:
Probability Distribution Function (PDF):
- In statistics, a PDF is a mathematical function that describes the theoretical or empirical probability distribution over all possible outcomes of a random variable.
- A PDF is not a digital document file format; it is a probability distribution function.
Discrete Random Variables (DRVs):
- Variable: Represents a statistical inquiry or question asked of a population.
- Random Variable: A variable whose numerical outcomes are determined purely by chance.
- Discrete: Characterized by distinct, separate values with finite or countable gaps between them. Continuous values (such as fractional parts or decimals) cannot occur between discrete increments.
Examples of Discrete vs. Non-Discrete Quantities:
- Coin Flipping: Asking a coin whether it lands on heads or tails results in a random outcome.
- Card Drawing: Drawing the top card from a deck yields a suit (heart, spade, diamond, or club) randomly, without deterministic temporal patterns.
- Sibling Counts: Countable values such as , , , , or . Outcomes like or siblings are impossible.
- Die Rolling: Outcomes are strictly bounded to integer faces . Fractional rolls like or cannot exist.
Notation:
- (Capital Letter): Denotes the random variable itself (the statistical question or process).
- (Lowercase Letter): Denotes a specific numerical value that the random variable can attain.
Classroom Coin Flipping Experiment and Frequency Distributions
Experimental Protocol:
- Each participant flips a single coin (nickel) times.
- The random variable represents the total number of heads obtained out of flips ().
Classroom Experimental Data Collection:
- Total sample size of participants reporting data: trials.
- Recorded counts of heads () across participants included values such as .
- Summarized Frequency Distribution across total responses:
- heads: Frequency , Relative Frequency =
- heads: Frequency , Relative Frequency =
- heads: Frequency , Relative Frequency =
- heads: Frequency , Relative Frequency =
- heads: Frequency , Relative Frequency =
- heads: Frequency , Relative Frequency =
Experimental Analysis:
- Mode / Most Frequent Outcome: heads occurred most frequently ( relative frequency).
- Possible Range for Flips: .
- Possible Range for Flips: .
- Even with flips, remains a discrete random variable because non-integer outcomes (e.g., heads) are strictly impossible.
- Expected Range for Flips: For a fair coin, theoretical expected heads is . Practical observations across large populations typically cluster in the range of to heads.
- Sum of Relative Frequencies: Adding all relative frequencies yields exactly (or in decimal form):
Axioms and Mathematical Properties of Probability Distribution Functions (PDFs)
Definition of a Probability Distribution Function (PDF):
- A function that assigns a probability to each possible value of a discrete random variable .
Two Axiomatic Properties of any valid PDF:
- Bounded Probability Property: Every individual probability output must be non-negative and no greater than :
- Completeness Property: The sum of probabilities over all possible outcomes in the sample space must equal exactly (or ):
Connection to Descriptive Statistics:
- A PDF table operates identically to a relative frequency table.
- Frequency tables derived from empirical sampling transition into theoretical probability distribution functions as sample sizes become infinitely large.
Case Study 1: Store Cookie Search Distribution
Scenario:
- Random variable represents the number of grocery stores driven to before finding a specific cookie brand.
- Finding cookies at each store represents a set of mutually exclusive events (once cookies are purchased at store , searching terminates).
PDF Table:
- store: (
- stores: (
- stores: (
- stores: (
Verification of PDF Axioms:
- All individual probabilities satisfy
- Sum of probabilities:
- It is certain that finding the cookies will require driving to either , , , or stores.
Case Study 2: Blueberry Count Analysis per Pint
Scenario:
- Sarah samples pint containers of blueberries at a grocery store and records the count of blueberries () per pint.
Empirical Probability Distribution Table:
- blueberries: (
- blueberries: (
- blueberries: (
- blueberries: (
- blueberries: (
- blueberries: (
- blueberries: Remaining probability mass distributed up to blueberries.
Question 1: Mode (Most Common Count):
- blueberries is the mode, as it exhibits the highest individual probability ( or
Question 2: Probability of At Least 150 Blueberries ():
- Direct Addition Method (utilizing mutual exclusivity):
- Complement Rule Method:
Question 3: Sample Mean ( or Expected Value ):
- Formula for the mean of a PDF table:
- Step-by-step calculation:
- Interpretation: Across repeated sampling, Sarah finds an average of approximately blueberries per pint container. The sample mean must logically lie between the distribution minimum () and maximum ().
Question 4: Sample Median:
- The median represents the point at which cumulative probability reaches or crosses ().
- Cumulative calculation:
- Up through : cumulative probability.
- At : Cumulative probability reaches .
- The threshold is crossed at , making blueberries the median.
Expected Value and Standard Deviation Formulas
Expected Value ( or ):
- The theoretical long-term average outcome resulting from repeating an experiment infinitely many times.
- Under the Law of Large Numbers, as the number of trials approaches infinity, the empirical average converges to the theoretical expected value.
- Formula:
Variance () and Standard Deviation ():
- Measures the spread or dispersion of outcomes relative to the mean .
- The standard deviation serves as a statistical ruler measuring distance from the center.
- Formula for Variance:
- Formula for Standard Deviation:
Example Walkthrough: Flipping Four Fair Coins
Experiment Parameters:
- A fair coin is flipped times ().
- Random variable = number of heads obtained ().
Given PDF Table:
- :
- :
- :
- :
- :
Step 1: Expected Value () Calculation:
- Interpretation: Over long-term repetition of flipping coins, an average of heads is expected.
Step 2: Standard Deviation () Calculation Table:
- For :
- For :
- For :
- For :
- For :
- Sum of weighted squared deviations:
- Take the square root to calculate standard deviation:
Empirical Rule Application and Z-Scores:
- Within standard deviation of the mean ():
- Within standard deviations of the mean ():
- Z-score: Quantifies the exact number of standard deviations a specific data value lies away from the mean :
Questions & Classroom Discussion
Bimodal Distributions:
- Question: What happens if two different values share the same highest frequency?
- Response: Either value can be reported, or both values are stated. The distribution is classified as bimodal.
Identifying Central Tendency:
- Question: Which standard measure of central tendency corresponds to the most frequently occurring value?
- Response: The mode.
Median Determination on Cutoff Boundaries:
- Question: How is the median reported if a percentile threshold lands exactly on a discrete outcome boundary?
- Response: If a discrete outcome boundary falls exactly on the percentile mark, any value between that boundary number and the next discrete data value is technically valid. However, if the percentile falls strictly within a specific data interval, that precise discrete value must be chosen.