Exhaustive Study Notes: Discrete Probability Distributions
Chapter Learning Objectives
LO1: Define and identify discrete and continuous random variables.
LO2: Develop, graph, and interpret valid probability distributions for discrete random variables.
LO3: Calculate and interpret the expected value, variance, and standard deviation for discrete random variables.
LO4: Develop and interpret the bivariate probability distribution for two discrete random variables.
LO5: Calculate and interpret the covariance and correlation coefficient for two discrete random variables.
LO6: Calculate and interpret the expected value and variance of a linear combination of two random variables.
LO7: Identify and use the binomial probability function to compute the probability of a specified number of successes out of a given number of trials.
LO8: Calculate and interpret the expected value, variance, and standard deviation for binomial experiments.
LO9: Identify and use the Poisson probability function to compute the probability of a specified number of occurrences over a given interval.
LO10: Calculate and interpret the expected value, variance, and standard deviation for Poisson experiments.
LO11: Identify and use the hypergeometric probability function to compute the probability of a specified number of successes out of a given number of trials.
LO12: Calculate and interpret the expected value, variance, and standard deviation for hypergeometric experiments.
Introduction to Discrete Random Variables and Distributions
Probability distributions serve as statistical models for populations of data.
A random variable provides a numerical description of experimental outcomes by associating a specific numerical value with each possible outcome.
Discrete probability distributions fall into two primary structural types:
Tabular Discrete Distributions: Presented as a two-column table where the first column lists possible values of the random variable and the second column lists their corresponding probabilities (assigned using classical, subjective, or relative frequency methods).
Mathematical Functions: Uses a specific mathematical formula to compute probabilities for each value of the random variable (e.g., binomial, Poisson, hypergeometric distributions).
Classification of Random Variables
Random variables are classified based on the numerical values they assume.
Discrete Random Variables:
May assume either a finite number of values or an infinite sequence of integer values ().
Example 1 (Finite Values): An accountant taking the Certified Public Accountant (CPA) examination. The exam consists of 4 parts. Defining , assumes finite values .
Example 2 (Infinite Sequence): Patient arrivals at a hospital emergency room during a 1-day period. Defining , assumes values from the infinite sequence .
Example 3 (Qualitative Outcomes Numerically Coded): A commercial recall survey asking whether an individual remembers a TV commercial message. Outcomes are qualitative (Cannot recall / Can recall). Arbitrarily defining for cannot recall and for can recall converts qualitative outcomes into a discrete random variable.
Continuous Random Variables:
May assume any numerical value in an interval or collection of intervals.
Typically associated with experimental outcomes based on measurement scales such as time, weight, distance, and temperature.
Example 1 (Time Scale): Monitoring incoming calls to an insurance company claims office. Defining , can assume any value in the interval (e.g., , , ).
Example 2 (Distance Scale): Emergency ambulance service monitoring a 90-mile section of Interstate Highway I-75 north of Atlanta, Georgia. Defining , assumes any value in the interval .
Developing Discrete Probability Distributions
The probability distribution for a random variable describes how probabilities are distributed across its values.
For a discrete random variable , a probability function provides the probability for each value .
Probability Assignment Methods:
Classical Method: Applicable when experimental outcomes generate equally likely values of the random variable. For rolling a single die, , , .
Subjective Method: Relies on individual judgment; different analysts develop different probability distributions.
Relative Frequency Method: Used when large historical datasets exist (e.g., scanner data, credit card records, social media data). Produces an empirical discrete distribution.
Case Study: DeCarlo Motors (Saratoga, New York) Empirical Distribution:
Historical data over operational days for daily automobile sales ():
cars sold: days
car sold: days
cars sold: days
cars sold: days
cars sold: days
cars sold: days
Decision-making applications:
Most probable daily sales level: car ().
Probability of selling or more cars in a day:
Required Conditions for any Valid Discrete Probability Function:
Non-negativity condition:
Summation condition:
Discrete Uniform Probability Distribution Formula: Where is the total number of possible values for the random variable.
Expected Value, Variance, and Standard Deviation
Expected Value ( or ):
A measure of central location or expected long-run average.
Formula:
DeCarlo Motors Calculation:
Forecasting Monthly Sales ( operating days):
Variance (\text{Var}(X) or \sigma^2):
A measure of variability or dispersion that weights squared deviations from the mean by their probability.
Formula:
DeCarlo Motors Calculation:
Standard Deviation (\sigma):
Measured in the same original units as the random variable, making interpretation easier than variance.
Formula:
DeCarlo Motors Calculation:
Excel Implementation using SUMPRODUCT:
Inputs: Random variable values in range
A2:A7, probabilities inB2:B7.Expected Value (cell
B9):=SUMPRODUCT(A2:A7, B2:B7)Squared Deviations (cells
C2:C7):=(A2-$B$9)^2Variance (cell
B11):=SUMPRODUCT(C2:C7, B2:B7)Standard Deviation (cell
B13):=SQRT(B11)
Bivariate Discrete Distributions, Covariance, Correlation, and Financial Portfolios
A bivariate experiment yields outcomes consisting of pairs of values for two random variables and .
Bivariate Empirical Discrete Probability Distribution Case Study (DeCarlo Motors Dealerships):
Dealership locations: Geneva () and Saratoga () over days.
Total experimental outcomes: outcomes.
Joint probabilities : Given by dividing cell frequencies by . E.g., days with Geneva selling and Saratoga selling ; ; .
Marginal Distributions: Right margin gives marginal distribution for Geneva (); bottom margin gives marginal distribution for Saratoga ().
Total Sales :
Expected total sales
Variance of total sales
Geneva (): ,
Saratoga (): ,
Covariance (\sigma_{xy}):
Formula:
DeCarlo Motors Calculation:
Positive covariance indicates daily sales at the two dealerships move in the same direction.
Correlation Coefficient (\rho_{xy}):
Formula:
DeCarlo Motors Calculation:
Value near indicates a weak positive linear association. Independent random variables have a correlation coefficient of .
Financial Portfolio Applications:
Probability distribution across 4 economic scenarios for Large Cap Stock Fund () and Long-Term Government Bond Fund ():
Scenario 1 (): Stock return = , Bond return =
Scenario 2 (): Stock return = , Bond return =
Scenario 3 (): Stock return = , Bond return =
Scenario 4 (): Stock return = , Bond return =
Individual Fund Expected Values & Variances:
Linear Combinations of Two Random Variables ():
Expected Value Formula:
Variance Formula:
Evaluation of Portfolio Alternatives:
Given :
Alternative 1 (100% Stock Fund): Expected Return = , Standard Deviation =
Alternative 2 (100% Bond Fund): Expected Return = , Standard Deviation =
Alternative 3 (50/50 Portfolio, ):
Key Insight: The 50/50 portfolio dominates the 100% bond fund because it achieves both a higher return () and lower risk () due to negative covariance between stock and bond returns.
Alternative 4 (25/75 Portfolio, ):
Binomial Probability Distribution
Four Properties of a Binomial Experiment:
The experiment consists of a sequence of identical trials.
Two outcomes are possible on each trial: Success () or Failure ().
The probability of success, denoted by , remains constant from trial to trial (Stationarity assumption). The probability of failure is .
The trials are independent (the outcome of any trial does not affect others).
If properties 2, 3, and 4 hold, the trials are generated by a Bernoulli process. Adding property 1 forms a binomial experiment.
Difference between Stationarity and Independence:
Stationarity requires to remain constant. If a salesperson becomes tired over 10 calls and drops from to on the 10th call, stationarity fails even if each family's decision is independent.
Binomial Formula Derivation:
Number of experimental outcomes with successes in trials:
Probability of any single sequence yielding successes in trials:
Binomial Probability Function :
Case Study: Martin Clothing Store ( customer purchase decisions, , ):
Probability of purchases out of customers:
Complete Probability Distribution ():
Example with , , :
Expected Value and Variance Formulas for Binomial Distribution:
Expected Value:
Variance:
Standard Deviation:
Calculations for Martin Clothing Store:
For :
For customers:
Excel
BINOM.DISTFunction:Syntax:
=BINOM.DIST(x, n, p, cumulative)Point probability ():
=BINOM.DIST(B5, $D$1, $D$2, FALSE)Cumulative probability ():
=BINOM.DIST(B9, $D$1, $D$2, TRUE)()
Poisson Probability Distribution
Used to estimate the number of occurrences over a specified interval of time or space (e.g., arrivals to emergency room, highway repairs per 10 miles, pipeline leaks per 100 miles).
Two Required Properties for a Poisson Experiment:
The probability of an occurrence is the same for any two intervals of equal length.
The occurrence or non-occurrence in any interval is independent of occurrence or non-occurrence in any other interval.
Poisson Probability Function Formula: Where is the mean or expected number of occurrences in the interval, and e \approx 2.71828$.\n\n- Poisson Distribution Properties:\n - The mean and variance are equal:\n E(X) = \mu\n \text{Var}(X) = \sigma^2 = \mu\n \sigma = \sqrt{\mu}\n\n- Case Study 1: Hospital Emergency Room Arrivals (Time Interval):\n - \mu = 10 arrivals per 15-minute period.\n - Probability of exactly 5 arrivals in 15 minutes:\n f(5) = \frac{10^5 e^{-10}}{5!} = 0.0378\n - Variance \sigma^2 = 10\sigma = \sqrt{10} = 3.16$.
Converting to a 3-minute interval:
Note: Probability of arrival in 3 minutes () is NOT equal to probability of arrivals in 15 minutes (), despite equal average arrival rates per unit time.
Case Study 2: Major Highway Defects (Length/Distance Interval):
Average defect rate = defects per mile.
For a 3-mile highway section: defects.
Probability of no major defects ():
Probability of at least one major defect:
Excel
POISSON.DISTFunction:Syntax:
=POISSON.DIST(x, mu, cumulative)Point probability for :
=POISSON.DIST(A9, $D$1, FALSE)Cumulative probability for :
=POISSON.DIST(A9, $D$1, TRUE)Difference:
Interval Probability ():
Probability of more than 20 arrivals:
Hypergeometric Probability Distribution
Key Differences from Binomial Distribution:
Trials are NOT independent.
Probability of success changes from trial to trial because sampling occurs without replacement from a finite population.
Mathematical Parameters:
= Total population size
= Total number of successes in population
= Total number of failures in population
= Sample size
= Number of successes in sample ( failures in sample)
Hypergeometric Probability Function Formula: Valid for and n - x \le N - r$.\n\n- Case Study: Ontario Electric Fuses Quality Control:\n - Box of N = 12r = 5N - r = 7n = 3 fuses.\n - Probability of finding exactly 1x = 1):\n f(1) = \frac{\binom{5}{1} \binom{7}{2}}{\binom{12}{3}} = \frac{(5)(21)}{220} = \frac{105}{220} = 0.4773\n - Probability of finding zero defective fuses (x = 0):\n f(0) = \frac{\binom{5}{0} \binom{7}{3}}{\binom{12}{3}} = \frac{(1)(35)}{220} = 0.1591\n - Probability of finding at least one defective fuse:\n 1 - f(0) = 1 - 0.1591 = 0.8409\n\n- Hypergeometric Mean and Variance Formulas:\n - Mean:\n E(X) = \mu = n \left(\frac{r}{N}\right)\n - Variance:\n \text{Var}(X) = \sigma^2 = n \left(\frac{r}{N}\right) \left(1 - \frac{r}{N}\right) \left(\frac{N - n}{N - 1}\right)\n - Calculation for Fuse Example (n = 3, r = 5, N = 12):\n \mu = 3 \left(\frac{5}{12}\right) = 1.25\n \sigma^2 = 3 \left(\frac{5}{12}\right) \left(1 - \frac{5}{12}\right) \left(\frac{12 - 3}{12 - 1}\right) = 0.77\n\n- Excel `HYPGEOM.DIST` Function:\n - Syntax: `=HYPGEOM.DIST(x, n, r, N, cumulative)`\n - Point probability for x = 0, n = 3, r = 5, N = 12: `=HYPGEOM.DIST(A6, $D$1, $D$2, $D$3, FALSE)` \rightarrow 0.1581\n\n# Case Studies and Managerial Applications\n\n- Case Study 1: Go Bananas Cereal (Great Grasslands Grains, Inc. - GGG):\n - Scenario: 16 oz boxes containing rice flakes and banana-flavored marshmallows. Standard weight range for marshmallows is 1.6\,\text{oz}2.4\,\text{oz}.\n - Quality target: Process failure rate p = 0.088\% non-compliant boxes) when process operates properly.\n - Sampling plan: Weekly random sample of n = 25 boxes.\n - Shutdown criterion: Process shut down if at least 5X \ge 5).\n - Managerial Report Tasks:\n 1. Calculate shutdown probability under normal operating conditions (n = 25, p = 0.08, P(X \ge 5)) and evaluate policy.\n 2. Determine maximum allowable defect threshold in sample of 25\le 1\%.\n 3. Determine target process failure rate pP(X \ge 5) \le 0.01$.
Case Study 2: McNeil's Auto Mall:
Scenario: Dealership staffing on Saturday mornings (8:00 AM to 12:00 PM). Customer arrival rate averages customers per hour (Poisson process).
Service duration: Salesperson spends average of 1 hour per customer.
Management goal: Maintain optimal balance of high perceived demand by having 2 more customers on lot than salespeople.
Risk threshold: Accept customer overload (more than 2 unserved customers above staffing level) no more than of the time ().
Managerial Report Tasks:
Identify arrival probability distribution (Poisson distribution with /hour).
Evaluate current staffing of salespeople () against the risk limit.
Calculate minimum number of salespeople required to satisfy target criteria.
Case Study 3: Tuggler Corporation Grievance Committee:
Scenario: Grievance committee composed of annual volunteers randomly drawn from total respondents. Accounting department observed zero representation over past 5 years.
Managerial Report Tasks:
Identify selection probability distribution (Hypergeometric distribution with population , accounting volunteers , sample ).
Compute probability of zero accounting members selected for each individual year ().
Compute combined 5-year probability of zero accounting representation (product of individual annual probabilities).
Analyze root causes and recommend structural changes to increase accounting representation.
Case Study 4: Sagittarius Casino - POSO Game:
Game Mechanics: Player chooses 2 distinct integers from . Two dice rolled.
Win if 1st chosen number appears on at least one die.
Win if 2nd chosen number appears on both dice.
Win otherwise.
Managerial Report Tasks:
Calculate single-game winning probability .
Calculate expected payout per play .
Compute casino expected net profit per play given a play fee, and state minimum play fee required to guarantee positive casino profit.
Appendix: Discrete Probability Distributions with R
R syntax and functions for discrete probability distributions:
Binomial Distribution in R:
Case Study: Martens specialty clothing targeted email campaign ( emails sent, click probability).
Probability function :
dbinom(x, size, prob)Example command:
dbinom(0:10, size = 10, prob = 0.3)Cumulative probability :
pbinom(q, size, prob)
Poisson Distribution in R:
Probability function :
dpois(x, lambda)Example command for :
dpois(5, lambda = 10)Cumulative probability :
ppois(q, lambda)
Hypergeometric Distribution in R:
Case Study: Ontario Electric fuses (, defective , non-defective , sampled ).
Function syntax:
dhyper(x, m, n, k)Where = sample successes, = population successes, = population failures, = sample size.
Example command for defective fuse:
dhyper(1, m = 5, n = 7, k = 3)Cumulative probability :
phyper(q, m, n, k)