Discrete Probability Distributions - Binomial Distribution
Discrete Probability Distributions
Binomial Random Variable
A random variable is binomial if it meets the following criteria:
- It measures the number of successes in n identical trials.
- Each trial has only two possible outcomes: success or failure.
- The probability of success (and failure) remains constant from one trial to another.
- Trials are independent.
Example 1: Pat's Quiz
Pat, a statistics student, relies on guessing for a quiz with 10 multiple-choice questions, each having 5 possible answers with only 1 correct.
We want to find the probability that:
- Pat answers all questions incorrectly.
- Pat answers exactly 2 questions correctly.
- Pat fails the quiz (score less than 50%, each question worth 1 point).
Example 2: Non-Binomial Scenario
Pat attempts to solve each question rather than guess. However, solving statistics questions is very brain-consuming and Pat gets tired, this means that the chance of getting each question right decreases as he works on the questions. This will not be a binomial experiment because the probability of success does not remain constant.
Bernoulli Distribution
Let B be a random variable that takes the value 1 with probability \pi and the value 0 with probability 1 - \pi.
- Mean of B:
\mu_B = E[B] = \sum bP(b) = 0 \times (1 - \pi) + 1 \times \pi = \pi - Variance of B:
\text{Var}(B) = \sum (b - \mu_B)^2 p(b) = (0 - \pi)^2 (1 - \pi) + (1 - \pi)^2 \pi = \pi^2 (1 - \pi) + (1 - 2\pi + \pi^2) \pi = \pi^2 - \pi^3 + \pi - 2\pi^2 + \pi^3 = \pi - \pi^2 = \pi(1 - \pi)
Binomial Distribution
Let X be a random variable that follows the binomial distribution with parameters n and \pi, denoted as X \sim Bin(n, \pi).
- X is the sum of n Bernoulli random variables with parameter \pi:
X = B1 + B2 + \cdots + B_n - Mean of X:
\muX = E[X] = E[B1] + E[B2] + \cdots + E[Bn] = n\mu_B = n\pi - Variance of X:
\text{Var}(X) = \text{Var}(B1 + B2 + \cdots + Bn), where B1, B2, \text{etc.} are independent of one another, so we can apply the rule about the variance of the sum of independent random variables: \text{Var}(X) = \text{Var}(B1) + \text{Var}(B2) + \cdots + \text{Var}(Bn) = n\pi(1 - \pi)
Example: Number of Boys in a 6-Children Family
Let X = number of boys in families with 6 children where n = 6 and \pi = 0.5 (assuming each birth has a 50% chance of being a boy).
Probability Distribution
| x | p(x) |
|---|---|
| 0 | 0.016 |
| 1 | 0.094 |
| 2 | 0.234 |
| 3 | 0.313 |
| 4 | 0.234 |
| 5 | 0.094 |
| 6 | 0.016 |
| Sum | 1 |
Mean Calculation
\mu = \sum x p(x) = n \pi
In this example: \mu = 6 \times 0.5 = 3
| x | p(x) | xp(x) |
|---|---|---|
| 0 | 0.016 | 0 |
| 1 | 0.094 | 0.094 |
| 2 | 0.234 | 0.468 |
| 3 | 0.313 | 0.939 |
| 4 | 0.234 | 0.936 |
| 5 | 0.094 | 0.470 |
| 6 | 0.016 | 0.096 |
| Sum | 1 | 3.000 |
Variance Calculation
\sigma^2 = \sum (x - \mu)^2 p(x) = n \pi (1 - \pi)
In this example: \sigma^2 = 6 \times 0.5 \times (1 - 0.5) = 1.5
| x | p(x) | xp(x) | \bf{x - \mu} | \bf{(x - \mu)^2} | \bf{(x - \mu)^2 p(x)} |
|---|---|---|---|---|---|
| 0 | 0.016 | 0 | -3 | 9 | 0.144 |
| 1 | 0.094 | 0.094 | -2 | 4 | 0.376 |
| 2 | 0.234 | 0.468 | -1 | 1 | 0.234 |
| 3 | 0.313 | 0.939 | 0 | 0 | 0 |
| 4 | 0.234 | 0.936 | 1 | 1 | 0.234 |
| 5 | 0.094 | 0.470 | 2 | 4 | 0.376 |
| 6 | 0.016 | 0.096 | 3 | 9 | 0.144 |
| Sum | 1 | 3.000 | 1.500 |
Pat's Quiz - Population Mean and Standard Deviation
Suppose that a professor has a class of Pat. What is the population mean? What is the population standard deviation?
Binomial Distribution Table
Table 5 in Appendix B of the textbook provides binomial distribution probabilities.
Essentials of Statistics For Business and Economics, Anderson et al. 9th Edition, pages 813 to 821.