Probability Theory and the Binomial Distribution
General Rules for Random Variables
Expectation of Combined Random Variables:
- For any two random variables and (whether independent or dependent), the expected value of their sum or difference equals the sum or difference of their individual expected values:
Standard Deviation of Independent Random Variables:
- For two independent random variables and , variances are strictly additive:
- The standard deviation of either the sum or the difference is given by the square root of the sum of the variances:
- Variability always compounds regardless of whether the variables are added or subtracted; standard deviations never subtract:
The Square Root Law (-Law)
Scope and Conditions:
- Applies to a series of independent repetitions of an experiment with outcome variable .
- Each trial has an identical expected value and standard deviation .
- The total outcome is the sum , where .
- The average outcome is the sample mean , where .
Formulas for the Sum ():
- Expected Value of the Sum:
- The expected total outcome scales linearly with the number of trials .
- Standard Deviation of the Sum:
- Due to the additivity of variance across independent repetitions (), the standard deviation of the total sum increases by a factor of .
- Expected Value of the Sum:
Formulas for the Mean ():
- Expected Value of the Mean:
- The average outcome across trials has the exact same expected value as a single experiment.
- Standard Deviation of the Mean (Standard Error):
- As the sample size increases, the spread of the sample mean shrinks by a factor of , producing a more concentrated distribution around the true mean.
- Expected Value of the Mean:
The Binomial Distribution
Parameters and Definition:
- Applies to a binomially distributed random variable modeling the total number of successes in repeated Bernoulli trials.
- : The fixed total number of independent experiments or trials.
- : The constant probability of success on each trial ().
- : The probability of failure on each trial.
- : The number of successes obtained, taking discrete integer values: .
Probability Mass Function (PMF):
- The probability of observing exactly successes out of trials is calculated as:
- The binomial coefficient (" choose ") calculates the total number of combinations for arranging successes among independent trials:
- accounts for the compound probability of successes.
- accounts for the compound probability of the remaining failures.
Expectation (Verwachting):
- The theoretical average number of successes across trials is:
Standard Deviation (Standaardafwijking):
- The spread of the number of successes around the mean is given by:
Curricular and Examination Context
- Formula Availability:
- These reference formulas—including the rules for combining random variables, the -law for sums and averages, and the binomial distribution parameters—are provided standardly during classroom tests (repetities) and official Dutch School Examinations (SE / schoolonderzoek).