Probability Theory and the Binomial Distribution

General Rules for Random Variables

  • Expectation of Combined Random Variables:

    • For any two random variables XX and YY (whether independent or dependent), the expected value of their sum or difference equals the sum or difference of their individual expected values:     E(X+Y)=E(X)+E(Y)E(X + Y) = E(X) + E(Y)E(X−Y)=E(X)−E(Y)E(X - Y) = E(X) - E(Y)E(X±Y)=E(X)±E(Y)E(X \pm Y) = E(X) \pm E(Y)
  • Standard Deviation of Independent Random Variables:

    • For two independent random variables XX and YY, variances are strictly additive:     σ2(X±Y)=σ2(X)+σ2(Y)\sigma^2(X \pm Y) = \sigma^2(X) + \sigma^2(Y)
    • The standard deviation of either the sum or the difference is given by the square root of the sum of the variances:     σ(X±Y)=σ2(X)+σ2(Y)\sigma(X \pm Y) = \sqrt{\sigma^2(X) + \sigma^2(Y)}
    • Variability always compounds regardless of whether the variables are added or subtracted; standard deviations never subtract:     σ(X−Y)=σ2(X)+σ2(Y)\sigma(X - Y) = \sqrt{\sigma^2(X) + \sigma^2(Y)}

The Square Root Law (n\sqrt{n}-Law)

  • Scope and Conditions:

    • Applies to a series of nn independent repetitions of an experiment with outcome variable XX.
    • Each trial has an identical expected value E(X)E(X) and standard deviation σ(X)\sigma(X).
    • The total outcome is the sum SS, where S=X1+X2+⋯+XnS = X_1 + X_2 + \dots + X_n.
    • The average outcome is the sample mean Xˉ\bar{X}, where Xˉ=Sn\bar{X} = \frac{S}{n}.
  • Formulas for the Sum (SS):

    • Expected Value of the Sum:E(S)=n⋅E(X)E(S) = n \cdot E(X)
      • The expected total outcome scales linearly with the number of trials nn.
    • Standard Deviation of the Sum:σ(S)=n⋅σ(X)\sigma(S) = \sqrt{n} \cdot \sigma(X)
      • Due to the additivity of variance across independent repetitions (σ2(S)=n⋅σ2(X)\sigma^2(S) = n \cdot \sigma^2(X)), the standard deviation of the total sum increases by a factor of n\sqrt{n}.
  • Formulas for the Mean (Xˉ\bar{X}):

    • Expected Value of the Mean:E(Xˉ)=E(X)E(\bar{X}) = E(X)
      • The average outcome across nn trials has the exact same expected value as a single experiment.
    • Standard Deviation of the Mean (Standard Error):σ(Xˉ)=σ(X)n\sigma(\bar{X}) = \frac{\sigma(X)}{\sqrt{n}}
      • As the sample size nn increases, the spread of the sample mean shrinks by a factor of 1n\frac{1}{\sqrt{n}}, producing a more concentrated distribution around the true mean.

The Binomial Distribution

  • Parameters and Definition:

    • Applies to a binomially distributed random variable XX modeling the total number of successes in repeated Bernoulli trials.
    • nn: The fixed total number of independent experiments or trials.
    • pp: The constant probability of success on each trial (0≤p≤10 \le p \le 1).
    • 1−p1 - p: The probability of failure on each trial.
    • kk: The number of successes obtained, taking discrete integer values: k=0,1,2,3,…,nk = 0, 1, 2, 3, \dots, n.
  • Probability Mass Function (PMF):

    • The probability of observing exactly kk successes out of nn trials is calculated as:     P(X=k)=(nk)⋅pk⋅(1−p)n−kP(X = k) = \binom{n}{k} \cdot p^k \cdot (1 - p)^{n - k}
    • The binomial coefficient (nk)\binom{n}{k} ("nn choose kk") calculates the total number of combinations for arranging kk successes among nn independent trials:     (nk)=n!k!⋅(n−k)!\binom{n}{k} = \frac{n!}{k! \cdot (n - k)!}
    • pkp^k accounts for the compound probability of kk successes.
    • (1−p)n−k(1 - p)^{n - k} accounts for the compound probability of the remaining n−kn - k failures.
  • Expectation (Verwachting):

    • The theoretical average number of successes across nn trials is:     E(X)=n⋅pE(X) = n \cdot p
  • Standard Deviation (Standaardafwijking):

    • The spread of the number of successes around the mean is given by:     σ(X)=n⋅p⋅(1−p)\sigma(X) = \sqrt{n \cdot p \cdot (1 - p)}

Curricular and Examination Context

  • Formula Availability:
    • These reference formulas—including the rules for combining random variables, the n\sqrt{n}-law for sums and averages, and the binomial distribution parameters—are provided standardly during classroom tests (repetities) and official Dutch School Examinations (SE / schoolonderzoek).