Theoretical Distributions - ICAI Foundation Statistics
Fundamentals of Theoretical Distributions
Theoretical probability distributions exist both in mathematical theory and in real-world phenomena, classifying into discrete or continuous forms.
A parameter is a defining numerical characteristic of a population or a probability distribution (e.g., the population mean).
A trial is an action or experiment intended to produce an outcome that is neither certain nor impossible.
Bernoulli trials consist of independent trials where each individual trial results in only one of two mutually exclusive outcomes (success or failure).
The cumulative distribution function of a random variable X is defined as F(x)=P(X=x) or F(x)=P(X≤x).
Binomial Distribution
A bi-parametric discrete probability distribution specified by parameters n (number of trials) and p (probability of success).
The binomial random variable x takes discrete whole number values in the range 0≤x≤n.
The probability mass function is given by:
f(x)=nCxpxqn−x
Mean and variance are given by:
Mean=npVariance=np(1−p)
The mean of a binomial distribution is always strictly greater than its variance.
The variance attains its maximum possible value of 4n when p=0.5.
The distribution is completely symmetrical when p=0.5; in this case, the mean and mode are equal.
Depending on the parameter values, the distribution may have either one mode (unimodal) or two modes (bimodal).
Fitting a binomial distribution to empirical data is commonly performed using the method of moments.
Real-world applications include modeling discrete win/loss outcomes, such as the results of One Day International (ODI) cricket matches.
Poisson Distribution
A uni-parametric discrete distribution defined solely by the parameter m=np.
Key underlying assumptions include:
The probability of an occurrence in a small time interval is constant.
The probability of multiple occurrences in an infinitesimal time interval is negligible.
Occurrences in non-overlapping intervals are mutually independent.
A fundamental property of the Poisson distribution is that its mean and variance are equal:
Mean=Variance=m
The distribution is always positively skewed and can be unimodal or bimodal.
Acts as a limiting form of the binomial distribution under the conditions that n→∞ and p→0 such that np remains finite.
Fitting a Poisson distribution to an observed frequency distribution requires equating parameter m directly to the sample mean of the distribution.
Appropriate for modeling rare event frequencies, such as the number of misprints per page in a thick book.
Normal Distribution
The principal continuous probability distribution, defined across the domain −∞<x<∞ with probability density function:
f(x)=σ2π1e−21(σx−μ)2
The normal probability curve is bell-shaped and symmetric about the mean μ, with the total area under the curve equaling 1.
Because of bilateral symmetry, the area from −∞ to μ is 0.50, and the area from μ to ∞ is 0.50.
The mean, median, and mode are always identical.
Points of inflexion for a general normal curve lie at μ−σ and μ+σ; for a standard normal distribution, they lie at −1 and 1.
The area under the curve covered by (μ−3σ,μ+3σ) accounts for all but 0.27% of the distribution (99.73% total coverage).
For a standard normal distribution, the mean deviation about the median equals 0.80.
The quartile deviation (QD) is approximately 0.675σ (e.g., for σ=4, QD=2.70).
The notation Φ(a) designates the cumulative standard normal area evaluated from −∞ to a.
Additive/reproductive property: If X and Y are two independent normally distributed random variables, their sum (X+Y) is also normally distributed.
Well suited for modeling continuous socioeconomic and physical measurements, such as the wages of factory workers.