Quantitative Methods: Central Tendency, Dispersion, Skewness, and Kurtosis

Central Tendency Measures and Properties

  • Definition of Central Tendency:

    • Measures of central tendency identify the center of gravity, center of mass, or average location of a data distribution.

    • In financial and investment applications, central tendency measures (specifically the arithmetic mean) represent expected periodic returns for asset classes, portfolios, or individual investments.

  • Arithmetic Mean:

    • Definition: The sum of all observed values divided by the total number of observations (nn).

    • Mathematical Formula:         xˉ=∑i=1nxin\bar{x} = \frac{\sum_{i=1}^{n} x_i}{n}

    • Key Properties:

      • Sits at the exact mathematical center of the data, meaning positive deviations and negative deviations from the arithmetic mean sum to zero (∑i=1n(xi−xˉ)=0\sum_{i=1}^{n} (x_i - \bar{x}) = 0).

      • Highly sensitive to extreme values or outliers. A single severe outlier pulls the mean disproportionately toward its value.

      • The standard measure of central tendency utilized in mathematical statistics and financial return modeling.

  • Median:

    • Definition: The value of the middle-ranked observation when data points are arranged in order of magnitude (ascending or descending).

    • Positional Calculation: For a dataset with nn observations, the median's rank position is calculated as:         Position=n+12\text{Position} = \frac{n + 1}{2}

    • Implementation Rules:

      • If nn is odd, the median is the value of the exact middle observation at position n+12\frac{n+1}{2}.

      • If nn is even, the position n+12\frac{n+1}{2} yields a midpoint; the median is defined as the arithmetic mean of the two central observation values.

    • Key Properties:

      • Highly robust against extreme values and outliers because extreme magnitudes do not alter the order or value of the central position.

      • Ideal measure of central tendency when evaluating distributions containing severe skewness or fat tails (high kurtosis).

  • Mode:

    • Definition: The observation value that occurs with the highest frequency in a data set.

    • Discrete vs. Continuous Data Applications:

      • Discrete Data: Consists of finite or countable distinct outcomes (e.g., counting the number of rainy days in a month such as 1010, 99, 1212, or 1515 days). The mode is highly effective for discrete data.

      • Continuous Data: Consists of measurements along a continuous spectrum (e.g., precise rainfall volumes measured in microliters or asset returns calculated to infinite decimal places). Exact identical observations rarely recur, making individual modes ineffective or nonexistent.

      • Modal Interval / Modal Range: To apply modal concepts to continuous variables, data distributions are partitioned into ranges or intervals (e.g., return ranges between 0%0\% and 2%2\% or 0%0\% and −2%-2\%). The range containing the greatest number of observations is designated as the modal interval.

    • Multi-Modality:

      • Unimodal: A distribution containing a single peak or mode.

      • Bimodal: A distribution containing two distinct values or intervals tied for the highest frequency.

      • Multimodal: A distribution with three or more modes.

      • No Mode: Occurs when every observation in a dataset appears with equal frequency.

    • Key Properties:

      • Completely unaffected by extreme outliers.

      • Provides limited mathematical utility in analytical financial modeling compared to the mean.

Techniques for Handling Outliers and Non-Stationary Data

  • Definition and Impact of Outliers:

    • An outlier is an observation located a significant distance away from the main cluster of dataset observations.

    • Numerical Illustration of Outlier Sensitivity:

      • Baseline Dataset without Outlier: {2,3,4,5}\{2, 3, 4, 5\} (n=4n = 4).

        • Arithmetic Mean: xˉ=2+3+4+54=144=3.5\bar{x} = \frac{2 + 3 + 4 + 5}{4} = \frac{14}{4} = 3.5

        • Median: Average of 2nd and 3rd observations (33 and 44) = 3+42=3.5\frac{3 + 4}{2} = 3.5

        • Mode: None.

      • Augmented Dataset with Outlier: {2,3,4,5,100}\{2, 3, 4, 5, 100\} (n=5n = 5).

        • Arithmetic Mean: xˉ=2+3+4+5+1005=1145=22.8\bar{x} = \frac{2 + 3 + 4 + 5 + 100}{5} = \frac{114}{5} = 22.8. The mean experiences a severe shift from 3.53.5 to 22.822.8, distorting the representation of central tendency.

        • Median: Value of the 3rd observation (5+12=3rd\frac{5+1}{2} = 3\text{rd}) = 44. The median shifts minimally from 3.53.5 to 44, demonstrating structural stability.

  • Methods to Mitigate Outlier Distortion:

    • Trimmed Mean:

      • Method: Removes a specified percentage of extreme values from both the lower and upper tails of the ranked dataset prior to calculating the arithmetic mean.

      • Operational Example: A 5%5\% trimmed mean ignores the lowest 2.5%2.5\% and highest 2.5%2.5\% of observations, evaluating the arithmetic mean strictly on the remaining central 95%95\% dataset interval.

    • Winsorized Mean:

      • Method: Replaces extreme outlier values outside specified percentile cutoffs with the exact values of those bounding percentiles, rather than discarding them.

      • Operational Example: Given a lower boundary at the 2.5th2.5\text{th} percentile (e.g., −10%-10\% return) and an upper boundary at the 97.5th97.5\text{th} percentile (e.g., +12%+12\% return):

        • Extreme negative returns such as −12%-12\% or −20%-20\% are recoded upward to −10%-10\%.

        • Extreme positive returns such as +15%+15\% are recoded downward to +12%+12\%.

        • The arithmetic mean is then computed across all observations using these adjusted values.

  • Stationarity vs. Non-Stationarity in Time Series Data:

    • Time Series Definition: A sequence of statistical data points indexed or plotted in chronological order along a time axis.

    • Stationarity Assumption:

      • A time series is stationary if its underlying statistical parameters—specifically its mean, variance, and dispersion structure—remain stable and constant over time.

      • Essential for statistical modeling, ensuring historical sample statistics accurately estimate true population parameters.

    • Non-Stationarity Characteristics:

      • A time series is non-stationary if its mean trends over time or if its dispersion/volatility experiences structural shifts or explosions.

      • Financial Asset Characteristics: Equity market prices typically exhibit non-stationarity, characterized by upward trending means and asymmetric downside volatility expansion.

      • Analytical Risks: Non-stationarity invalidates standard statistical modeling assumptions, producing non-persistent patterns and unreliable population estimators.

Data Quantiles, Interquartile Range, and Box-and-Whisker Plots

  • Quantiles Framework:

    • Quantiles are positional values that divide a ranked distribution of data into equal fractional parts.

    • Percentiles: Partition data into 100100 equal parts. For example, the 8th8\text{th} percentile represents the value below which 8%8\% of dataset observations lie.

    • Deciles: Partition data into 1010 equal parts (10%,20%,…,90%10\%, 20\%, \dots, 90\%).

    • Quintiles: Partition data into 55 equal parts (20%,40%,60%,80%20\%, 40\%, 60\%, 80\%). The 1st1\text{st} quintile corresponds to the 2nd2\text{nd} decile and the 20th20\text{th} percentile.

    • Quartiles: Partition data into 44 equal parts (25%,50%,75%25\%, 50\%, 75\%).

      • First Quartile (Q1Q_1): 25th25\text{th} percentile point (25%25\% of data lies below).

      • Second Quartile (Q2Q_2): 50th50\text{th} percentile point (equals the median).

      • Third Quartile (Q3Q_3): 75th75\text{th} percentile point (75%75\% of data lies below).

  • Interquartile Range (IQR):

    • Definition: The numerical distance between the third quartile (Q3Q_3) and the first quartile (Q1Q_1).

    • Mathematical Formula:         IQR=Q3−Q1\text{IQR} = Q_3 - Q_1

    • Significance: Represents the spread of the middle 50%50\% of the data observations positioned around the median, eliminating tail extreme effects.

  • Box-and-Whisker Plots:

    • Visual Structure:

      • Central Box: Defined from Q1Q_1 to Q3Q_3, explicitly representing the Interquartile Range (IQR) and the middle 50%50\% of data.

      • Median Bar: A vertical line drawn inside the box at the value of Q2Q_2.

      • Whiskers: Horizontal lines extending outward from the box boundaries to the minimum (smallest) and maximum (largest) observed dataset values.

    • Interpretation:

      • Numerical Illustration: Given Q3≈55Q_3 \approx 55 and Q1≈20Q_1 \approx 20, the Interquartile Range is:             IQR=55−20=35\text{IQR} = 55 - 20 = 35

      • Skewness Assessment: Asymmetrical whisker lengths indicate distribution skewness. A right whisker longer than the left whisker reveals positive skewness, which pulls the arithmetic mean above the median.

Dispersion Measures: Range, MAD, and Median Absolute Deviation

  • Role of Dispersion in Financial Risk:

    • Dispersion quantifies how widely spread observations (such as manager returns) are around their measure of central tendency.

    • In investment management, dispersion serves as the primary metric for risk, capturing the probability and extent of deviating from expected returns, particularly on the downside.

  • Range:

    • Definition: The total distance between the absolute maximum and minimum observation values in a dataset.

    • Mathematical Formula:         Range=Maximum Observation−Minimum Observation\text{Range} = \text{Maximum Observation} - \text{Minimum Observation}

    • Operational Example:

      • Given a manager's highest return of 18%18\% and lowest return of −20%-20\%, the range calculation yields:             Range=18%−(−20%)=38%\text{Range} = 18\% - (-20\%) = 38\%

    • Limitations: Simplistic metric that relies exclusively on two extreme observations while ignoring the clustering and distribution of all internal data points.

  • Mean Absolute Deviation (MAD):

    • Concept: Overcomes simple deviation cancellation (∑(xi−xˉ)=0\sum (x_i - \bar{x}) = 0) by dropping positive and negative signs, evaluating the average absolute distance of each observation from the sample mean (xˉ\bar{x}).

    • Mathematical Formula:         MAD=∑i=1n∣xi−xˉ∣n\text{MAD} = \frac{\sum_{i=1}^{n} |x_i - \bar{x}|}{n}

    • Mechanism: The vertical absolute value bars transform negative differences into positive distance values prior to summation.

  • Median Absolute Deviation:

    • Concept: Evaluates dispersion relative to the median rather than the mean, offering maximum resistance to outlier distortions.

    • Step-by-Step Procedure:

      1. Determine the median of the underlying dataset.

      2. Calculate the absolute deviation of each observation from the dataset median: ∣xi−Median∣|x_i - \text{Median}|.

      3. Rank the calculated absolute deviations in ascending order.

      4. Identify the median value of those ranked absolute deviations.

Variance and Standard Deviation: Population vs. Sample

  • Fundamental Principles:

    • Variance and standard deviation represent the standard risk metrics in corporate finance and investment management.

    • Variance removes negative signs by squaring deviations from the mean.

    • Units Disconnect: Squaring percentage returns yields percentage squared (%2\%^2), a unit lacking physical or economic meaning. Taking the square root converts the metric back to original percentage units (%\%), yielding standard deviation.

  • Population Variance and Standard Deviation:

    • Population Variance Formula:         σ2=∑i=1N(xi−μ)2N\sigma^2 = \frac{\sum_{i=1}^{N} (x_i - \mu)^2}{N}         Where σ2\sigma^2 represents population variance, μ\mu is the true population mean, and NN is total population size.

    • Population Standard Deviation Formula:         σ=σ2=∑i=1N(xi−μ)2N\sigma = \sqrt{\sigma^2} = \sqrt{\frac{\sum_{i=1}^{N} (x_i - \mu)^2}{N}}

  • Sample Variance and Standard Deviation:

    • Sample Variance Formula:         s2=∑i=1n(xi−xˉ)2n−1s^2 = \frac{\sum_{i=1}^{n} (x_i - \bar{x})^2}{n - 1}         Where s2s^2 represents sample variance, xˉ\bar{x} is sample mean, and nn is sample size.

    • Correction for Bias (n−1n - 1 Denominator):

      • Dividing by n−1n - 1 instead of nn adjusts for the lower dispersion typically observed in sample subsets.

      • This adjustment slightly increases the resulting calculated variance, making s2s^2 an unbiased estimator of true population variance σ2\sigma^2.

    • Sample Standard Deviation Formula:         s=s2=∑i=1n(xi−xˉ)2n−1s = \sqrt{s^2} = \sqrt{\frac{\sum_{i=1}^{n} (x_i - \bar{x})^2}{n - 1}}

  • Step-by-Step Comparative Example:

    • Dataset: {1,2,8,9}\{1, 2, 8, 9\} (n=4n = 4).

    • Sample Mean Calculation: xˉ=1+2+8+94=204=5\bar{x} = \frac{1 + 2 + 8 + 9}{4} = \frac{20}{4} = 5

    • Squared Deviations from Mean (55):

      • (1−5)2=(−4)2=16(1 - 5)^2 = (-4)^2 = 16

      • (2−5)2=(−3)2=9(2 - 5)^2 = (-3)^2 = 9

      • (8−5)2=(3)2=9(8 - 5)^2 = (3)^2 = 9

      • (9−5)2=(4)2=16(9 - 5)^2 = (4)^2 = 16

      • Sum of Squared Deviations = 16+9+9+16=5016 + 9 + 9 + 16 = 50

    • Sample Variance (s2s^2):         s2=504−1=503≈16.67s^2 = \frac{50}{4 - 1} = \frac{50}{3} \approx 16.67

    • Sample Standard Deviation (ss):         s=16.67≈4.08s = \sqrt{16.67} \approx 4.08

    • Population Variance (σ2\sigma^2) (assuming N=4,μ=5N = 4, \mu = 5):         σ2=504=12.50\sigma^2 = \frac{50}{4} = 12.50

    • Population Standard Deviation (σ\sigma):         σ=12.50≈3.54\sigma = \sqrt{12.50} \approx 3.54

    • Sanity Check: The numbers 1,2,8,91, 2, 8, 9 sit at an average standard distance of approximately 44 units away from the central mean value of 55

Scaling Standard Deviation and Volatility Over Time

  • Linear Scaling Assumptions for Variance:

    • Variance scales linearly across time periods under two explicit theoretical assumptions:

      1. Constant periodic variance across time.

      2. Independence of periodic returns over time (no serial correlation).

    • Multi-Period Variance Equation:         σmulti-period2=T×σdaily2\sigma_{\text{multi-period}}^2 = T \times \sigma_{\text{daily}}^2         For a two-day horizon (T=2T = 2): σ2-day2=2×σdaily2\sigma_{\text{2-day}}^2 = 2 \times \sigma_{\text{daily}}^2

  • Square Root of Time Rule for Standard Deviation:

    • Because standard deviation is the square root of variance, it scales across time horizons according to the square root of time (T\sqrt{T}):         σT=σdaily×T\sigma_T = \sigma_{\text{daily}} \times \sqrt{T}

  • Annualization Example:

    • Given: Daily standard deviation = 0.9%0.9\%, annual trading days T=250T = 250

    • Annual Standard Deviation Calculation:         σannual=0.9%×250≈0.9%×15.811388≈14.23%\sigma_{\text{annual}} = 0.9\% \times \sqrt{250} \approx 0.9\% \times 15.811388 \approx 14.23\%

  • Real-World Market Violations:

    • Empirical asset return data frequently displays mean reversion over longer time horizons.

    • As a result, long-term volatility scales up at a slower rate than predicted by the theoretical T\sqrt{T} rule.

Skewness and Distribution Symmetry

  • Distribution Moments Context:

    • Distributional characteristics are categorized into statistical moments:

      • 1st Moment: Mean (Location / Central Tendency)

      • 2nd Moment: Variance (Dispersion / Risk)

      • 3rd Moment: Skewness (Asymmetry)

      • 4th Moment: Kurtosis (Peakedness and Tail Weight)

  • Definition of Skewness:

    • Skewness measures distribution asymmetry by calculating the standardized average cubed deviation from the mean.

    • Cubing mathematical properties preserve algebraic signs while disproportionately magnifying extreme outlier deviations.

  • Symmetrical Distribution:

    • Skewness equals zero (Skewness=0\text{Skewness} = 0).

    • A symmetric curve (e.g., standard normal distribution) displays equal tail lengths and outlier frequencies on both sides of the mean.

  • Positive Skewness:

    • Structure: Features an elongated right-hand tail caused by extreme positive outliers (large gains).

    • Central Tendency Order (Alphabetical Rule):         Mean>Median>Mode\text{Mean} > \text{Median} > \text{Mode}

    • Investment Context: Preferred by investors (e.g., venture capital, private equity returns) where upside potential is unbounded while downside loss is limited to 100%100\%.

  • Negative Skewness:

    • Structure: Features an elongated left-hand tail caused by extreme negative outliers (large losses).

    • Central Tendency Order:         Mean<Median<Mode\text{Mean} < \text{Median} < \text{Mode}

    • Investment Context: Undesirable exposure requiring extra return risk premiums.

    • Market Occurrence: Common in credit risk portfolios (steady yield punctuated by rare default losses), equity market panics (gradual market rises followed by sudden crashes), and relative value hedge fund strategies.

Kurtosis, Tail Risks, and Excess Kurtosis

  • Definition of Kurtosis:

    • Kurtosis measures distribution peakedness and tail fatness based on standardized average deviations raised to the fourth power (4th moment4\text{th moment}).

    • Power of four transformations amplify tail extremes, serving as a primary metric for tail risk.

  • Baseline Normal Kurtosis:

    • A standard normal bell curve possesses an absolute kurtosis value equal to three (Kurtosisnormal=3\text{Kurtosis}_{\text{normal}} = 3).

  • Excess Kurtosis Formula:

    • Excess Kurtosis=Kurtosis−3\text{Excess Kurtosis} = \text{Kurtosis} - 3

  • Distribution Classifications by Kurtosis:

    • Leptokurtic:

      • Characteristics: High kurtosis (Kurtosis>3\text{Kurtosis} > 3) and positive excess kurtosis (Excess Kurtosis>0\text{Excess Kurtosis} > 0).

      • Shape: Highly peaked center with fat tails.

      • Risk Profile: Elevated probability of extreme tail events (large losses or gains) compared to a normal distribution.

    • Platykurtic:

      • Characteristics: Low kurtosis (Kurtosis<3\text{Kurtosis} < 3) and negative excess kurtosis (Excess Kurtosis<0\text{Excess Kurtosis} < 0).

      • Shape: Flatter, domed peak with thin tails (resembling a duckbill platypus profile).

    • Mesokurtic:

      • Characteristics: Kurtosis exactly equals three (Kurtosis=3\text{Kurtosis} = 3), matching a standard normal distribution.

  • Critical Risk Combination:

    • Combining negative skewness with high leptokurtosis exposes portfolios to extreme left-tail fat-tail losses.

Empirical Applications and Analytical Problem Sets

  • S&P 500 Five-Year Return Dispersion Dataset:

    • Given Parameters: Sample mean xˉ=12.9%\bar{x} = 12.9\%, median return = 21.7%21.7\%. Five-year annual returns include maximum = 25.4%25.4\% and minimum = −21.6%-21.6\%.

    • Range Calculation:         Range=25.4%−(−21.6%)=47.0%\text{Range} = 25.4\% - (-21.6\%) = 47.0\%

    • Mean Absolute Deviation (MAD) Calculation:

      • Absolute distances from mean 12.9%12.9\%: ∣25.4−12.9∣=12.5%|25.4 - 12.9| = 12.5\%, ∣15.1−12.9∣=2.2%|15.1 - 12.9| = 2.2\%, ∣−21.6−12.9∣=34.5%|-21.6 - 12.9| = 34.5\%

      • Sum of absolute deviations divided by 55 observations yields MAD=13.7%\text{MAD} = 13.7\%

    • Median Absolute Deviation Calculation:

      • Absolute distances from median 21.7%21.7\%: ∣25.4−21.7∣=3.7%|25.4 - 21.7| = 3.7\%, ∣15.1−21.7∣=6.6%|15.1 - 21.7| = 6.6\%

      • Ranked absolute distances: lowest = 0.0%0.0\%, 3rd middle ranked distance = 3.7%3.7\%, highest = 43.3%43.3\%

      • Median Absolute Deviation = 3.7%3.7\%

  • Brent Crude Oil Futures Skewness Analysis:

    • Scenario: 10 years of daily returns for front-month Brent crude oil futures contracts yield a skewness statistic of −0.9393-0.9393

    • Evaluation: Distribution is non-normal, asymmetrical, and exhibits a longer left tail than a normal distribution.

  • Monthly Return Kurtosis Analysis:

    • Scenario: 5 years of monthly asset returns yield a kurtosis statistic of 3.90763.9076

    • Evaluation: Because 3.9076>3.03.9076 > 3.0, the distribution displays leptokurtosis with positive excess kurtosis (3.9076−3.0=0.90763.9076 - 3.0 = 0.9076), characterized by fatter tails and more extreme values than a normal distribution.

  • Private Equity Fund Return Performance (250 Funds):

    • Scenario: Unimodal distribution of 250250 private equity funds with arithmetic mean = 9.98%9.98\% and geometric mean = 9.91%9.91\%

    • Evaluation: Positive manager return asymmetry shifts mass into the right tail, resulting in more mass in the right tail than the left tail.

  • Central Tendency Selection under High Skewness and Kurtosis:

    • Scenario: Identify the optimal measure of central tendency for a dataset containing severe skewness and high kurtosis.

    • Evaluation: The median is selected as the most suitable measure because positional ranking insulates it from severe tail outliers and asymmetric skew, whereas the arithmetic mean is heavily distorted.