6.1: The Standard Normal Distribution

Foundations: Discrete vs. Continuous Random Variables

  • Discrete Random Variables:

    • A discrete random variable takes on specific, distinct values with gaps between permissible outcomes (e.g., variables restricted strictly to whole numbers where fractions and decimals are excluded).

    • Probability as Area: The probability of selecting a specific outcome equals the area of its corresponding rectangle in a histogram. The probability of selecting a value from a set of outcomes equals the sum of the areas of those rectangles.

    • Binomial Distribution Example: A binomial distribution B(n,p)B(n, p) is a discrete random variable. As the sample size nn becomes large, its histogram forms a single symmetric bump centered near the mean (μ=np\mu = np) and tapers off at both tails.

  • Continuous Random Variables:

    • A continuous random variable can take on any real value within a continuous interval. Outcomes are not restricted to whole numbers; fractions, decimals, and every real number in between are possible outputs.

  • Measuring Spread via Standard Deviation:

    • The standard deviation of any dataset serves as a measuring stick indicating how far a data value lies from the mean.

    • Standardizing a raw score xx is performed using the z-score formula: z=x−μσz = \frac{x - \mu}{\sigma}

The Normal Distribution

  • Notation: A normal random variable is denoted as X∼N(μ,σ)X \sim N(\mu, \sigma).

  • Probability Density Function:

    • The probability density function defining the normal distribution curve is: f(x)=1σ2πe−12(x−μσ)2f(x) = \frac{1}{\sigma \sqrt{2\pi}} e^{-\frac{1}{2}\left(\frac{x - \mu}{\sigma}\right)^2}

  • Parameters:

    • The normal distribution depends on two parameters:

    • Mean (μ\mu): Specifies the center and location of the peak.

    • Standard Deviation (σ\sigma): Determines how spread out the distribution is and controls the speed at which the curve tapers off.

  • Graphical Characteristics:

    • Symmetry: The graph is perfectly symmetric about the mean (μ\mu), containing zero skewness.

    • Peak: The peak occurs at the center where x=μx = \mu, representing the highest point on the curve.

    • Tapering: The curve tapers off smoothly in both directions away from the mean towards the horizontal axis.

    • Transformation Properties:

    • Changing μ\mu shifts the graph horizontally along the horizontal axis.

    • Changing σ\sigma stretches or squishes the curve vertically and horizontally.

Normal distribution curve X ~ N(mu, sigma) symmetric about mu
  • Probabilities as Area Under the Curve:

    • For continuous distributions, probabilities correspond directly to the area underneath the distribution curve.

    • The cumulative probability of observing a value less than xx is written as P(X<x)P(X < x) and corresponds to the area under the normal curve up to xx

    • Total Area Property: The total area underneath the normal distribution curve equals exactly 11.

Shaded area under the normal curve to the left of x representing cumulative probability P(X < x)

The Standard Normal Distribution and Z-Scores

  • Definition:

    • The standard normal distribution is the specific normal distribution where the mean μ=0\mu = 0 and the standard deviation σ=1\sigma = 1, expressed as N(0,1)N(0, 1).

  • Simplification of Z-Score in Standard Normal:

    • For the standard normal distribution N(0,1)N(0, 1), substituting μ=0\mu = 0 and σ=1\sigma = 1 simplifies the calculation: z=x−μσ=x−01=xz = \frac{x - \mu}{\sigma} = \frac{x - 0}{1} = x

  • Purpose of Z-Scores:

    • The z-score standardizes data values from any arbitrary normal distribution N(μ,σ)N(\mu, \sigma), allowing comparison to the standard normal distribution N(0,1)N(0, 1).

    • A z-score answers the specific question: "What data value in the standard normal distribution corresponds to this data value from a given normal distribution?"

Questions & Discussion

  • Question: What can be concluded about a data value from a normal distribution if its z-score is negative? What if its z-score is positive?

  • Response:

    • Negative Z-Score (z<0z < 0): Indicates that the data value is strictly smaller than the mean (x<μx < \mu) and lies to the left of the center on the distribution curve.

    • Positive Z-Score (z>0z > 0): Indicates that the data value is strictly greater than the mean (x>μx > \mu) and lies to the right of the center on the distribution curve.

    • Zero Z-Score (z=0z = 0): Indicates that the data value is exactly equal to the mean (x=μx = \mu).

Worked Examples: Z-Scores and Data Values

  • Calculating Z-Scores from Data Values:

    • Example 1:

    • Given X∼N(5.8,2)X \sim N(5.8, 2) and x=7x = 7: z=7−5.82=1.22=0.6z = \frac{7 - 5.8}{2} = \frac{1.2}{2} = 0.6

    • Example 2:

    • Given Y∼N(18,1.4)Y \sim N(18, 1.4) and y=15y = 15: z=15−181.4=−31.4≈−2.143z = \frac{15 - 18}{1.4} = \frac{-3}{1.4} \approx -2.143

    • Example 3:

    • Given P∼N(3.25,0.82)P \sim N(3.25, 0.82) and p=4.1p = 4.1: z=4.1−3.250.82=0.850.82≈1.037z = \frac{4.1 - 3.25}{0.82} = \frac{0.85}{0.82} \approx 1.037

  • Calculating Data Values from Z-Scores:

    • Given X∼N(80,5.7)X \sim N(80, 5.7), find the corresponding value xx using x=μ+zσx = \mu + z\sigma:

    • Case 1 (z=−2.3z = -2.3): x=80+(−2.3)(5.7)=80−13.11=66.89x = 80 + (-2.3)(5.7) = 80 - 13.11 = 66.89

    • Case 2 (z=0.1z = 0.1): x=80+(0.1)(5.7)=80+0.57=80.57x = 80 + (0.1)(5.7) = 80 + 0.57 = 80.57

    • Case 3 (z=1.6z = 1.6): x=80+(1.6)(5.7)=80+9.12=89.12x = 80 + (1.6)(5.7) = 80 + 9.12 = 89.12

The Empirical Rule (68-95-99 Rule)

  • For any normal distribution X∼N(μ,σ)X \sim N(\mu, \sigma), data distribution across standard deviations follows the empirical rule:

    • Within 1 Standard Deviation: Approximately 68%68\% of the data falls within 1 standard deviation of the mean, lying in the interval [μ−1σ,μ+1σ][\mu - 1\sigma, \mu + 1\sigma].

    • Within 2 Standard Deviations: Approximately 95%95\% of the data falls within 2 standard deviations of the mean, lying in the interval [μ−2σ,μ+2σ][\mu - 2\sigma, \mu + 2\sigma].

    • Within 3 Standard Deviations: Approximately 99%99\% of the data falls within 3 standard deviations of the mean, lying in the interval [μ−3σ,μ+3σ][\mu - 3\sigma, \mu + 3\sigma].