Sampling Distribution and Confidence Intervals

Sampling Distribution

  • Sampling Distribution: The distribution of all possible values taken by a statistic from all possible samples of a fixed size nn taken from a population.
  • It's a theoretical construct and represents the probability distribution of that statistic.

Sampling Distribution of the Sample Mean

  • Multiple random samples of size nn are taken from a population with mean µµ and standard deviation σσ.
  • Some sample means will be above µµ and some below, forming the sampling distribution.
  • The mean of the sampling distribution of x\overline{x} is equal to the population mean µµ.
  • The standard deviation of the sampling distribution is σ/nσ/\sqrt{n}, where nn is the sample size.
  • There's no systematic tendency for a sample mean to fall above or below µµ, even if the raw data is skewed.
  • The mean of the sampling distribution is an unbiased estimate of the population mean µµ, meaning it will be "correct on average" in many samples.
  • The standard deviation of the sampling distribution measures how much the sample statistic varies from sample to sample.
  • It is smaller than the population's standard deviation by a factor of n\sqrt{n}. Averages are less variable than individual observations.

The Central Limit Theorem

  • Central Limit Theorem: When sampling randomly from any population with mean µµ and standard deviation σσ, if nn is large enough, the sampling distribution of x\overline{x} is approximately normal.

Confidence Level

  • Confidence Level: The overall capture rate if the method is used many times.
  • The sample mean varies from sample to sample, but the method estimate ±\pm margin of error is used to get an interval based on each sample.
  • C% of these intervals capture the unknown population mean µµ. The actual mean will be located within the interval C% of the time.
  • Confidence interval = sample mean ±\pm margin of error
  • The population mean for a certain variable is estimated by computing a confidence interval for that mean.
  • If several random samples were collected, the mean for that variable would be slightly different from one sample to another. When researchers estimate population means, instead of providing only one value, they specify a range of values (or an interval) within which this mean is likely to be located.
  • To obtain this confidence interval, add and subtract the margin of error from the sample mean. This result is the upper limit and the lower limit of the confidence interval.
  • The confidence interval may be wider or narrower depending on the degree of certainty, or estimation precision, that is required.

Confidence Intervals

  • The formulas for the confidence interval and margin of error can be combined into one formula.

Review of Data Types

  • Quantitative Data: Data that can be counted or measured and averaged across individuals in the population (e.g., height, age, IQ score).
  • Categorical Data: Data that falls into one of several categories. What can be counted is the proportion of individuals in each category (e.g., gender, hair color, blood type—A, B, AB).