Multivariate Analysis: Introduction and Core Concepts
Introduction to Multivariate Analysis
Chapter 1: Introduction
Univariate Analysis: Working with single variables or multiple variables in regression analyses.
Multivariate Analysis: Works with multiple variables in a multidimensional way; not the same as multiple variable analysis.
May be more challenging than standard statistics.
Outline for Topics Covered:
Probability review.
Marginal distributions.
Multivariate data recommendations.
Random factors.
Descriptive statistics.
Textbook Reference: Paragraphs 3.1, 3.2, and 4.1 are relevant to these topics.
Basic Probability Terminology
Random Variable: A variable whose outcomes are not determined with 100% certainty.
Outcome: One of the possible results.
Example (Single Die Roll): Six possible outcomes (1, 2, 3, 4, 5, 6); one outcome might be
.
State Space: The full set of potential outcomes.
Example (Single Die Roll):
through.
Event: A subset of the state space.
Probability: The likelihood of an event occurring.
Probability Distribution: A function that maps the values of the outputs towards their probabilities.
Types of Probability Distributions
Discrete Distribution: For variables with discrete outcomes (e.g.,
,,, oror).Probability Mass Function (PMF): The probability distribution for discrete variables.
Rules for PMF:
The summation of probabilities for all possible states must equal
:.Probabilities cannot be negative:
.
Continuous Distribution: For variables with continuous, smooth outcomes (e.g.,
).Probability Density Function (PDF): The probability distribution for continuous variables.
Rules for PDF:
The total area under the curve must equal
:.The values of the density (height of the function) cannot be negative:
.The height of the density function can be greater than
(e.g.,), as long as the total area under the curve is.
Describing Probability Distributions
Cumulative Distribution Function (CDF):
Formula:
.Description: Gives the probability that a random variable
is less than or equal to a particular value. It's a