Multivariate Stats Weeks 1 - 2

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/28

encourage image

There's no tags or description

Looks like no tags are added yet.

29 Terms

1
New cards

Variance

How spread out observations in a dataset are

average of squared differences from the mean

2
New cards

PPDAC cycle

Problem, plan, data, analysis, conclusion

3
New cards

Discrete Variables

whole numbers

categorical data

dichotomous variables

4
New cards

continuous variables

numerics that can be fractions

ex. age, distance

5
New cards

nominal data

  • categorical

  • no order, no quantitative distinction

  • categories


6
New cards

ordinal data

  • categorical

  • order matters

  • difference between categories is not necessarily consistent


7
New cards

Interval data

  • Continuous

  • order matters

  • values indicate quantity, not categories

  • equal intervals between values

  • NO TRUE ZERO - even if 0 exists it does not indicate a lack of the variable

    • ex. temperature


8
New cards

Ratio Data

  • continuous

  • order matters

  • values indicate quantity, not categories

  • equal intervals

  • true zero exists

    • ex. Weight


9
New cards

Plots and best data for them

bar chart - categorical data

histogram - continuous data, good for seeing distribution

column/bar plot - grouped continuous data

box plot - grouped continuous data

violin plot - grouped continuous data

scatterplot - relationships between continuous variables

line graphs - data that changes over time

10
New cards

Screening data

check accuracy of data

check relevant statistical assumptions

11
New cards

univariate outliers

an observation that is extreme for one variable

detected by

  • plotting data and finding them visually

  • computing z-scores (observations with a z-score of more than ±3.29 are too many standard deviations away from the mean)


12
New cards

multivariate outliers

an observation that is extreme in multiple variables

CAN BE MULTIVARIATE WITHOUT BEING UNIVARIATE - these are sneaky and remain in data set even after handling all univariate outliers

  • only occurs in data with a pattern

  • these data are too distant from the pattern which makes them outliers

  • but they’re not too extreme on any one variable to count as outliers

detected by:

  • calculating Mahalanobis Distance


13
New cards

Mahalanobis Distance

distance of an observation from the centroid point (center) of the data

corrects for variance in the dat so that values that are far from the mean in the expected direction are less likley to be categorized as outliers


14
New cards

dealing with outliers - first steps

  • set rules for what counts as outlier beforehand

  • address univariate outliers first

  • check if outliers is a data entry error


15
New cards

Dealing with outliers - statistical approaches

  • transform data (ex. log transform) to reduce overall variance

  • winsorize - change outliers score into next-most extreme score in the data set so it still represents a high score in the same direction without messing with statistical tests

  • use non parametric tests to analyze (rank based)


16
New cards

dealing with outliers - trimming strategies

  • omit cases if confident they come from a different population than the desired one

  • trim certain percentage of cases from high and low tails

  • just trim outliers (careful with this one)


17
New cards

The Normal Distribution

Many statistical tests assume data is normal shaped

  • when this is not true, statistical tests lose power

skew = 0

kurtosis = 0


18
New cards

Skew

symmetry/asymmetry of distribution

positive - data shows a longer tail on high end of scale

negative - data shows a longer tail on the low end of scale

19
New cards

Kurtosis

peakedness/flatness of distribution

positive - sharp peak in the middle, indicates concentration of observations around that point

negative - peaks at the extremes of the scale, indicates observations are concentrated at highest and lowest values

20
New cards

Testing for Normality of Distribution

test whether skew and kurtosis differ significantly from zero using z-scores


Use Q-Q plot - compares observed values against expected values of a normal distribution

21
New cards

Q-Q Plot

knowt flashcard image
22
New cards

Correcting Normality

  • transform variable

  • winsorize/trim

  • choosea statistical method that fits the shape of data

  • use non-parametric tests


23
New cards

Linearity

Assumption that variables have a linear relationship

necessary for many statistical tests

visualize with bivariate scatterplot\

nonlinear data must use alternative analyses

24
New cards

homogeneity of variance

assumption that variance of DV for all levels of a categorical IV is similar

25
New cards

Homoscedasticity

assumption that variance of DV is similar at all points of a continuous IV


26
New cards

multicollinearity

when variables are too closely correlated

indicates conceptual redundancy between variables, one can be deleted

causes problems especially in regression

  • hard to tell what is actually causing the effect

  • convergence problems

  • makes interpreting role of individual predictors difficult


27
New cards

Dealing with Multicollinearity

Remove the less important variable

combine them if they measure the same construct

28
New cards

Types of missing data

Missing completely at random (MCAR)

  • no pattern to missing data, existing data is representational of desired population

Missing at Random (MAR)

  • pattern of missingness depends on a variable but not the primary relevant one

Missing not at Random (MNAR)

  • missing data depends on a variable that is central to the research

  • can seriously bias results


29
New cards

Dealing with missing data

  • listwise/pairwise deletion - delete the whole participant if some vital data is missing from their observation or if too much data is missing

  • estimate/impute missing data - use knowledge of previous research

  • mean substitution - impute mean value for missing value bc it wont significantly change data distribution

  • regression - use complete cases to create regression model to predict missing values