Bivariate Correlation, Multiple Regression, and ANOVA

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/57

flashcard set

Earn XP

Description and Tags

Vocabulary practice flashcards covering bivariate correlation, linear and multiple regression diagnostics, ANOVA, and data transformations from the Exam 2 Study Guide.

58 Terms

1
New cards

what is line of best fit? what makes it fit best

A line that is closest to the most data points on a scatterplot, minimizes prediction errors/residuals/sum of squared errors, and must pass through points (0,a)(0, a) and (X,Y)(X, Y).

2
New cards

Covariance

The statistical basis for correlation, reflecting the degree to which 2 variables vary together; it is positive when both scores are above the mean, and negative when one score is above and the other is below the mean.

3
New cards

Adjusted rr

A statistic used to obtain a more unbiased estimate of the population correlation coefficient by penalizing degrees of freedom; the difference between rr and adjusted rr is substantial for small samples and negligible for large samples.

4
New cards

when to use Point-biserial correlation? interpretation

A correlation appropriate when one variable is truly dichotomous and the other is approximately continuous, interpreted in the same manner as a Pearson correlation.


Interpretation: A ——- correlation revealed that there were no sex differences in physical health, r(df)_pb=___, p= __.

5
New cards

Spearman correlation (rsr_s) definition, interpretation, and drawbacks

A correlation coefficient used when both variables are ordinal (ranked data)

interpretation: a ____ correlation revealed that people who rank their own health as good will also rank their health as better than their same sex peers, rs(df)=__, p=__.

its drawbacks include the inability to calculate confidence intervals or standard errors for small samples, and that data cannot be normally distributed.

6
New cards

Kendall's Tau and interpretation

A rank-based correlation calculated from the number of inversions and reversals in rankings; preferred over Spearman correlation for small datasets containing a large number of tied ranks, better estimate of correlation in the population than spearman


Interpretation: People who rank their own health as good also tend to rank their health as better than same age/sex peers, Kendall’s tau=__ , p= __. no df and no effect size here

7
New cards

describe the components of a regression equation

Y (hat) = bx +a


Y hat is the predicted value of Y

b is slope of the regression line (amount of difference in Y hat associated with a 1 unit difference in X)

a is the intercept (value if Y hat when X=0)

X is the value of the predictor variable

goal is to find the line of best fit

8
New cards

What are the standardized regression coefficients?

the difference in 1 unit in X or Y represents a difference of 1SD (unitless regression estimate calculated when data are converted into z scores)

b becomes Beta if the data are standardized

r is the slope if variables are standardized

9
New cards

Standardized regression coefficient (β\beta)

A unitless regression estimate calculated after converting data into zz-scores, where a 11-unit difference in XX or YY represents a difference of 1 SD1\text{ SD}.

10
New cards

what affects accuracy of prediction?

sum of squares (sum of squared deviations from the predicted point)

standard error of the estimate (sd of Y predicted from X)

residuals/error of variance= (SE of estimate) squared

df = N-2 ( lose 1 for a, lose 1 for b)

inverse relationship between r and the standard error of the estimate

r squared

11
New cards

Standard error of the estimate

The standard deviation of YY predicted from XX, calculated as Sum of Squaresdf\sqrt{\frac{\text{Sum of Squares}}{df}}; it has an inverse relationship with the correlation coefficient rr.

12
New cards

Coefficient of determination (r2r^2)

A measure of predictive variability that indicates the variance in the dependent variable explained by the regression model; does not imply causation; like eta squared for correlations

13
New cards

describe the assumptions for correlation and regression

homogeneity of variance in arrays (variance of Y for each value of X is constant)

normality of arrays (pop values of Y corresponding to any value of X are normally distributed around Y hat)

14
New cards

Homogeneity of variance in arrays

An assumption of bivariate and multiple regression stating that the variance of YY across each specific value of XX remains constant.

15
New cards

Normality of arrays

The regression assumption specifying that the population values of YY corresponding to any particular value of XX are normally distributed around Y^\hat{Y}.

16
New cards

null hypothesis for correlation and regression

  • H0: ρ = 0

means that there is no relationship between X and Y in the population

17
New cards

assumptions/factors that affect correlation

range restrictions: looking at smaller parts of the data, results in variance when one or both variables are low, results in lowered correlation

heterogenous subsamples: potential 3rd variable problem, overall correlation might be artificially inflated/deflated because of 2 subsamples

covariance

r (pearson product-moment correlation coefficient)

18
New cards

steps to remember for correlation

graph variables first

make sure there is variability

make sure variables are normally distributed

are there outliers? do they have undue influence on the results?

19
New cards

benefits of multiple regression

can explain more variance in the DV

can compare predictors

20
New cards

correlation matrix as it relates to multiple regression

the slope of each predictor represents its contribution to the DV

must graph variables, correlate them, then run the regression

can detect indicators of suppression by comparing correlation to regression coefficients

21
New cards

Collinearity

The presence of relatively high interrelationships among predictor variables in a multiple regression model, which can be a problem because of non-uniqueness and difficulty in explaining unique variance.

22
New cards

Multiple correlation coefficient (RR)

A statistic representing the overall linear correlation between the criterion variable (DV\text{DV}) and all predictor variables (IVs\text{IVs}) combined.

23
New cards

R squared

amount of variance in DV accounted for by all the IVs

different from R because R is how all variables correlate together (IVs and DV)

24
New cards

regression analysis interpretation

Interpretation: controlling for age (Beta= -.05, p = .426) and self rated health (Beta= .11, p= .063), people who have completed more education score significantly better on the BDS than people with less education (Beta = .22, p<.001). Age, education, and self rated health account for 8% of the variance in BDS scores.

pick standardized slope that best describes overall for last, control for non-sig vars then focus on how R squared is the IVs account for DV

25
New cards

How are regression coefficients and R squared tested for statistical significance?

b and Beta: linear transformations of each other, so if one is significant, the other is

SE: less SE, more likely to be sig

Use t test

R squared: rejecting the null if sig predicts at better than chance levels, F explains if it is different than 0

26
New cards

distribution assumptions of multiple regression

multivariate, normal distribution (departures from normal are okay bc tests are robust)

conditional distributions of Y (value of Y for specific value of X) are not independently distributed (moderate departures okay)

27
New cards

issues surrounding sample size for multiple regression

At least 10 people per IV

N should be bigger than p by at least 50, by at least 40

use power as a basis

MORE IS BETTER

28
New cards

what makes b and Beta partial regression coefficients?

unique effect of predictor on DV when other IVs are partialled out

29
New cards

Partial correlation definition and interpretation

The correlation between two variables after the influence of one or more other variables has been controlled for and removed from both XX and YY.

recognize it bc there’s a column of control variables (variables taken out of the model)

Interpretation: A partial correlation revealed that age and stress were unrelated when negative mood was completely removed, r(df)= , p= __.

30
New cards

Semipartial correlation (Part correlation) definition and interpretation

The correlation between the dependent variable and a predictor variable when other predictors have been partialled out of only that single predictor variable.

recognize by three columns at the end with zero-order, partial, and part(look at part for r)

interpretation: A ____ correlation revealed that age and stress were unrelated when negative mood was removed from age r(df)= p= .

31
New cards

Suppressor variable

A predictor variable that increases the predictive variability of another predictor; indicated when its regression coefficient is larger in magnitude or opposite in sign compared to its simple bivariate correlation.

32
New cards

statistics for regression diagnostics and 2 sentences to describe them

Cook’s D, residual, studentized residual, centered leverage values

if all of them are small, no problem with outliers

Tolerance and VIF: if VIF is larger than tolerance, suggests potential problem among predictors because they are overlapping more than they should be (multicollinearity)

There doesn’t appear to be a problem with outliers. The results between tolerance and VIF suggest that there is a problem among predictors because they are overlapping more than they should be.

33
New cards

Cook's Distance (Cook's D)

A regression diagnostic statistic measuring the influence of an individual data point on the model; a value greater than 11 indicates a problematic case.

34
New cards

residual

measure of distance, smaller is better

35
New cards

Studentized residual

A tt-test on the magnitude of each residual value used as a diagnostic tool; statistical significance indicates a potentially problematic outlier.

36
New cards

centered leverage values

measure of leverage; smaller is better

37
New cards

Tolerance

A collinearity diagnostic indicating the degree to which one independent variable can be predicted by other independent variables; values near 00 indicate severe collinearity problems.

38
New cards

Variance Inflation Factor (VIF)

The reciprocal of tolerance (1Tolerance\frac{1}{\text{Tolerance}}) that measures predictor overlap; values significantly larger than tolerance indicate multicollinearity among predictors.

39
New cards

All subsets regression

program chooses best predictors based on your specifications, can include irrelevant variables but good at looking at all predictors

40
New cards

Backward elimination and drawbacks

A regression model selection procedure that begins with all predictors in the model and iteratively eliminates the variables that contribute the least based on partial or semipartial correlations.

capitalizes on chance, can drop good predictors that might not fit this model

41
New cards

Stepwise regression

An automated regression method that starts with no predictors and enters variables sequentially based on the highest semipartial correlation and predefined entry criteria, used primarily when no guiding theory exists.

42
New cards

Listwise deletion and drawback

A missing data handling method where an entire case is excluded from analysis if it is missing a value on any variable in the model, which can result in a substantially lower sample size (NN).

43
New cards

Pairwise deletion and drawback

A missing data approach where all available data are used to calculate each correlation separately, which can lead to an unrepresentative correlation matrix.

44
New cards

benefits of Analysis of Variance (ANOVA)

compare more than 2 means

compare 2+ IVs simultaneously

more common in experimental designs

categorical IVs and 1 continuous DV (regression all continuous)

conceptually same as regression but all IVs must bc categorical

45
New cards

assumptions of ANOVA

homogeneity of variance

normality of DV scores

independence of observations'

null hyp is that all means are equal

46
New cards

logic of ANOVA

compares variance estimates and sum of squares total is the SS treatment plus SS error

47
New cards

interpretation of ANOVA with 1 IV

The three groups of sex control do not have the same health ratings, F (2, 291) = 4.63, p= .01, Eta squared= .03

OR
Sex control is related to health ratings F (2, 291) = 4.63, p= .01, Eta squared= .03

48
New cards

how are ANOVA df determined?

total: N-1

treat: k-1 ( k is # of treatments)

df error= df total - df treat

49
New cards

assumptions of ANOVA sample sizes

assumed to be equal, and if not equal, the larger group gets weighted more in SS treat calculation

50
New cards

Eta squared (η2\eta^2)

An effect size statistic in ANOVA representing the proportion of total variance explained by the treatment (SStreatSStotal\frac{SS_{\text{treat}}}{SS_{\text{total}}}); displayed as R2R^2 in SPSS output.

51
New cards

Omega squared (ω2\omega^2)

A conservative, less-biased ANOVA effect size calculated as SStreat−(k−1)MSerrorSStotal+MSerror\frac{SS_{\text{treat}} - (k - 1)MS_{\text{error}}}{SS_{\text{total}} + MS_{\text{error}}}; reported as Adjusted R2R^2 in SPSS output.

52
New cards

what components are necessary to calculate power in ANOVA

N and effect size

phi = phi prime sqrt(n)

phi prime is effect size

power= 1- table entry

53
New cards

Logarithmic transformation

A nonlinear data transformation used to correct positively skewed distributions by changing interval distances between points, which cannot be applied if the data contain zero (00).

54
New cards

Square root transformation

A nonlinear transformation applied to reduce skewness specifically in count data, which can successfully be computed when values contain zero (00).

55
New cards

Reciprocal transformation

A nonlinear transformation used when extreme scores exist in the positive tail to reduce their disproportionate influence on the model.

56
New cards

Arcsine transformation

A nonlinear transformation applied to leptokurtic distributions to stretch out both tails relative to the center.

57
New cards

Trimmed sample

A method to reduce outlier influence by symmetrically removing an identical fixed percentage of extreme scores from both tails of the distribution.

58
New cards

interpretation for pearson correlation

interpretation: A ___ correlation revealed that people who score high on var X will also tend to score high on var Y, r(df)= ___, p =___. (positive example)