BS141 Lecture 5 - Linear Regression

What does variance additivity state

If distributions are independent the variance of their sum equals the sum of the variances

What happens to variance as sample size increases

Variance increases as more samples are added

What does covariance measure

How two variables change together

What is the formula for joint variance

Variance of X plus variance of Y plus two times covariance of X and Y

What is the covariance of independent samples

Zero

Why is covariance limited as a measure

It depends on units and cannot show independence clearly

What is Pearson correlation coefficient

R a standardized measure of association between two variables

What is the range of Pearson correlation coefficient

Between minus one and one

What does R equal to zero indicate

No correlation between variables

What does R close to one indicate

Strong positive correlation

What does R close to minus one indicate

Strong negative correlation

What is the limitation of correlation

It shows association but does not allow prediction

What statistical method allows prediction of one variable from another

Linear regression

What method is used to fit a regression line

Least squares method

What does the least squares method minimize

The sum of squared differences between observed and predicted values

What is the equation of a linear regression line

y equals a plus b x

What does the intercept a represent

The value of y when x is zero

What does the slope b represent

The change in y for a one unit increase in x

What is the null hypothesis in a regression test

The population slope beta equals zero

What is the alternative hypothesis in a regression test

The population slope beta is not equal to zero

What type of data is required for regression testing

Paired continuous measurements

What variances are computed in a regression test

Model variance and error variance

What test statistic is used in regression testing

The F statistic

Why is a regression test similar to ANOVA

It compares explained variance to unexplained variance

What does the model term represent in regression

How far the regression line is from the null hypothesis line

What does the error term represent in regression

How close observed values are to predicted values

What is the degrees of freedom for the model in regression

One

What is the degrees of freedom for error in regression

Number of observations minus two

What is the coefficient of determination

R squared

What does R squared measure

The proportion of total variance explained by the regression model

If R squared equals zero point four eight what does it mean

Forty eight percent of variance is explained by the regression line

How is R squared related to Pearson correlation

It is the square of the Pearson correlation coefficient

Why does correlation not imply causation

Association does not prove one variable causes the other

What is the difference between correlation and regression

Correlation measures association while regression predicts values

When is linear regression appropriate

When the relationship between variables is linear

What is an important limitation when making predictions

Predictions should only be made within the observed data range