Business Analytics: Linear Regression, Data Wrangling, and Hypothesis Testing

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/49

flashcard set

Earn XP

Description and Tags

Comprehensive practice vocabulary flashcards covering simple and multiple linear regression models, least squares estimation, diagnostic residual evaluation, categorical and nonlinear modeling, data wrangling methodologies, missing data taxonomy, and hypothesis testing principles.

50 Terms

1
New cards

Regression Analysis

A statistical procedure that uses data to develop an equation showing how variables are related.

2
New cards

Dependent Variable

The response variable being predicted in a regression analysis, denoted by yy.

3
New cards

Independent Variable

A predictor variable or feature used to predict the value of the dependent variable, denoted by xx (or x1,x2,…,xqx_1, x_2, \dots, x_q).

4
New cards

Simple Linear Regression Model

An equation describing how the dependent variable yy relates to a single independent variable xx and an error term ϵ\epsilon, formulated as y=β0+β1x+ϵy = \beta_0 + \beta_1 x + \epsilon.

5
New cards

Multiple Linear Regression Model

A regression model relating the dependent variable yy to two or more independent variables through the equation y=β0+β1x1+β2x2+⋯+βqxq+ϵy = \beta_0 + \beta_1 x_1 + \beta_2 x_2 + \dots + \beta_q x_q + \epsilon.

6
New cards

Error Term (ϵ\epsilon)

The model component that accounts for the variability in the dependent variable yy that cannot be explained by the linear effect of the independent variable(s).

7
New cards

Least Squares Method

A procedure for using sample data to determine the estimated regression equation by minimizing the sum of squared residuals, ∑(yi−y^i)2\sum (y_i - \hat{y}_i)^2.

8
New cards

Residual (eie_i)

The error made in estimating the value of the dependent variable for the ithi^{\text{th}} observation, calculated as the observed value minus the predicted value: ei=yi−y^ie_i = y_i - \hat{y}_i.

9
New cards

Experimental Region

The range of values of the independent variables in the sample data used to estimate the regression model.

10
New cards

Extrapolation

The prediction of the value of the dependent variable outside the experimental region, which is risky and unreliable unless supported by empirical evidence.

11
New cards

Sum of Squares Due to Error (SSE)

A measure of the error resulting from using the predicted values y^i\hat{y}_i to estimate the actual values yiy_i, computed as SSE=∑(yi−y^i)2\text{SSE} = \sum (y_i - \hat{y}_i)^2.

12
New cards

Total Sum of Squares (SST)

A measure of total deviation based on the error of using the sample mean yˉ\bar{y} to predict the observed values yiy_i, computed as SST=∑(yi−yˉ)2\text{SST} = \sum (y_i - \bar{y})^2.

13
New cards

Sum of Squares Due to Regression (SSR)

A measure of how much the predicted values y^i\hat{y}_i deviate from the sample mean yˉ\bar{y}, defined as SSR=∑(y^i−yˉ)2\text{SSR} = \sum (\hat{y}_i - \bar{y})^2, where SST=SSR+SSE\text{SST} = \text{SSR} + \text{SSE}.

14
New cards

Coefficient of Determination (r2r^2 or R2R^2)

The ratio of the sum of squares due to regression to the total sum of squares, computed as r2=SSRSST=1−SSESSTr^2 = \frac{\text{SSR}}{\text{SST}} = 1 - \frac{\text{SSE}}{\text{SST}}, indicating the proportion of variability in the dependent variable explained by the regression relationship.

15
New cards

Conditions for Valid Inference in Regression

The two required assumptions regarding the error term ϵ\epsilon: (1) for any combination of independent variable values, the error population is normally distributed with a mean of 00 and constant variance; and (2) the error values are statistically independent.

16
New cards

Residual Plot Error Term Violations

The four common violations of regression error assumptions observed in residual plots: (a) non-constant spread, (b) nonlinear pattern, (c) non-normal residuals, and (d) non-independent residuals.

<p>The four common violations of regression error assumptions observed in residual plots: (a) non-constant spread, (b) nonlinear pattern, (c) non-normal residuals, and (d) non-independent residuals.</p>
17
New cards

Multicollinearity

The condition of high correlation among independent variables in a multiple regression model, which inflates parameter standard errors and reduces estimation precision.

18
New cards

Dummy Variable

An artificial indicator variable coded as 00 or 11 used to represent categorical independent variables in a regression equation. A categorical factor with kk levels requires k−1k - 1 dummy variables.

19
New cards

Quadratic Regression Model

A curvilinear regression model that includes a squared independent variable term alongside the linear term, expressed as y=β0+β1x+β2x2+ϵy = \beta_0 + \beta_1 x + \beta_2 x^2 + \epsilon.

20
New cards

Curvilinear Shapes in Quadratic Regression

The parametric curvature shapes of y=β0+β1x+β2x2y = \beta_0 + \beta_1 x + \beta_2 x^2: (a) increasing when β1>0,β2>0\beta_1 > 0, \beta_2 > 0; (b) decreasing when β1<0,β2<0\beta_1 < 0, \beta_2 < 0; (c) concave down with a maximum when β1>0,β2<0\beta_1 > 0, \beta_2 < 0; and (d) concave up with a minimum when β1<0,β2>0\beta_1 < 0, \beta_2 > 0.

<p>The parametric curvature shapes of $$y = \beta_0 + \beta_1 x + \beta_2 x^2$$: (a) increasing when $$\beta_1 > 0, \beta_2 > 0$$; (b) decreasing when $$\beta_1 < 0, \beta_2 < 0$$; (c) concave down with a maximum when $$\beta_1 > 0, \beta_2 < 0$$; and (d) concave up with a minimum when $$\beta_1 < 0, \beta_2 > 0$$.</p>
21
New cards

Interaction

A condition where the relationship between the dependent variable and one independent variable depends on the specific value of a second independent variable, represented by a product term x1x2x_1 x_2.

22
New cards

Piecewise Linear Regression Model

A modeling technique that joins two separate linear regression segments at a specific threshold value where the slope of the relationship changes.

23
New cards

Knot (Breakpoint)

The specific value of the independent variable, denoted x(k)x^{(k)}, at which the functional slope or relationship between xx and yy changes in a piecewise linear model.

24
New cards

Variable Selection Procedures

Systematic methods for identifying the best subset of independent variables: Stepwise Regression, Forward Selection, Backward Elimination (iterative methods), and Best-Subsets Regression (evaluating all subsets).

25
New cards

Overfitting

The error of creating an excessively complex regression model that fits sample idiosyncrasies, causing it to overperform on training data but underperform on population validation data.

26
New cards

Cross-Validation

A validation technique, such as the holdout method, that evaluates regression model performance on a separate validation dataset not used to train the model.

27
New cards

Confidence Interval (Regression Mean Value)

An interval estimate of the expected mean value of the dependent variable for given independent variable values, defined as y^±tα/2sy^\hat{y} \pm t_{\alpha/2} s_{\hat{y}}.

28
New cards

Prediction Interval (Regression Individual Value)

An interval estimate of an individual realization of the dependent variable for given independent variable values, computed as y^±tα/2sy^2+SSEn−p−1\hat{y} \pm t_{\alpha/2} \sqrt{s_{\hat{y}}^2 + \frac{\text{SSE}}{n - p - 1}}.

29
New cards

Raw Data

Data that has not yet been processed, cleansed, or prepared for analysis; also called source data or primary data.

30
New cards

Data Wrangling

The process of cleaning, transforming, and managing raw data so it is accurate, reliable, accessible, and prepared for analysis; also known as data munging or data remediation.

31
New cards

Discovery

The first step of data wrangling, in which an analyst becomes familiar with the raw data and conceptualizes its intended use.

32
New cards

Structuring

The second step of data wrangling, involving the arrangement of raw data into a structured layout to facilitate analysis.

33
New cards

Cleaning

The third step of data wrangling, focusing on identifying and correcting errors, outliers, duplicate records, and handling missing data.

34
New cards

Enriching

The fourth step of data wrangling, involving subsetting, supplementing by appending fields from other files, and enhancing data via systematic transformations.

35
New cards

Validating

The fifth step of data wrangling, verifying that the wrangled data accurately represent the raw data and that all definitions are applied consistently.

36
New cards

Publishing

The final step of data wrangling, which entails storing the final dataset along with its data dictionary in an accessible location for end users.

37
New cards

Flat File

A common pattern of structured data arranged as a rectangular table, where each row represents an observation or record and each column represents a variable or field.

38
New cards

Delimiter

A character (such as a comma, tab, or space) used in raw text files to separate fields within an observation or record.

39
New cards

Stacked Data

A data layout where all measured values for a given variable are stored in a single field or column.

40
New cards

Unstacked Data

A data arrangement where values corresponding to different categories of one variable are placed in separate fields or columns.

41
New cards

Legitimately Missing Data

Data entries that are absent for an appropriate and expected contextual reason, requiring no remedial correction.

42
New cards

Missing Completely at Random (MCAR)

A missing data category where the probability of a value being missing is completely independent of the missing value itself and of any other variable in the dataset.

43
New cards

Missing at Random (MAR)

A missing data category where the likelihood of a value being missing is related to the value of another observed variable in the dataset, but not to the missing value itself.

44
New cards

Missing Not at Random (MNAR)

A missing data category where the probability of a value being missing is directly related to the value of the missing data itself, introducing bias if ignored.

45
New cards

Imputation

The systematic replacement of missing values with reasonable estimates, such as substituting the mean or median for MCAR values or using a predictive model for MAR values.

46
New cards

Data Dictionary

A comprehensive reference document accompanying a dataset that describes field names, definitions, units of measure, raw sources, and cross-table relationships.

47
New cards

Lower-Tail Hypothesis Test

A one-tailed test where the alternative hypothesis posits that the population parameter is strictly less than the hypothesized value (H0:μ≥μ0H_0: \mu \ge \mu_0 vs. Ha:μ<μ0H_a: \mu < \mu_0).

48
New cards

Two-Tailed Hypothesis Test

A directional-neutral statistical test that determines whether a population parameter differs in either direction from a hypothesized value (H0:μ=μ0H_0: \mu = \mu_0 vs. Ha:μ≠μ0H_a: \mu \ne \mu_0).

49
New cards

Level of Significance (α\alpha)

The maximum acceptable risk or probability of committing a Type I error (rejecting a true null hypothesis).

50
New cards

p-Value

The probability of obtaining a test statistic at least as extreme as the observed sample value assuming the null hypothesis H0H_0 is true; H0H_0 is rejected if p-value≤αp\text{-value} \le \alpha.