Bivariate Data Analysis: Scatterplots, Correlation Coefficient, and Least-Squares Regression Models

Foundations of Bivariate Data and Variable Classification

  • Bivariate data analysis involves the simultaneous study of two quantitative variables to investigate patterns, associations, and relationships between paired observations.

  • Paired data structure:

    • Data points must always exist as linked ordered pairs (x,y)(x, y).

    • Data lists must never be sorted independently from low to high, as sorting severs the pairing between individual observations and invalidates any subsequent statistical regression analysis.

    • Regression analysis cannot be performed on categorical variables; both variables under study must be strictly quantitative.

  • Explanatory variable (xx):

    • The variable that explains, affects, or accounts for changes in the response variable.

    • Known historically across mathematics as the independent variable, the input variable, or the domain variable.

    • Plotted exclusively along the horizontal axis (xx-axis).

    • In experimental designs, the explanatory variable represents the treatment or the condition actively manipulated by the experimenter (e.g., amount of time, applied pressure, fluid volume, or number of attachments).

    • Used as the basis for predicting the outcome of the response variable.

  • Response variable (yy):

    • The variable that measures the outcome of an experiment or observational study and depends on the changes of the explanatory variable.

    • Known historically across mathematics as the dependent variable, the output variable, or the range variable.

    • Plotted exclusively along the vertical axis (yy-axis).

    • Represents the variable being predicted by the statistical model.

  • Distinguishing variable roles:

    • When establishing a model, the investigator must explicitly assign the explanatory and response variables before running calculations.

    • In situations where neither variable naturally causes or predicts the other (e.g., paired skeletal dimensions such as femur length and humerus length), either variable may arbitrarily serve as the explanatory variable, provided that the assignment remains consistent throughout the analysis.

Constructing and Interpreting Scatterplots

  • Scatterplot construction principles:

    • Scatterplots serve as the primary graphical tool for displaying bivariate quantitative data.

    • The horizontal axis is designated for the explanatory variable (xx), and the vertical axis is designated for the response variable (yy).

    • Both axes must be labeled clearly with variable names, appropriate numerical scales, and units of measurement.

    • Axes are not required to originate at (0,0)(0, 0); truncation of an axis is permissible to avoid compressing the data points or plotting them directly on top of the axes, provided the numerical intervals are scaled consistently.

  • The DUFS descriptive framework:

    • While single-variable distributions are described using SOCS (Shape, Outliers, Center, Spread), bivariate distributions displayed via scatterplots are evaluated using DUFS:

    • Direction:

      • Positive direction indicates that as the explanatory variable (xx) increases, the response variable (yy) also tends to increase.

      • Negative direction indicates that as the explanatory variable (xx) increases, the response variable (yy) tends to decrease.

      • No direction indicates a random, amorphous scattering of points showing no consistent upward or downward trend.

    • Unusual features:

      • Outliers: Individual data points that fall outside or deviate substantially from the overall pattern of the data. Outliers can occur in the horizontal direction (xx-direction), the vertical direction (yy-direction), or both.

      • Clusters: Distinct groupings of data points separated by spaces. Different clusters within the same dataset may exhibit conflicting internal trends (e.g., one cluster trending positively while another trends negatively).

      • Gaps: Noticeable intervals along the domain or range where no observations appear.

    • Form:

      • Refers to the underlying geometric shape traced by the data points.

      • Classifications include linear (tracing a straight-line pattern) and nonlinear.

      • Nonlinear patterns encompass curved structures such as quadratic/parabolic, exponential, power, logarithmic, polynomial, or logistic growth curves.

    • Strength:

      • Measures how tightly the plotted coordinates adhere to the identified form.

      • Described qualitatively using modifiers such as very strong, strong, moderately strong, fairly weak, or weak.

      • Determining strength requires examining the scale of the vertical (yy) axis: closely bounded values on a small scale indicate tight adherence and less dispersion around the overall trend line.

  • Mandatory context requirement:

    • All written descriptions of scatterplots must incorporate the real-world context of both variables (identifying the units and attributes being measured) rather than relying exclusively on abstract statistical terminology.

  • Explicit prohibition on using "correlation" as a descriptive visual adjective:

    • The word "correlation" represents a specific numerical coefficient (rr).

    • The term "correlation" must never be utilized to describe the visual appearance of a scatterplot unless the exact numerical value of rr has been computed.

    • Appropriate alternative terminology includes "linear relationship" or "linear association".

  • Illustrative case studies:

    • Barbie bungee jump:

    • Context: Dropping a doll secured with varying counts of rubber bands to measure descent distance.

    • Setup: Doll's feet attached to rubber bands; the baseline rubber band around the ankles represents rubber band 00. Two yardsticks stacked end-to-end measure vertical drop.

    • Explanatory variable: Number of rubber bands (manipulated discrete integer values: 0,1,2,3,4,5,6,70, 1, 2, 3, 4, 5, 6, 7).

    • Response variable: Distance traveled by the doll's head in centimeters.

    • Scatterplot characteristics: Strong, positive, linear association between the count of rubber bands and the total distance traveled, with no outliers in either the horizontal or vertical directions.

    • Star Wars characters screen time vs. popularity:

    • Explanatory variable: Screen time exposure in minutes.

    • Response variable: Character popularity rank (11 to 1414).

    • Scatterplot characteristics: Weak, negative linear trend. Overall, as screen time increases, rank value decreases (which numerically represents a higher rank, though visually sloping downward).

    • Unusual features: Darth Vader represents a prominent outlier, holding a rank of 11 despite having very limited screen time. The distribution displays two distinct clusters separated by a central gap; the lower cluster displays a positive trend, whereas the upper cluster trends negatively.

    • Ninth-grade student body weight vs. backpack weight:

    • Explanatory variable: Body weight in pounds.

    • Response variable: Backpack weight in pounds during a hiking field trip.

    • Scatterplot characteristics: Positive, strong linear association; generally, students with lower body weights carry lighter packs.

    • Unusual feature: A student weighing approximately 185 pounds185\,\text{pounds} carries a pack significantly lighter than predicted by the linear model, creating an outlier that deviates noticeably from the dominant trend.

    • State SAT participation rate vs. mean SAT math score:

    • Explanatory variable: Percentage of high school students taking the SAT (5050 state data points).

    • Response variable: State mean math SAT score.

    • Scatterplot characteristics: Fairly strong, negative, nonlinear association; states with higher test-taking percentages exhibit lower mean math scores.

    • Cluster structure: Displays two separate clusters. The upper, more compact cluster consists of states where the SAT is voluntary (taken primarily by self-selected, college-bound students seeking competitive admissions), producing higher scores along a tight linear path. The lower cluster consists of states where SAT testing is universally mandated for graduation, generating lower, more uniform average scores across broader populations.

The Correlation Coefficient (rr)

  • Definition and purpose:

    • The correlation coefficient, denoted by rr, is a standardized numerical statistic that quantifies the direction and strength of the linear association between two quantitative variables.

  • Mathematical bounds and interpretation:

    • The value of rr is strictly bounded: −1≤r≤1-1 \le r \le 1.

    • Direction:

    • A positive value (r>0r > 0) indicates a positive linear association (yy increases as xx increases).

    • A negative value (r<0r < 0) indicates a negative linear association (yy decreases as xx increases).

    • Strength:

    • Values of r=1r = 1 or r=−1r = -1 indicate a perfect linear relationship where all observed points lie exactly upon a single straight line.

    • Values near 00 indicate an extremely weak linear association or an absence of any linear pattern.

    • General benchmarks:

      • Absolute values exceeding 0.80.8 (e.g., ∣r∣≥0.80|r| \ge 0.80) indicate strong or very strong linear relationships.

      • Absolute values in the vicinity of 0.50.5 (e.g., ∣r∣≈0.50|r| \approx 0.50 to 0.750.75) reflect moderate to fairly strong linear associations.

      • Absolute values below 0.50.5 indicate weak linear associations.

  • Algebraic definition and standard score derivation:

    • The formal calculation for the sample correlation coefficient rr is defined as:     r=1n−1∑(x−xˉsx)(y−yˉsy)r = \frac{1}{n - 1} \sum \left( \frac{x - \bar{x}}{s_x} \right) \left( \frac{y - \bar{y}}{s_y} \right)

    • Equivalent formulation using standardized scores (zz-scores):     r=1n−1∑zxzyr = \frac{1}{n - 1} \sum z_x z_y

    • Here, zx=x−xˉsxz_x = \frac{x - \bar{x}}{s_x} denotes the standardized zz-score of the explanatory coordinate, and zy=y−yˉsyz_y = \frac{y - \bar{y}}{s_y} denotes the standardized zz-score of the response coordinate.

    • Conceptual meaning: The correlation coefficient represents the average product of the standardized horizontal and vertical deviations from the mean centroid (xˉ,yˉ)(\bar{x}, \bar{y}).

    • Geometric interpretation: Every data point forms a rectangle whose dimensions are its respective horizontal and vertical zz-scores relative to the intersection lines x=xˉx = \bar{x} and y=yˉy = \bar{y}. The statistic rr is the sum of these signed rectangular areas scaled across n−1n - 1 degrees of freedom.

  • Statistical properties of rr:

    • Non-resistance to outliers: Because the calculation of rr relies directly on sample means (xˉ,yˉ\bar{x}, \bar{y}) and sample standard deviations (sx,sys_x, s_y)—none of which are resistant to extreme values—the correlation coefficient rr is highly sensitive to outliers.

    • Influence of added points:

    • Adding a coordinate that falls directly in line with the existing linear pattern maintains or strengthens the value of rr.

    • Adding a coordinate that deviates substantially from the linear pattern (such as an erroneous entry of 8585 instead of 5858) degrades the tightness of the association and decreases the magnitude of rr.

    • Variable ordering: Because multiplication is commutative (zxzy=zyzxz_x z_y = z_y z_x), switching the explanatory and response variable assignments does not change the numerical value of rr. However, contextual interpretation requires precise variable assignment.

    • Unit invariance: Standardizing data points into dimensionless zz-scores renders rr completely independent of the units of measurement chosen for either xx or yy.

  • Correlation versus causation:

    • A high correlation coefficient demonstrates association, not causality.

    • Even an exceptionally high linear correlation can arise purely from coincidence or confounding variables.

    • Example: The length of winning words in the National Spelling Bee exhibits a strong positive correlation (r≈0.81r \approx 0.81, r2≈0.65r^2 \approx 0.65) with the annual number of deaths caused by venomous spider bites. This statistical association is coincidental and cannot establish that word length influences arachnid mortality.

    • Causation can only be established through a rigorously controlled, randomized comparative experiment.

The Least Squares Regression Line (LSRL)

  • Definition and objective:

    • While infinitely many arbitrary lines of fit can be drawn through a scatterplot, there is exactly one unique Least Squares Regression Line (LSRL), also called the line of best fit or the y^\hat{y} equation.

    • The LSRL mathematical equation is defined as:     y^=a+bx\hat{y} = a + bx

    • Here, y^\hat{y} represents the predicted value of the response variable for a given value of xx, bb denotes the slope of the regression line, and aa denotes the yy-intercept.

    • The caret symbol (^\hat{}) over the variable yy is mandatory to distinguish modeled, predicted outputs from observed data points (yy).

  • Fundamental properties of the LSRL:

    • Least-squares criterion: The line minimizes the sum of the squared vertical distances (squared residuals) from each observed data point to the line:     ∑(y−y^)2=minimum\sum (y - \hat{y})^2 = \text{minimum}

    • Centroid property: The LSRL always passes directly through the point of averages (centroid), defined by coordinates (xˉ,yˉ)(\bar{x}, \bar{y}).

  • Mathematical derivation of slope and intercept:

    • Slope (bb):     b=r(sysx)b = r \left( \frac{s_y}{s_x} \right)

    • Conceptual derivation: The ratio sysx\frac{s_y}{s_x} represents the baseline rate of vertical variation to horizontal variation (ΔyΔx\frac{\Delta y}{\Delta x}). If r=1r = 1 or r=−1r = -1, the slope equals this ratio directly. For any real-world dataset where ∣r∣<1|r| < 1, the slope is scaled by the correlation coefficient rr, pulling the line toward the horizontal axis relative to standard deviations.

    • Intercept (aa):

    • Because the regression line must pass through (xˉ,yˉ)(\bar{x}, \bar{y}), substituting these coordinates into the point-slope form gives:       yˉ=a+bxˉ\bar{y} = a + b\bar{x}

    • Solving for aa yields:       a=yˉ−bxˉa = \bar{y} - b\bar{x}

  • Contextual interpretation of regression parameters:

    • Slope (bb):

    • Standard sentence structure: "On average, for each additional unit increase in [explanatory variable xx], the [response variable yy] is predicted to increase/decrease by ∣b∣|b| units."

    • The phrase "on average" or "predicted" is strictly required, as the slope describes a modeled rate of change rather than an absolute deterministic rule.

    • Intercept (aa):

    • Standard sentence structure: "When the [explanatory variable xx] is equal to zero units, the predicted value of the [response variable yy] is aa units."

    • Meaningful application: In certain contexts, the intercept has concrete physical meaning (e.g., in a model of rat growth, a=100 ga = 100\,\text{g} represents the average birth weight at 0 weeks0\,\text{weeks}; for vehicle valuation, a=$38,257a = \$38,257 reflects the baseline price of a brand-new vehicle at 0 miles0\,\text{miles}).

    • Non-physical application: In other contexts, the intercept serves only as a mathematical anchor to establish the slope across the observed domain. For instance, in modeling fossilized dinosaur bones where femur length predicts humerus length, a yy-intercept of a=−3.66 cma = -3.66\,\text{cm} at a femur length of 0 cm0\,\text{cm} has no biological reality, as negative limb lengths cannot exist.

Evaluating Regression Models: Predictions, Extrapolation, and Residual Analysis

  • Generating predictions:

    • Predicted response values are computed by substituting a designated value of xx directly into the regression model: y^=a+b(x)\hat{y} = a + b(x).

    • Example: In the Ford F-150 pricing model y^=38257−0.1629x\hat{y} = 38257 - 0.1629x (where xx is odometer mileage and yy is resale price in dollars):

    • At x=100,000 milesx = 100,000\,\text{miles}:       y^=38257−0.1629(100000)=38257−16290=$21,967\hat{y} = 38257 - 0.1629(100000) = 38257 - 16290 = \$21,967

  • The danger of extrapolation:

    • Extrapolation is the practice of using a regression model to make predictions for values of the explanatory variable that lie far beyond the domain of the data used to construct the model.

    • Extrapolated predictions are notoriously unreliable, unrealistic, and mathematically invalid because the established linear relationship cannot be assumed to hold outside the observed interval.

    • Example 1 (Automotive depreciation):

    • Evaluating the Ford F-150 model at x=260,000 milesx = 260,000\,\text{miles} yields:       y^=38257−0.1629(260000)=−$4,097\hat{y} = 38257 - 0.1629(260000) = -\$4,097

    • A negative market value implies the owner must pay a buyer to haul the vehicle away, which is commercially absurd. The vehicle's scrap materials maintain positive value, showing that depreciation slows down nonlinearly at higher mileages.

    • Example 2 (Biological growth model):

    • A laboratory rat study models weight over the first 25 weeks25\,\text{weeks} of life as y^=100+40x\hat{y} = 100 + 40x (xx in weeks, yy in grams).

    • Evaluating the model at an age of 2 years2\,\text{years} (x=104 weeksx = 104\,\text{weeks}) yields:       y^=100+40(104)=4,260 grams=4.26 kg\hat{y} = 100 + 40(104) = 4,260\,\text{grams} = 4.26\,\text{kg}

    • Converting units (1 kg≈2.2 pounds1\,\text{kg} \approx 2.2\,\text{pounds}):       4.26×2.2≈9.372 pounds4.26 \times 2.2 \approx 9.372\,\text{pounds}

    • A lab rat weighing nearly 10 pounds10\,\text{pounds} is biologically impossible. Organism growth follows a logistic growth curve that levels off horizontally at adulthood rather than continuing along an unbounded linear path.

  • Residual calculation and interpretation:

    • A residual measures the vertical prediction error between an observed coordinate and the corresponding point on the regression line.

    • Formal formula:     Residual=y−y^\text{Residual} = y - \hat{y}     Residual=Actual Value−Predicted Value\text{Residual} = \text{Actual Value} - \text{Predicted Value}

    • Interpretation of residual signs:

    • Positive residual (y−y^>0  ⟹  y>y^y - \hat{y} > 0 \implies y > \hat{y}):

      • The actual data point lies vertically above the regression line.

      • The regression model underestimates the true observed outcome.

    • Negative residual (y−y^<0  ⟹  y<y^y - \hat{y} < 0 \implies y < \hat{y}):

      • The actual data point lies vertically below the regression line.

      • The regression model overestimates the true observed outcome.

    • Numerical examples:

    • Ford F-150: Observed truck with x=70,583 milesx = 70,583\,\text{miles} and actual resale price y=$21,994y = \$21,994.

      • Predicted price: y^=38257−0.1629(70583)=$26,759\hat{y} = 38257 - 0.1629(70583) = \$26,759

      • Residual calculation:         Residual=21994−26759=−$4,765\text{Residual} = 21994 - 26759 = -\$4,765

      • Interpretation: The linear model overestimates the resale price of this specific vehicle by $4,765\$4,765 (the vehicle sells for $4,765\$4,765 less than predicted).

    • Dinosaur fossil: Observed pair with femur length x=59 cmx = 59\,\text{cm} and humerus length y=70 cmy = 70\,\text{cm}.

      • Model parameters: y^=−3.426+1.197x\hat{y} = -3.426 + 1.197x

      • Predicted humerus length:         y^=−3.426+1.197(59)=67.2007 cm\hat{y} = -3.426 + 1.197(59) = 67.2007\,\text{cm}

      • Residual calculation:         Residual=70−67.2007=2.7993 cm\text{Residual} = 70 - 67.2007 = 2.7993\,\text{cm}

      • Interpretation: The model underestimates the humerus length by 2.7993 cm2.7993\,\text{cm} (the observed bone is 2.7993 cm2.7993\,\text{cm} longer than predicted).

  • Residual plots:

    • A residual plot is a diagnostic scatterplot that displays the explanatory variable (xx) along the horizontal axis and the calculated residuals (y−y^y - \hat{y}) along the vertical axis.

    • The horizontal axis at Residual=0\text{Residual} = 0 corresponds directly to the LSRL.

    • Conservation property of the LSRL:

    • By mathematical construction, the algebraic sum of all residuals produced by the least-squares regression line is always identically zero:       ∑(y−y^)=0\sum (y - \hat{y}) = 0

    • Diagnostic criteria for assessing model fit:

    • Appropriate linear fit:

      • The residual plot displays an unstructured, uniform, random scatter of points distributed symmetrically above and below the line Residual=0\text{Residual} = 0.

      • No distinct curves, trends, or systematic variations in point spread should appear.

    • Inappropriate linear fit (curved pattern):

      • If the residual plot exhibits a distinct curved or parabolic shape, a linear model is structurally inappropriate for the data.

      • Even if the correlation coefficient rr is high (e.g., r=0.85r = 0.85 or r=0.90r = 0.90), a curved residual plot confirms that the underlying relationship is nonlinear.

    • Inappropriate linear fit (fanning or heteroscedasticity):

      • If the residual plot fans outward (points spread wider along the vertical axis as xx increases), predictions become systematically less precise and less reliable for higher values of the explanatory variable.

The Coefficient of Determination (r2r^2) and Partitioning of Variation

  • Definition and operational interpretation:

    • The coefficient of determination, denoted by r2r^2, represents the proportion or percentage of the total variation in the response variable (yy) that is explained by the linear relationship with the explanatory variable (xx).

    • Standard sentence frame:

    • "[r2×100]%[r^2 \times 100]\% of the variation in [response variable yy] can be explained by the linear relationship with [explanatory variable xx]."

    • Example interpretations:

    • Barbie bungee drop (r=0.987,r2=0.974r = 0.987, r^2 = 0.974): 97.4%97.4\% of the variation in the distance traveled by the doll can be explained by the linear relationship with the number of attached rubber bands.

    • Dinosaur bones (r=0.9941,r2=0.988r = 0.9941, r^2 = 0.988): 98.8%98.8\% of the variation in humerus bone length can be explained by the linear relationship with femur bone length.

    • National Spelling Bee vs. spider bites (r2=0.65r^2 = 0.65): 65%65\% of the variation in spider bite fatalities can be mathematically accounted for by the linear model with the number of letters in winning spelling bee words (though this is entirely non-causal).

    • Poor interpretation phrasing to avoid: Stating that "98.8%98.8\% of the variation is explained by the data" is mathematically incomplete. The phrasing must explicitly specify that variation is explained by the linear relationship with the changes in the explanatory variable xx.

  • Mathematical derivation and partitioning of variation:

    • Total Sum of Squares (SSTSST):

    • Measures the total dispersion of the observed response values (yy) around their unconditional mean (yˉ\bar{y}):       SST=∑(y−yˉ)2SST = \sum (y - \bar{y})^2

    • Represents the baseline error present when predicting yy using only the horizontal mean line yˉ\bar{y} without considering the explanatory variable xx.

    • Sum of Squared Residuals (SSRSSR or SSESSE):

    • Measures the remaining unexplained vertical variation after fitting the regression line:       SSR=∑(y−y^)2SSR = \sum (y - \hat{y})^2

    • Because the regression line tilts through the centroid to follow the trend, the squared residual errors from the line (SSRSSR) are smaller than the deviations from the mean line (SSTSST).

    • Ratio of unexplained variation:

    • The fraction SSRSST\frac{SSR}{SST} represents the proportion of total variation in yy that cannot be accounted for by the linear model.

    • Complementary relationship for r2r^2:

    • Subtracting the unexplained fraction from the total baseline variation gives the proportion of explained variation:       r2=1−SSRSSTr^2 = 1 - \frac{SSR}{SST}

    • As the regression line approaches the data points, SSRSSR approaches 00, driving SSRSST\frac{SSR}{SST} toward 00 and bringing r2r^2 closer to 11.

Step-by-Step Computational Procedures and Technology Guide

  • Manual calculation of rr using standard scores (zz-scores):

    • Step 1: Compute the summary statistics for both variables: sample means (xˉ,yˉ\bar{x}, \bar{y}) and sample standard deviations (sx,sys_x, s_y).

    • Step 2: In a calculation table, list paired columns for xx and yy.

    • Step 3: Compute the standardized score for each horizontal observation: zx=x−xˉsxz_x = \frac{x - \bar{x}}{s_x}.

    • Step 4: Compute the standardized score for each vertical observation: zy=y−yˉsyz_y = \frac{y - \bar{y}}{s_y}.

    • Step 5: Calculate the product of the standardized pairs for each row: Product=zx×zy\text{Product} = z_x \times z_y.

    • Step 6: Sum all calculated products across the dataset: ∑zxzy\sum z_x z_y.

    • Step 7: Divide the total sum by the degrees of freedom (n−1n - 1) to obtain rr:     r=∑zxzyn−1r = \frac{\sum z_x z_y}{n - 1}

  • Manual derivation of the LSRL from summary statistics:

    • Given: xˉ,sx,yˉ,sy\bar{x}, s_x, \bar{y}, s_y, and rr.

    • Step 1: Calculate the slope bb:     b=r(sysx)b = r \left( \frac{s_y}{s_x} \right)

    • Step 2: Calculate the intercept aa using the centroid (xˉ,yˉ)(\bar{x}, \bar{y}):     a=yˉ−bxˉa = \bar{y} - b\bar{x}

    • Step 3: Write the final regression model using formal prediction notation:     y^=a+bx\hat{y} = a + bx

  • Graphing calculator setup (TI-84 series):

    • Enabling statistical diagnostics (required once per calculator reset):

    • Modern OS: Press MODE, navigate down to STAT DIAGNOSTICS, set to ON. Ensure STAT WIZARDS is set to ON.

    • Legacy OS: Press 2nd then 0 to open the CATALOG. Press D (or scroll downward) to find DiagnosticOn. Press ENTER twice until the screen displays Done. If diagnostics remain inactive, the calculator will output slope and intercept without computing rr or r2r^2.

    • Entering bivariate data:

    • Press STAT, select 1:Edit....

    • Enter explanatory observations (xx) into list L1.

    • Enter response observations (yy) into list L2.

    • Ensure ordered pairs correspond correctly row-by-row; never sort either list.

    • Computing the regression model:

    • Press STAT, move the cursor right to CALC.

    • Select 8:LinReg(a+bx) (avoid option 4:LinReg(ax+b) to maintain standard statistical convention).

    • Specify parameters: Xlist: L1, Ylist: L2.

    • To automatically store the regression line into graphing memory:

      • Method A: Navigate to Store RegEQ:, press VARS, scroll to Y-VARS, select 1:Function, then select 1:Y1.

      • Method B: Press ALPHA, press F4 (or TRACE), and select Y1.

    • Move cursor to Calculate and press ENTER. The output provides the intercept aa, slope bb, coefficient of determination r2r^2, and correlation coefficient rr.

    • Generating a scatterplot with the fitted regression line:

    • Press 2nd then Y= (STAT PLOT).

    • Select Plot1, toggle to On.

    • Choose the first icon under Type (scatterplot).

    • Set Xlist: L1 and Ylist: L2.

    • Press ZOOM, select 9:ZoomStat.

    • The screen will display the scatterplot alongside the regression line stored in Y1.

    • Generating a diagnostic residual plot:

    • After running LinReg(a+bx), the calculator automatically writes the residuals into a dedicated system list named RESID.

    • To view residuals in the table: Press STAT, select 1:Edit..., move the cursor to the header of empty list L3, press ENTER, press 2nd then STAT (LIST), select RESID, and press ENTER.

    • Plotting the residuals:

      • Press 2nd then Y= (STAT PLOT).

      • Ensure Plot1 (or the equation in Y=) is turned off to prevent the original line from appearing.

      • Select Plot2, toggle to On, choose the scatterplot icon.

      • Set Xlist: L1 and Ylist: L3 (or direct selection of RESID).

      • Press ZOOM, select 9:ZoomStat.

      • Examine the resulting plot relative to the horizontal axis (Residual=0\text{Residual} = 0) for signs of curvature or fanning.

Questions & Discussion

  • Q: What is an explanatory variable?

    • Response: An explanatory variable explains or accounts for the changes observed in the response variable. It represents the quantity manipulated by the investigator (such as time, pressure, or volume) to observe changes in an experimental outcome.

  • Q: In the initial snack preference warmup (where the xx-axis represents Person A and the yy-axis represents Person B across identical snack scales), what would the scatterplot look like if two individuals share similar snack preferences?

    • Response: The points trace an upward, positive linear pattern across the coordinate space. However, the points are not connected by continuous line segments because preferences represent discrete ordered entities.

  • Q: In the same warmup, what would the scatterplot look like if two individuals have opposite snack preferences, or if they share no common interests at all?

    • Response: If preferences are completely opposite (e.g., Person A ranks Cheez-It lowest while Person B ranks Funyuns highest), the points trace a negative linear downward pattern. If the two individuals share no common interests, the points scatter randomly without a discernible linear path.

  • Q: In the Barbie bungee experiment, what are the explanatory and response variables?

    • Response: The explanatory variable is the number of rubber bands tied to the doll's feet (the input quantity manipulated by adding bands from 00 to 77). The response variable is the total distance traveled by the doll's head (the resulting output measured in centimeters).

  • Q: How should the initial Barbie bungee scatterplot be described?

    • Response: There is a strong, positive, linear relationship between the number of rubber bands tied to the doll and the distance traveled. The term "correlation" must not be used in the visual description unless its numerical value is calculated. There are no apparent outliers in either the horizontal or vertical directions.

  • Q: What happens if an additional point is recorded for 1212 rubber bands that aligns closely with the existing pattern?

    • Response: Because the point conforms to the existing linear trend without deviating, the value of the correlation coefficient rr remains essentially unchanged or slightly strengthens.

  • Q: What happens if a data value is mistyped as 8585 instead of 5858?

    • Response: The mistyped point becomes an artificial outlier that deviates substantially from the overall linear trend, increasing dispersion around the line and reducing the magnitude of the correlation coefficient rr.

  • Q: In the Star Wars study, which variable is explanatory and which is response?

    • Response: The explanatory variable is the screen time exposure in minutes, because the research question investigates whether exposure time can predict a character's popularity rank (which serves as the response variable).

  • Q: Does the Star Wars screen time vs. popularity scatterplot exhibit any direction, form, or unusual points?

    • Response: The plot shows a weak, negative linear trend. Darth Vader represents an unusual point (ranking at number 11 despite minimal screen time). The distribution forms two distinct clusters separated by a gap; within these clusters, the lower group shows a positive slope while the upper group displays a negative slope.

  • Q: In the fossil dinosaur bones dataset, which bone length is the explanatory variable and which is the response variable?

    • Response: Neither variable naturally causes or predicts the other. In the absence of an explicit experimental setup, either bone length may serve as the explanatory variable. For the class analysis, femur length is designated as the explanatory variable (xx) and humerus length as the response variable (yy).

  • Q: How is the linear relationship between femur length and humerus length described?

    • Response: There is a strong, positive, linear relationship between femur length and humerus length, with longer femur bones corresponding to longer humerus bones. The points cluster tightly along a line with no unusual outliers.

  • Q: What is the physical meaning of the regression slope b=−0.1629b = -0.1629 in the Ford F-150 pricing model?

    • Response: On average, the resale price of a Ford F-150 truck decreases by approximately $0.1629\$0.1629 (or about 16.3 cents16.3\,\text{cents}) for each additional mile driven.

  • Q: What does the yy-intercept a=38257a = 38257 represent in the Ford F-150 model?

    • Response: The yy-intercept represents the modeled baseline price ($38,257\$38,257) for a brand-new truck with zero miles driven.

  • Q: Why does predicting the price of a Ford F-150 with 260,000 miles260,000\,\text{miles} produce a negative value (−$4,097-\$4,097)?

    • Response: The calculation represents an extrapolation far beyond the domain of the sample data (8,3598,359 to approximately 144,000 miles144,000\,\text{miles}). A linear model inevitably crosses the horizontal axis at zero dollars, whereas actual vehicle values level off nonlinearly due to scrap metal and parts value.

  • Q: In the lab rat growth model (y^=100+40x\hat{y} = 100 + 40x), what do the parameters represent and why does predicting weight at 2 years2\,\text{years} fail?

    • Response: The intercept indicates that an average newborn lab rat weighs 100 grams100\,\text{grams}. The slope indicates that rats gain an average of 40 grams40\,\text{grams} per week during their first 25 weeks25\,\text{weeks}. Predicting at 2 years2\,\text{years} (104 weeks104\,\text{weeks}) produces an impossible weight of 4,260 grams4,260\,\text{grams} (about 9.4 pounds9.4\,\text{pounds}) because animal growth tapers off into a logistic plateau rather than continuing along a linear trajectory indefinitely.

  • Q: In the dinosaur bone regression model, what does the yy-intercept of a=−3.66 cma = -3.66\,\text{cm} signify?

    • Response: The intercept has no realistic biological application because a dinosaur cannot have a negative humerus length when its femur length is zero. It functions solely as a mathematical anchor to position the regression line correctly across the observed data interval.

  • Q: How is a residual calculated, and what does its sign indicate?

    • Response: A residual is calculated as observed response minus predicted response: Residual=y−y^\text{Residual} = y - \hat{y}. A positive residual indicates that the observed point lies above the line (the model underestimated the value). A negative residual indicates that the observed point lies below the line (the model overestimated the value).

  • Q: What ideal visual pattern should appear in a diagnostic residual plot to confirm that a linear model fits well?

    • Response: The residual plot should show a random, uniform scatter of points centered around the reference line Residual=0\text{Residual} = 0, with consistent vertical spread across the domain and no evidence of curvature, parabolic arcs, or fanning.