Chapter 2: Introduction to Statistics and Data Analysis Study Guide
Overview of Statistical Inference, Samples, Populations, and Probability
Historical Context and the Industrial Miracle:
Beginning in the 1980s and extending into the 21st century, American industry shifted significant attention toward quality improvement.
The Japanese "industrial miracle" of the mid-20th century was largely driven by the widespread implementation of statistical methods and statistical thinking among management personnel to manufacture high-quality products consistently.
Use of Scientific Data:
Gathering scientific data is a centuries-old practice involved in manufacturing, food product development, computer software engineering, energy systems, and pharmaceuticals.
A fundamental distinction exists between mere data collection/summarization and inferential statistics.
Inferential statistics provides a structured toolkit designed to make scientific judgments, decisions, and inferences in the presence of natural uncertainty and variation.
Sources of Variability in Scientific Data:
Variability is inherent in almost all physical and biological systems. If data were always constant and perfectly accurate, statistical analysis would be unnecessary.
Batch-to-Batch vs. Within-Batch Variation: In manufacturing (e.g., material density), output varies between production runs (batch-to-batch) as well as within a single batch.
Measurement vs. Environmental Variation: Measuring atmospheric sulfur monoxide involves two distinct sources of variation: daily fluctuations at the same locale and measurement error between the observed reading and the true chemical concentration.
Subject-to-Subject Variation: In biomedical drug trials (e.g., a hypertension drug achieving an success rate versus an old drug's success rate), patient response varies naturally. Success rates fluctuate across study samples (e.g., a repeated trial might yield ), making statistical evaluation of variability critical before approving higher-cost or side-effect-bearing treatments.
Populations and Samples:
Population: The complete collection of all individual items, observations, or scientific units of a specified type (e.g., all computer boards manufactured under a given process, or all human patients suffering from chronic hypertension).
Sample: A subset of observations chosen from a population (e.g., computer boards selected randomly from an assembly line).
Statistical inferences drawn from a sample extend to the overarching population from which the sample was drawn, provided proper sampling methods are used.
Types of Scientific Studies:
Designed Experiments: The scientist or engineer systematically alters input factors (e.g., temperature, humidity, chemical dosages) according to a planned scheme to evaluate their impact on a response variable.
Observational Studies: Data are collected without direct control over input factor levels because factors cannot be preselected or manipulated (e.g., a forest scientist studying wood density across natural tree populations, or an agronomist collecting crop yield data during an unexpected drought).
Role of Probability in Inferential Statistics:
Probability theory (covered in depth in Chapters 2–6) connects descriptive statistics to inferential methods, quantifying the strength or confidence of statistical conclusions.
Deductive Reasoning (Probability): Uses known population characteristics to deduce the behavior or properties of hypothetical samples drawn from that population.
Inductive Reasoning (Inferential Statistics): Uses observed sample data alongside probability theory to draw formal conclusions about unknown population parameters.

Illustrative Examples of Probability in Decision Making:
Example 1.1 (Manufacturing Defect Rates):
A sample of items yields defective items. The maximum tolerable long-run defective rate for the company is ().
Assuming a true population defective rate of , the probability () of observing or more defective items in a random sample of is calculated as
Because is small, the engineer concludes that the process defective rate likely exceeds the allowable threshold, signaling a need for process modification.
Example 1.2 (Fungus and Seedling Root Growth Study):
Conducted at Virginia Polytechnic Institute and State University (Virginia Tech) to evaluate the effect of nitrogen on northern red oak seedlings inoculated with the fungus Pisolithus tinctorus over days.
Data Set (Stem Weights in grams):
No Nitrogen (): , , , , , , , , ,
Nitrogen (): , , , , , , , , ,

- Visual inspection via a dot plot reveals that nitrogen-treated observations () generally exceed non-nitrogen observations ().
- If nitrogen had zero effect (both samples coming from the exact same population), the probability of observing data with this degree of separation is approximately . This small provides strong evidence that nitrogen increases average stem weight.
Sampling Procedures and Collection of Data
Simple Random Sampling:
A sampling procedure where every possible sample of size has an equal chance of being selected from the population.
Sample Size (): The total number of elements or observations included in a sample.
Biased Sample: Occurs when non-random selection restricts the sample to a sub-population. For instance, selecting families exclusively from urban areas for a statewide political survey biases results because rural political preferences differ.
Stratified Random Sampling:
Used when sampling units are non-homogeneous but naturally divide into homogeneous, non-overlapping groups called strata.
Independent random samples are selected within each stratum to ensure all sub-groups are appropriately represented (e.g., dividing a municipal population into ethnic strata before conducting a bond referendum opinion poll).
Principles of Experimental Design:
Treatments: Specific conditions or factor combinations being compared across populations (e.g., Nitrogen vs. No Nitrogen; Placebo vs. Active Drug; Coated vs. Uncoated materials).
Experimental Units: The physical entities or subjects assigned to treatments (e.g., individual tree seedlings, clinical trial patients, metal specimens).
Importance of Random Assignment:
Assigning experimental units randomly to treatments prevents systematic bias caused by uncontrolled baseline characteristics (e.g., accidentally assigning heavier patients to a placebo group in a hypertension study).
Randomization ensures that variability among experimental units is distributed evenly across treatment groups rather than confounding the treatment effects.
Example 1.3 (Aluminum Alloy Corrosion Study):
Investigates the impact of a chemical corrosion coating and relative humidity on aluminum fatigue life.
Response Variable: Corrosion resistance measured in thousands of cycles to failure (higher values indicate lower corrosion).
Experimental Design: Four treatment combinations across two factors:
Coating: Uncoated vs. Chemical Corrosion Coating
Humidity: vs. Relative Humidity
Eight experimental specimens were prepared, assigning two specimens randomly to each treatment combination.
Data Set (Average Cycles to Failure in Thousands):
Uncoated at Relative Humidity:
Uncoated at Relative Humidity:
Chemical Corrosion Coating at Relative Humidity:
Chemical Corrosion Coating at Relative Humidity:

Key Insights: Higher humidity increases corrosion across both groups, but the chemical coating significantly reduces corrosion. Furthermore, the coating mitigates the negative impact of high humidity.
Measures of Location: The Sample Mean and Median
Sample Mean:
The numerical average of a set of sample observations .
Formula (Definition 1.1):
Physical Interpretation (Centroid): The sample mean serves as the centroid or center of mass of the sample data. In a physical system, it represents the exact fulcrum point where a system of equal weight points balances.

Sample Median:
A robust measure of central location arranged to reflect central tendency without distortion from extreme outliers.
Formula (Definition 1.2): For ordered observations :
Sensitivity to Outliers (Mean vs. Median Comparison):
For the sample , the single extreme value pulls the mean to , whereas the median remains stable at .
Stem Weight Summary (Example 1.2 Data):
No-Nitrogen: ,
Nitrogen: ,
Trimmed Means:
A compromise estimator created by eliminating a specified percentage of the highest and lowest sample values prior to computing the arithmetic average.
Trimmed Mean Formula: Removes the top and bottom of ordered data.
Stem Weight Computations (Example 1.2):
No-Nitrogen ( trimmed mean, removing and ):
Nitrogen ( trimmed mean, removing and ):
The median is a limiting extreme case of a trimmed mean where all observations except the central one or two are trimmed.
Measures of Variability
Importance of Variability:
Controlling and reducing process variability is vital in manufacturing and engineering because product quality and overall profitability depend directly on variance reduction.
Measures of location alone are insufficient to summarize a sample; two data sets can share identical sample means yet exhibit vastly different spread, altering conclusions.
Sample Range:
Defined as the absolute difference between the maximum and minimum observations:
Sample Variance and Standard Deviation:
Sample Variance Formula (Definition 1.3):
Sample Standard Deviation Formula:
Degrees of Freedom (): Represents the number of independent pieces of information available to compute . Because the sum of deviations about the mean always equals zero: stipulating the first deviations fully fixes the final deviation.
Step-by-Step Variance Calculation Example:
For sample data , :
Deviations : , , ,
Sum of squared deviations:
Variance:
Example 1.4 (pH Meter Bias Test):
Sample size measurements of a neutral solution ():
Data:
Mean:
Variance calculation:
Standard deviation:
Measurement Units and Theoretical Context:
Variance is expressed in squared linear units (e.g., ), whereas standard deviation returns to original linear units (e.g., ).
For Example 1.2 stem weights, standard deviations are (No Nitrogen) and (Nitrogen), confirming that nitrogen increases sample dispersion alongside the mean.
Population variance () and mean () represent true fixed population parameters estimated by sample statistics ( and ). Variance is primarily utilized in theoretical inference, while standard deviation is used in practical applications.
Discrete and Continuous Data
Continuous Data:
Measurements taken along a continuous numerical scale (e.g., chemical yield in grams/pound, tensile strength in megapascals, stem weight in grams).
Discrete Data:
Count data or categorical classifications representing distinct integers or non-continuous steps (e.g., number of radioactive particles passing a sensor per millisecond, number of oil tankers arriving daily).
Binary Data and Sample Proportions:
Binary outcomes consist of two mutually exclusive categories (e.g., Success/Failure, Defective/Non-defective, Response/No Response).
Categories are coded numerically as (Category 1 / Success) or (Category 2 / Failure).
For sample items with total successes:
Sample proportion in Category 1:
Sample proportion in Category 2:
The sample proportion is mathematically identical to the sample mean of binary 0s and 1s:
Clinical Example: If out of patients show improvement under a drug, ( success) and ( non-success).
Manufacturing Quality Example: A tire manufacturer evaluates tires and finds defective (). After a process change, a second sample of yields defective tires (). Inferential statistics determines if the drop from to reflects a genuine population improvement or sampling noise.
Statistical Modeling, Scientific Inspection, and Graphical Diagnostics
Statistical Modeling vs. Deterministic Models:
Statistical models incorporate random probabilistic variation alongside underlying mathematical assumptions (e.g., assuming sample data follow a Gaussian/Normal distribution).
Scatter Plots and Empirical Model Building:
Tensile Strength vs. Cotton Percentage Study:
Specimens manufactured across four cotton percentages (, , , ) with five specimens tested per concentration level.
Data Set:
Cotton:
Cotton:
Cotton:
Cotton:

- A quadratic regression model captures the curvilinear relationship:
where represents expected tensile strength given cotton concentration .
Stem-and-Leaf Plots:
Tabular and graphical display splitting observations into leading digits (stems) and trailing digits (leaves).
Car Battery Life Study ( items, guaranteed 3 years):
Data Set: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,
Single Stem Plot: Stems =
Stem 1: Leaves (Frequency = 2)
Stem 2: Leaves (Frequency = 5)
Stem 3: Leaves (Frequency = 25)
Stem 4: Leaves (Frequency = 8)
Double-Stem Plot: Splits stems into (leaves 0–4) and (leaves 5–9):
: (Frequency = 2)
: (Frequency = 1)
: (Frequency = 4)
: (Frequency = 15)
: (Frequency = 10)
: (Frequency = 5)
: (Frequency = 3)
Practical guideline: Select between and stems based on total sample size.
Relative Frequency Distributions and Histograms:
Dividing class frequency by sample size yields the class relative frequency.
Relative Frequency Table for Battery Life Data ():
Interval (Midpoint ): Frequency , Relative Frequency
Interval (Midpoint ): Frequency , Relative Frequency
Interval (Midpoint ): Frequency , Relative Frequency
Interval (Midpoint ): Frequency , Relative Frequency
Interval (Midpoint ): Frequency , Relative Frequency
Interval (Midpoint ): Frequency , Relative Frequency
Interval (Midpoint ): Frequency , Relative Frequency


Distribution Symmetry and Skewness:
Symmetric: Foldable along a central vertical axis into matching halves.
Right-Skewed (Positive Skew): Possesses an elongated right tail and concentrated left values.
Left-Skewed (Negative Skew): Possesses an elongated left tail and concentrated right values.

Box-and-Whisker Plots (Box Plots) and Outlier Detection:
Encloses the Interquartile Range () within a central box containing the median ().
Rule: Observations falling beyond below or above are categorized as outliers.
Example 1.5 (Cigarette Nicotine Data, ):
Data Set: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,
; Threshold
Outliers identified: and in the lower tail; in the upper tail.


Example 1.6 (Paint Can "Ears" Thickness, samples of size ):
Median , Lower Quartile , Upper Quartile
Asymmetric left block wider than right block; no outliers detected.

Quartiles and Percentiles:
First Quartile ( / 25th percentile): Separates the lowest of data.
Second Quartile ( / Median / 50th percentile): Divides the sample into equal halves.
Third Quartile ( / 75th percentile): Separates the top of data.
Percentiles: Partition distributions finely (e.g., 95th percentile isolates the top ; 1st percentile isolates the bottom ).
General Types of Statistical Studies
Designed Experiments:
Feature active factor level manipulation and random experimental unit allocation.
Establish definitive cause-and-effect relationships by neutralizing nuisance variables through randomization.
Interaction Effects: Occurs when the response variation across levels of one factor depends on the state of a second factor (demonstrated by non-parallel lines in factor plots, such as Figure 1.3).
Observational Studies:
Collect monitoring data over time without active factor intervention or randomization (e.g., recording human sodium intake vs. blood cholesterol, or monitoring power plant usage vs. ambient temperature).
Limitations: Cannot definitively demonstrate cause-and-effect due to confounding variables (e.g., diet, exercise, plant production volume) and subject to environmental constraints on variable ranges.
Retrospective Studies:
Utilize historical records compiled over past operational periods.
Advantages: Low execution cost.
Disadvantages:
Questionable data validity and historical recording accuracy.
Unobserved missing records along time series.
Risk of unrecorded human error.
Uncontrolled historical variable ranges that may not reflect present conditions.
End-of-Chapter Exercises and Practice Datasets
Exercise 1.1 (Paint Drying Times in Hours):
Data ():
Calculations: , , trimmed mean .
Exercise 1.2 (Cotton Fiber Water Absorbency):
Data ():
Calculations: , , trimmed mean .
Exercise 1.3 (Aircraft Polymer Aging and Tensile Strength in psi):
No Aging ():
Aging ():
Comparison: No Aging , ; Aging , . Aging significantly reduces tensile strength.
Exercise 1.4 (Steel Rod Spring Flexibility):
Company A ():
Company B ():
Results: Company A , ; Company B , . Company B yields higher flexibility.
Exercise 1.5 (Cholesterol Reduction Study):
Control ():
Treatment ():
Results: Control , ; Treatment , . The treatment mean is inflated by a single outlier (), while medians show similar overall performance.
Exercise 1.6 (Silicone Rubber Tensile Strength in MPa vs. Curing Temp):
():
():
Calculations: , ; , . Higher temperature increases both mean strength and sample variability.
Exercise 1.13 (Electronic Battery Lifetimes in Hours):
Sample:
, . The extreme value causes the mean to exceed the median.
Exercise 1.14 (Tire Inner Diameter in mm):
Sample:
, , , , Range . Mean matches target target diameter () closely.
Exercise 1.15 (Fair Coin Probability Proof):
Five coin tosses yielding HHHHH has probability
Evaluating under a two-tailed test () shows moderate, but not overwhelming, evidence of bias.
Exercise 1.16 (Sum of Deviations Proof):
Show that :
Exercise 1.17 (Smoking Impact on Sleep Onset in Minutes):
Smokers ():
Nonsmokers ():
Results: Smokers , ; Nonsmokers , . Smoking increases sleep latency and variation.
Exercise 1.21 (Power Failure Durations in Minutes):
Data ( observations from to minutes).
, , .
Exercise 1.23 (Automobile Hydrocarbon Emissions in ppm):
1980 Models ():
1990 Models ():
Shows significant reduction in average emissions and variance across decade models.
Exercise 1.27 (Bearing Wear vs. Load in lbs):
Loads tested: , ,
Means: , ,
Individual variability shows substantial overlap across load categories, emphasizing the importance of evaluating standard deviations alongside means.
Exercises 1.28 & 1.31 (Injection Molding Shrinkage in ):
Low Mold Temperature:
Low Velocity Mean , High Velocity Mean
High Mold Temperature:
Low Velocity Mean , High Velocity Mean
Conclusion: A strong interaction exists between injection velocity and mold temperature: increasing injection velocity slightly reduces shrinkage at low temperatures, but substantially increases shrinkage at high temperatures.