Statistics and Probability Chapter 1

What is the formal definition of Statistics as a science?

The science of collecting, organizing, analyzing, interpreting, and presenting data to support informed decision-making.

Statistics used to summarize and describe the features of a dataset without drawing conclusions beyond that data is known as _____ statistics.

Descriptive

What is the primary goal of Inferential Statistics?

To draw conclusions or generalizations about a population based on information from a sample.

The complete set of all individuals, objects, or measurements of interest is called the _____.

Population

Term: Sample

Definition: A subset or part of the population selected for analysis.

A numerical summary of a population (such as the population mean \mu) is called a _____.

Parameter

A numerical summary of a sample (such as the sample mean bar{x}) is called a _____.

Statistic

In the context of knowledge, why is a parameter considered 'fixed but unknown'?

It is a constant value for the population at a given time, but its exact value is rarely known because we cannot measure the entire population.

How does the knowledge of a statistic differ from that of a parameter?

A statistic is known and calculated directly from sample data, whereas a parameter is often an unknown target value.

What level of measurement classifies data into mutually exclusive categories with no logical order or ranking?

Nominal

Which level of measurement applies to data that can be categorized and ranked, but where the differences between ranks are not meaningful?

Ordinal

Data where the differences between values are meaningful, but there is no 'true zero' point, belongs to the _____ level of measurement.

Interval

What distinguishes the Ratio level of measurement from the Interval level?

The Ratio level has a 'true zero' point, meaning a value of zero indicates the complete absence of the characteristic.

Variables that can only take on specific, isolated values (often counts) are classified as _____ variables.

Discrete

Variables that can take on any value within a given range, typically resulting from measurements, are called _____ variables.

Continuous

Data collected directly by the researcher for a specific purpose is called _____ data.

Primary

Data previously collected by others for a different purpose is called _____ data.

Secondary

Sampling bias that occurs when a researcher selects the most easily accessible members of a population is called _____ bias.

Convenience

What is Voluntary Response bias?

Bias that occurs when sample members self-select into a study, often resulting in overrepresentation of people with strong opinions.

Bias that occurs when a significant portion of the sampled individuals do not participate is called _____ bias.

Nonresponse

The sampling method where every member of the population has an equal and independent chance of being selected is _____.

Simple Random Sampling

What is Systematic Sampling?

A method where every k-th member of a population is selected from a starting point determined at random.

The arithmetic average of a dataset is called the _____.

Mean

Term: Median

Definition: The middle value of a dataset when the observations are arranged in order of magnitude.

The value that appears with the highest frequency in a dataset is the _____.

Mode

Which measure of central tendency is described as being 'robust' or resistant to outliers?

Median

Why is the mean more sensitive to extreme values than the median?

The mean incorporates the numerical value of every observation in the dataset, whereas the median only depends on the middle position.

The difference between the maximum and minimum values in a dataset is the _____.

Range

What does the Sample Variance (s^2) measure?

The average of the squared deviations of the observations from the sample mean.

Formula: Sample Variance (s^2)

s^2 = \frac{\sum (x_i - \bar{x})^2}{n - 1}

The positive square root of the variance is known as the _____.

Standard Deviation

Why is the Standard Deviation preferred over Variance for reporting on specification sheets?

It is expressed in the same units as the original data, making it more interpretable.

The spread of the middle 50% of the data is measured by the _____.

Interquartile Range (IQR)

How is the Interquartile Range (IQR) calculated?

IQR = Q3 - Q1

According to the 1.5 x IQR rule, an observation is a suspected outlier if it falls more than 1.5 IQRs below _____ or above _____.

Q1; Q3

In a distribution that is Right-Skewed (positively skewed), the mean is typically _____ than the median.

Greater

In a distribution that is Left-Skewed (negatively skewed), the mean is typically _____ than the median.

Less

Which chart type is best suited for showing the distribution of a single continuous numerical variable?

Histogram

What does a Scatter Plot investigate?

The relationship or correlation between two numerical variables.

Which visualization uses a five-number summary (Min, Q1, Median, Q3, Max) to display data distribution and outliers?

Box Plot

A _____ chart is most effective for displaying trends or changes in a variable over a continuous period of time.

Line

When comparing frequencies of different categorical groups, which chart type is most appropriate?

Bar Chart

In a histogram, what is the trade-off of using a bin width that is too large?

It leads to information loss and hides important patterns in the data distribution.

In Python's pandas library, which method provides a summary of central tendency, dispersion, and shape of a DataFrame's distribution?

df.describe()

When using `df.describe()` on a categorical (nominal) column in pandas, what specific information is returned?

The count of non-null values, number of unique categories, the most frequent category (top), and its frequency.

Which Python library is primarily used for data manipulation and analysis using DataFrames?

pandas

Which Python library is the standard for creating static, animated, and interactive visualizations?

Matplotlib

What is the primary purpose of the NumPy library in Python?

Performing efficient numerical computations and handling multi-dimensional arrays.

Python function: `plt.hist(data)`

Purpose: To generate and plot a histogram of the provided data.

In the standard Matplotlib plotting workflow, which command is used to actually display the generated plot on the screen?

plt.show()

Why can Variance never be a negative number?

It is calculated by averaging the squares of the deviations, and squares of real numbers are always non-negative.

What does a Variance of exactly 0 imply about a dataset?

All observations in the dataset are identical and there is no variability.

Which level of measurement is appropriate for 'ZIP/postal codes'?

Nominal (they are labels, not quantities).

Which level of measurement is appropriate for 'Exam letter grades (A, B, C, D, F)'?

Ordinal.

Under what condition is the mean approximately equal to the median?

When the distribution is symmetric (or bell-shaped).

In a Box Plot, the vertical lines extending from the box to the minimum and maximum values are called _____.

Whiskers

What does the 'top' row represent in the output of `df.describe()` for a pandas categorical column?

The most common value (the mode) in that column.

Python code: `df['ColumnName'].mean()`

Purpose: To calculate the arithmetic mean of a specific column in a pandas DataFrame.

Which level of measurement is appropriate for 'Engine temperature recorded in Celsius'?

Interval (Celsius has a relative, not absolute, zero).

What sampling bias is introduced if a safety survey only interviews day-shift workers at a 24-hour factory?

Selection bias (or coverage bias), as it systematically excludes a segment of the population.