Use of Statistics in Data Science

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/22

flashcard set

Earn XP

Description and Tags

Flashcards covering key statistical concepts in data science, including subsetting methods, two-way frequency tables, mean, median, mean absolute deviation (MAD), and standard deviation.

23 Terms

1
New cards

What is a subset in data analytics and data science?

A subset is a division of a small set of data taken from a larger data set for analysis, used as an indexing feature to select and filter variables and observations.

2
New cards

What are the three methods of subsetting data discussed in the chapter?

  1. Row-based subsetting
  2. Column-based subsetting
  3. Data-based subsetting
3
New cards

How is row-based subsetting performed?

Row-based subsetting is performed by taking specific rows from the top or bottom of a data table.

4
New cards

How is column-based subsetting performed?

Column-based subsetting is performed by selecting specific columns from a dataset when not all columns are necessary to conduct the analysis.

5
New cards

What is data-based subsetting?

Data-based subsetting is the process of subsetting data based on specific data criteria or values (such as filtering for only specific marked or colored rows).

6
New cards

What is a two-way frequency table?

A two-way frequency table is a statistical table that demonstrates the observed number or frequency for two variables, where rows represent one category and columns represent the other.

7
New cards

What are the four key structural features of a two-way table?

  1. Categories are in the left column and top row.
  2. The counts are placed in the center of the table.
  3. The totals are at the end of each row and column.
  4. A sum of all counts (grand total) is placed at the bottom right.
8
New cards

How does a two-way relative frequency table differ from a standard two-way frequency table?

A two-way relative frequency table displays percentages of data points fitting each category instead of raw numerical counts.

9
New cards

Why are two-way relative frequency tables useful when comparing datasets?

They are helpful when there are different sample sizes in a dataset because percentages make it easier to compare preferences.

10
New cards

What is the meaning of the mean in data science, and how are values weighted?

The mean (simple average) is a measure of central tendency representing the value around which the entire data is spread out; all values used in calculating the average are weighted equally.

11
New cards

How is the mean of a data set calculated?

The mean is calculated by adding up all the values in the data set and dividing the sum by the total number of values present.

12
New cards

What is the median of a dataset?

The median is a measure of central tendency representing the exact middle point of a sorted dataset (ordered in ascending or descending order).

13
New cards

How is the median calculated when a dataset contains an even number of records?

When there is an even number of records, there are two middle points, so the median is calculated by finding the average of those two middle values.

14
New cards
<p>What statistical scenario is illustrated here, and why is median preferred over mean in this situation?</p>

What statistical scenario is illustrated here, and why is median preferred over mean in this situation?

It illustrates how an irregular value or outlier (error value of 210210) greatly distorts the mean (157.4157.4), making the median (147147) a more effective and accurate measure of central tendency.

15
New cards

What is Mean Absolute Deviation (MAD)?

Mean Absolute Deviation (MAD) is the average of how far away all values in a dataset are from the mean, providing an understanding of the variability or scatter of the data.

16
New cards

What are the three steps to calculate the Mean Absolute Deviation (MAD)?

  1. Calculate the mean of the dataset.
  2. Calculate the distance of each data point from the mean, taking the absolute value (ignoring negative signs, e.g., ∣−2∣=2|-2| = 2).
  3. Calculate the mean of those distances.
17
New cards

What is Standard Deviation?

Standard Deviation is a measure of how spread out the numbers are around the mean or average.

18
New cards
<p>What graphical representation is shown below?</p>

What graphical representation is shown below?

The Standard Deviation Curve.

19
New cards

What are the five steps to calculate standard deviation?

  1. Calculate the mean by adding up all data pieces and dividing by the total number of pieces.
  2. Subtract the mean from every value.
  3. Square each of the differences.
  4. Calculate the average of the squared differences to get the variance.
  5. Find the square root of the variance.
20
New cards

What is variance in the context of standard deviation?

Variance is the average of the squared differences between each individual data value and the mean.

21
New cards

What are three real-life implementations of standard deviation listed in the text?

  1. Grading Tests: determining whether students perform at the same level or show high variation.
  2. Survey Results: assessing response reliability to predict how larger populations will answer.
  3. Weather Forecasting: analyzing forecasted low temperatures across cities, where a low standard deviation indicates a reliable forecast.
22
New cards

In the classroom snap cube activity, what statistical concept does the leveled 'equal share' represent?

The equal share represents the mean of the distribution.

23
New cards

In the snap cube leveling activity, what does the 'number of steps to equal' describe?

It describes the variability of a distribution in relation to its mean; fewer steps indicate that the distribution has less variability and is closer to being equal.