Study Notes on Discrete and Continuous Random Variables

CHAPTER 15: Discrete and Continuous Random Variables

Discrete Random Variables

• Definition: A discrete random variable takes on a fixed set of possible values and has distinct values.

  • Requirements for probabilities:

  • Every probability p must be a number between 0 and 1

  • The sum of all probabilities must equal 1

Tossing a Coin Example

• Sample Space: For tossing a coin three times, the possible outcomes are combinations of heads (H) and tails (T).

• Total Number of Outcomes: The total number of outcomes when tossing a coin 3 times is:

  • $2^3 = 8$

Probability Distribution of Coin Tosses

• Let X be the random variable representing the number of heads in 3 tosses:

  • Symbols and meaning:

  • $P(X = 0)$: Probability of getting 0 heads

  • $P(X = 1)$: Probability of getting 1 head

  • $P(X = 2)$: Probability of getting 2 heads

  • $P(X = 3)$: Probability of getting 3 heads

• Entries for Probability Distribution:

  • For probabilities:

    • When calculated, each probability $P(X = k)$ can be filled in for k = 0, 1, 2, 3.

Mean/Expected Value of Discrete Random Variables

• Mean/Expected Value Formula: The mean (expected value) of a discrete random variable X is calculated as:

  • $E(X) = ext{mean} = rac{ ext{Sum of } X imes P(X)}{ ext{Total Outcomes}}$

• Example Using Grade Distribution: In Statistics 101, a student’s grades were as follows:

  • A: 26% (4 points)

  • B: 42% (3 points)

  • C: 20% (2 points)

  • D: 10% (1 point)

  • F: 2% (0 points)

  • Grade Distribution Table:
    | Grade | Value | Probability |
    |-------|-------|--------------|
    | A | 4 | 0.26 |
    | B | 3 | 0.42 |
    | C | 2 | 0.20 |
    | D | 1 | 0.10 |
    | F | 0 | 0.02 |

• To find the expected value, calculate: $E(X) = (4)(0.26) + (3)(0.42) + (2)(0.20) + (1)(0.10) + (0)(0.02)$

Variance and Standard Deviation of Discrete Random Variables

• Variance/Standard Deviation:

  • The variance of a random variable X is a measure of how spread out its values are. Formula:

  • $ext{Var}(X) = ext{E}[(X - ext{mean})^2] = ext{standard deviation}^2$

  • Final formulas: For a random variable, standard deviation is given as:

  • $ext{std dev} = ext{Var}(X)^{0.5}$

Continuous Random Variables

• Definition: A continuous random variable can take on all possible values in an interval of numbers; it has an associated probability density function.

• Probability Distribution: The probability is described by a density curve, and the probability of any event is the area under the curve for the values under consideration:

  • Area under density curve: Represents the probability.

Differences between Discrete and Continuous Random Variables

• Continuous Random Variables:

  • Equal to inequalities do not matter. For example, $P(X = 5) = 0$

  • However, P(X < 5) is equivalent to $P(X ≤ 5)$.

• Discrete Random Variables:

  • Equal to inequalities matter. For example, P(X < 5) differs from $P(X ≤ 5)$.

  • Often presented in tables or histograms.

Combining Random Variables

• Expected Value and Variance: If X and Y are independent random variables:

  • $E(X + Y) = E(X) + E(Y)$

  • $E(X - Y) = E(X) - E(Y)$

  • $ext{Var}(X + Y) = ext{Var}(X) + ext{Var}(Y)$

  • $ext{Var}(X - Y) = ext{Var}(X) + ext{Var}(Y)$

Binomial Distribution

• Definition: A binomial distribution describes the probability of a random variable that counts the number of successes in a fixed number of Bernoulli trials.

• Parameters: Defined by two parameters:

  • $n$: Number of trials

  • $p$: Probability of success

• Denoted as: Binom(n, p)

Criteria for Binomial Model

1. Each trial has two outcomes, usually termed as success and failure.

2. The number of trials n is fixed.

3. Each trial is independent, meaning the outcome of one trial does not affect the others.

4. The probability of success p is constant for each trial.

Examples of Binomial Random Variables

• Tossing 20 coins and counting heads, or choosing 5 cards from a deck and counting hearts.

• Calculating probabilities: Using
  $P(X = k) = \binom{n}{k} p^k (1-p)^{n-k}$

Geometric Random Variables

• Definition: A geometric model counts the number of trials until the first success occurs.

• Parameter: Denoted as Geom(p), where p is the probability of success.

• Formula: If X is the number of trials until the first success:

  • $P(X = k) = (1-p)^{k-1} p$

Examples and Applications

• Example calculations for the probability it takes several trials to achieve a specific condition (like pulling a red M&M).

Conclusion

• Relationship Between Models: Both binomial and geometric distributions allow for modeling different types of random variables under certain conditions, with respective distinctions in definitions and applications. These concepts are critical for statistical analysis and probability assessment in various fields.