Probability - Multiplication Rules and Conditional Probability
Chapter 4: Probability
Section 3: The Multiplication Rules and Conditional Probability
Independent vs Dependent Events
Independent Events:
Definition: Events for which the probability of the first occurring does not affect the probability of the second occurring. This means that the outcome of one event does not change the likelihood of the other event happening. For instance, if an event involves replacement (like drawing a card and putting it back), the trials are typically independent.
Example: Rolling a die and tossing a coin; specifically, rolling a 5 and getting tails. The outcome of the die roll (getting a 5) in no way influences whether the coin lands on heads or tails, and vice versa. Each event occurs in isolation.
Formula for independent events:
P(A \text{ and } B) = P(A) \times P(B)
This formula indicates that to find the probability of both independent events A and B occurring, you simply multiply their individual probabilities. This rule can be easily extended to any number of independent events.
Dependent Events:
Definition: Events for which the outcome or occurrence of the first event affects the outcome or occurrence of the second event, thereby changing the probability. This often happens in situations without replacement, where the sample space for subsequent events changes after the first event occurs.
Example: Picking two cards without replacement; specifically getting an Ace followed by a Jack. If you draw an Ace as the first card and do not replace it, there are now fewer cards in the deck (51 instead of 52) and also one less Ace, which changes the probability of drawing any subsequent card.
Important note:
P(A \text{ and } B)
\ne P(A) \times P(B)
This inequality shows that the simple product rule for independent events cannot be used because the probability of event B is altered by the occurrence of event A. The conditional probability of B given A must be considered.
Multiplication Rule 1
Definition: When two events are independent, the probability of both occurring is given by the product of their individual probabilities. This rule is fundamental for calculating the likelihood of multiple successive events that do not influence each other.
Formula:
P(A \text{ and } B) = P(A) \times P(B)
This rule can be extended to three or more independent events:
P(A1 \text{ and } A2 \text{ and } \dots \text{ and } An) = P(A1) \times P(A2) \times \dots \times P(An)
Each probability P(A_i) remains constant regardless of the outcomes of the other independent events, making the multiplication straightforward.
Examples of Independent Events
Example 4-23: Tossing a Coin and Rolling a Die
Problem: Find the probability of getting a head on the coin and a 4 on the die.
Solution Approach: Identify sample space. The total number of unique outcomes when tossing a coin once and rolling a die once is 2 \times 6 = 12. Each outcome is equally likely.
Sample Space:
H1, H2, H3, H4, H5, H6, T1, T2, T3, T4, T5, T6
The valid outcome for head and 4 is just one occurrence: H4. This corresponds to the combined event of getting a head on the coin and a 4 on the die.
Therefore:
P(\text{head and 4}) = P(\text{head}) \times P(4) = \frac{1}{2} \times \frac{1}{6} = \frac{1}{12} \text{ or approximately } 0.083
The product rule provides a more efficient way to calculate this than listing the entire sample space.
Example 4-24: Drawing a Card
Problem: Probability of getting a queen followed by an ace from a standard 52-card deck, with replacement.
Since the card is replaced after the first draw, the events are independent, and the probabilities remain the same for each draw:
P(\text{queen}) = \frac{4}{52}, P(\text{ace}) = \frac{4}{52}
Because the first card is returned, the composition of the deck (52 cards, 4 queens, 4 aces) is identical for the second draw.
Hence, the combined probability is:
P(\text{queen and ace}) = P(\text{queen}) \times P(\text{ace}) = \frac{4}{52} \times \frac{4}{52} = \frac{16}{2704} \text{ or approximately } 0.006
Example 4-25: Selecting Colored Balls
Problem: An urn contains 3 red, 2 blue, 5 white balls (total 10 balls). Two balls are selected with replacement. Find:
a. Probability of selecting 2 blue balls.
b. Probability of selecting 1 blue and then 1 white.
c. Probability of selecting 1 red and then 1 blue.
a. Probability of drawing a blue ball is P(\text{blue}) = \frac{2}{10}. Since the ball is replaced, the second draw is independent.
P(\text{blue and blue}) = P(\text{blue}) \times P(\text{blue}) = \frac{2}{10} \times \frac{2}{10} = \frac{4}{100} = 0.04
b. Probability of drawing a blue ball is P(\text{blue}) = \frac{2}{10} and a white ball is P(\text{white}) = \frac{5}{10}.
P(\text{blue and white}) = P(\text{blue}) \times P(\text{white}) = \frac{2}{10} \times \frac{5}{10} = \frac{10}{100} = 0.1
c. Probability of drawing a red ball is P(\text{red}) = \frac{3}{10} and a blue ball is P(\text{blue}) = \frac{2}{10}.
P(\text{red and blue}) = P(\text{red}) \times P(\text{blue}) = \frac{3}{10} \times \frac{2}{10} = \frac{6}{100} = 0.06
Multiplication Rule 2
Definition: When two events are dependent, the probability of both occurring is given by the multiplication of the probability of the first event and the conditional probability of the second event given the first. This rule is crucial when the outcome of the first event changes the sample space or conditions for the second event.
Formula:
P(A \text{ and } B) = P(A) \times P(B|A)
Here, P(B|A) represents the probability of event B occurring after event A has already occurred and affected the conditions for B. This makes it distinct from P(B) alone.
Conditional Probability
Definition: The probability that an event B occurs given that event A has already occurred. This modifies the sample space for B to only include outcomes where A has happened, thereby providing a more specific probability.
Mathematical Representation:
P(B|A) = \frac{P(A \text{ and } B)}{P(A)}
This formula clarifies that the conditional probability of B given A is the ratio of the probability of both A and B occurring to the probability of A occurring alone. It effectively shrinks the sample space to only those cases where A is true.
Note: Derived from Multiplication Rule 2 which can be rearranged as follows:
P(A \text{ and } B) = P(A) \times P(B|A)
Dividing both sides by P(A) (assuming P(A) > 0) yields the definition of conditional probability.
Examples of Conditional Probability
Example 4-28: Overqualified Workers
Background: 33% of respondents feel overqualified (O), and of these, 24% are looking for a new job (J). The phrase "of these" explicitly indicates a conditional probability.
Problem: Find the probability that an individual feels overqualified (O) and is looking for a new job (J).
Solution: We are given P(O) = 0.33 and P(J|O) = 0.24 (the probability of looking for a new job given that they feel overqualified).
P(O \text{ and } J) = P(O) \times P(J|O) = (0.33)(0.24)
\rightarrow \text{approximately } 0.079
This means that about 7.9% of all respondents both feel overqualified and are looking for a new job.
Example 4-29: Homeowner's and Automobile Insurance
Background: 53% of city residents have homeowner's insurance (H) from World Wide Insurance, and of these, 27% have automobile insurance (A). Again, "of these" signals a conditional probability.
Problem: What is the probability that a resident has both types of insurance?
Solution: We are given P(H) = 0.53 and P(A|H) = 0.27 (the probability of having automobile insurance given they have homeowner's insurance).
P(H \text{ and } A) = P(H) \times P(A|H) = (0.53)(0.27)
\rightarrow \text{approximately } 0.143 \
This calculation shows that approximately 14.3% of all city residents have both homeowner's and automobile insurance from World Wide Insurance.
Summary of Probability and Examples
Each example demonstrates the application of independent and dependent event probability calculations via basic probability rules, illustrating how to correctly apply Multiplication Rule 1 and Multiplication Rule 2.
The use of tree diagrams can visually represent the relationships and probabilities between events, both independent and dependent. Tree diagrams are particularly useful for sequences of events, as they clearly show how the sample space and probabilities change at each stage.
Probabilities derived from various situations help in understanding how independent and dependent events interact in probability theory, providing a foundational understanding for more complex statistical analyses.
Probability of "At Least"
Complementary probabilities can simplify finding the chance of at least one success across multiple trials. The concept states that the probability of an event occurring is 1 minus the probability of the event not occurring.
Example situation: Finding at least one heart when drawing cards or at least one tails when tossing coins multiple times. Calculating the probability of "at least one" directly can be complex as it involves several scenarios (one success, two successes, etc.).
A fundamental approach is calculating the probability of the complementary event (e.g., all non-successful outcomes) and subtracting from 1. If A is the event "at least one success", then A' (the complement) is the event "no successes" or "all failures". So, P(A) = 1 - P(A'). This method dramatically simplifies calculations for many problems.
Additional Examples
Example 4-36: Tossing Coins:
Problem: Find the probability of getting at least 1 tail when tossing a coin 5 times.
Solution involves calculating the complement of getting all heads. The probability of getting a head on one toss is 1/2. The probability of getting all heads in 5 tosses is (1/2)^5 = 1/32. Therefore, P(\text{at least 1 tail}) = 1 - P(\text{all heads}) = 1 - \frac{1}{32} = \frac{31}{32}.
Example 4-37: Ties:
Background: 3% of ties sold are bow ties. Find the probability that at least 1 out of 4 randomly selected customers purchases a bow tie.
Solution involves calculating the complement of none purchasing a bow tie. If P(\text{bow tie}) = 0.03, then P(\text{not bow tie}) = 1 - 0.03 = 0.97. For 4 independent customers, the probability that none purchase a bow tie is (0.97)^4 \approx 0.8853. Therefore, P(\text{at least 1 bow tie}) = 1 - (0.97)^4 \approx 1 - 0.8853 = 0.1147.
Conditional probability examples include various real-life scenarios, reinforcing critical understanding of events. These examples highlight the practical application of these rules in different contexts, from financial analysis to medical diagnostics.
Closing Thoughts
Understanding these principles forms the basis of more complex probability analysis in diverse fields and applications. These foundational rules are essential for advancing to topics such as Bayes' Theorem, statistical inference, risk assessment, and decision-making under uncertainty, which are critical in fields like engineering, finance, and scientific research.