Comprehensive Study Notes on Probability Terminology, Rules, and Events
Fundamental Terminology and Concepts of Probability
Probability:
Defined as a measure associated with the degree of certainty regarding the outcomes of a particular experiment or activity.
Quantified as a number between and , inclusive (that is, ).
indicates that event can never happen.
indicates that event always happens.
indicates that event is equally likely to occur or not to occur.
The probability of any outcome represents the long-term relative frequency of that outcome.
Experiment and Chance Experiment:
An experiment is a planned operation carried out under controlled conditions.
A chance experiment occurs when the result of the experiment is not predetermined.
Example: Flipping one fair coin twice.
Outcome and Sample Space:
An outcome is a specific result of an experiment.
The sample space (denoted by the uppercase letter ) is the set of all possible outcomes of an experiment.
Three standard methods to represent a sample space are:
Listing all possible outcomes explicitly (e.g., flipping one fair coin yields , where and ).
Constructing a tree diagram.
Constructing a Venn diagram.
Events:
An event is any combination or subset of outcomes within a sample space.
Represented using uppercase letters such as , , , etc.
The probability of event occurring is denoted .
Equally Likely Outcomes:
Outcomes are considered equally likely if each outcome in the sample space has an identical probability of occurring.
Examples of equally likely outcomes:
Tossing a fair, six-sided die: each face () is equally likely.
Tossing a fair coin: Head () and Tail () are equally likely.
Guessing randomly on a true/false exam question: selecting a correct answer or an incorrect answer is equally likely.
Calculation Formula for Equally Likely Outcomes:
Example: Tossing a fair dime and a fair nickel yields (total outcomes). Let (). Thus, .
Example: Rolling one fair six-sided die with faces . Let (). Thus, .
Law of Large Numbers:
States that as the number of repetitions (trials) of an experiment increases, the empirical (observed) relative frequency of an event approaches its theoretical probability.
Although short-term outcomes do not follow a fixed pattern or order, the long-term relative frequency stabilizes near the theoretical value.
Empirical refers to observed experimental data.
Fair vs. Biased Experiments:
Outcomes are not always equally likely; coins or dice can be unfair or biased.
European Euro Coin Study: Two European math professors had statistics students test the Belgian 1 Euro coin across trials, resulting in heads of the time and tails of the time, suggesting coin bias.
Standard vs. Casino Dice:
Standard home dice have small holes carved out and painted for spots, creating slight weight differences across faces that may cause bias.
Casino dice are manufactured with flat faces where holes are filled completely with paint of the exact same density as the die material to maintain strict fairness.
Operations on Events and Set Notation
"OR" Event (Union):
An outcome is in the event if the outcome is in , in , or in both and .
Represented using union notation: .
Example: Let and . Then . Note that shared elements ( and ) are listed only once.
"AND" Event (Intersection):
An outcome is in the event if the outcome is in both and simultaneously.
Represented using intersection notation: .
Example: Let and . Then .
Complement of an Event:
The complement of event is denoted (read "A prime").
consists of all outcomes in the sample space that are NOT in .
Fundamental property of complements: .
Example: Let and . Then . Here , , and .
Conditional Probability:
Written as and read as "the probability of given ".
Represents the probability that event will occur given that event has already occurred.
A condition reduces the sample space from to .
Formula:
, provided
Example: Toss one fair six-sided die (). Let () and ().
Using reduced sample space : outcome () satisfies , out of total outcomes in . Thus, .
Using formula: , .
Independent and Mutually Exclusive Events
Independent Events:
Two events and are independent if knowing that one occurred does not alter the probability of the other occurring.
Two events and are independent if and only if at least one of the following equivalent conditions holds:
Showing any one of these three conditions is sufficient to prove independence.
If two events fail these conditions, they are dependent events.
Default rule: If it is unknown whether events are independent or dependent, assume they are dependent until proven otherwise.
Sampling Methods and Independence:
Sampling With Replacement:
Each selected member of a population is replaced before the next draw.
Members can be chosen more than once.
Draws are independent events because population counts and probabilities remain constant across draws.
Sampling Without Replacement:
Each selected member is set aside and cannot be picked again.
Members can be chosen at most once.
Draws are dependent events because the total population size and available options change after each draw.
Mutually Exclusive Events:
Events and are mutually exclusive if they cannot occur at the same time.
Mutually exclusive events share no outcomes in common: .
Mathematical Definition:
Default rule: Assume events are NOT mutually exclusive until proven otherwise.
Critical Distinction: "Independent" and "Mutually Exclusive" are different concepts. Mutually exclusive events with non-zero probabilities can never be independent, because if one occurs, the chance of the other occurring drops to zero.
The Two Basic Rules of Probability
The Multiplication Rule:
For any two events and defined on a sample space:
Equivalently:
Rewritten for conditional probability:
Special Case for Independent Events:
If and are independent, then , simplifying the rule to:
The Addition Rule:
For any two events and defined on a sample space:
Special Case for Mutually Exclusive Events:
If and are mutually exclusive, then , simplifying the rule to:
Detailed Worked Examples and Practice Problems
Example 3.1 & Try It 3.1 (Whole Number Sample Spaces):
Example 3.1:
Sample space ().
Let ().
Let ().
Probabilities: , .
Intersections & Unions: (), ().
Values: , .
Complement: , . Sum .
Conditionals: ; . Probabilities are not equal.
Try It 3.1:
().
().
().
Probabilities: , .
() .
has elements .
Complement () .
Conditionals: ; . Not equal.
Example 3.2 & Try It 3.2 (Die Rolls & Integer Selection):
Example 3.2 (Fair Six-Sided Die):
.
.
A = \text{even} = \{2, 4, 6\} \implies P(A) = \frac{3}{6} = 0.5$.\n - B = \text{less than four} = {1, 2, 3} \implies P(B) = \frac{3}{6} = 0.5$.
Complement A' = \{1, 3, 5\} \implies P(A') = 0.5$.\n - Conditionals: P(A|B) = \frac{1}{3}P(B|A) = \frac{1}{3}.\n - A \cap B = {2} \implies P(A \cap B) = \frac{1}{6}$.
A \cup B = \{1, 2, 3, 4, 6\} \implies P(A \cup B) = \frac{5}{6}$.\n - A \cup B' = {2, 4, 5, 6} \implies P(A \cup B') = \frac{4}{6} = \frac{2}{3}$.
N = \text{prime} = \{2, 3, 5\} \implies P(N) = \frac{3}{6} = 0.5$.\n - I = \text{seven} = \emptyset \implies P(I) = 0$.
Try It 3.2 (Selecting Number 1 to 10):
.
F = \{5\} \implies P(F) = 0.1$.\n - A = \text{more than 6} = {7, 8, 9, 10} \implies P(A) = 0.4$.
B = \text{odd} = \{1, 3, 5, 7, 9\} \implies P(B) = 0.5$.\n - B' = {2, 4, 6, 8, 10} \implies P(B') = 0.5$.
out of B \implies P(A|B) = \frac{2}{5} = 0.4$.\n - B|A = {7, 9}A \implies P(B|A) = \frac{2}{4} = 0.5$.
A \cup B = \{1, 3, 5, 7, 8, 9, 10\} \implies P(A \cup B) = 0.7$.\n - A' \cup B = {1, 2, 3, 4, 5, 6, 7, 9} \implies P(A' \cup B) = 0.8$.
P = \text{composite} = \{4, 6, 8, 9, 10\} \implies P(P) = 0.5$.\n - M = \text{multiple of 3} = {3, 6, 9} \implies P(M) = 0.3$.
Example 3.3 & Try It 3.3 (Contingency Table Analysis):
Example 3.3 (Handedness and Sex at Birth, Total ):
Data Table:
Males (): Right-handed () = , Left-handed () = (Total ).
Females (): Right-handed () = , Left-handed () = (Total ).
Column Totals: , .
Results:
Try It 3.3 (Beverage Preference and Gender, Total ):
Data Table:
Men (): Tea () = , Coffee () = (Total ).
Women (): Tea () = , Coffee () = (Total ).
Column Totals: , .
Results:
, , ,
,
Examples 3.4 & 3.5 / Try Its 3.4 & 3.5 (Card Sampling Protocols):
Deck structure: total cards, suits (Clubs , Diamonds , Hearts , Spades ), ranks per suit ( to , , , ).
Example 3.4:
With replacement: Sequence allows duplicate .
Without replacement: Sequence contains no duplicates.
Try It 3.4:
Sequence must be with replacement due to duplicate card.
Sequence could occur under either sampling method.
Example 3.5:
Sequence without replacing cards = sampling without replacement.
Sequence replacing cards each time = sampling with replacement.
Try It 3.5:
Outcome : Possible both with and without replacement.
Outcome : Possible only with replacement ( repeated).
Outcome : Possible both with and without replacement.
Examples 3.6 & 3.7 / Try Its 3.6 & 3.7 (Coin Flips, Cards, and Balls):
Example 3.6 (Flipping Two Fair Coins):
.
.
. Here .
( mutually exclusive).
D = \text{more than 1 tail} = \{TT\} \implies P(D) = \frac{1}{4}$.\n - E = \text{head on first flip} = {HT, HH} \implies P(E) = \frac{2}{4} = 0.5$.
F = \text{at least 1 tail} = \{HT, TH, TT\} \implies P(F) = \frac{3}{4}$.\n - **Try It 3.6 (Two Cards With Replacement)**:\n - Find probability of at least one black card.\n - P(\text{both red}) = 0.5 \times 0.5 = 0.25$.
P(\text{at least 1 black}) = 1 - P(\text{both red}) = 1 - 0.25 = 0.75$.\n - **Example 3.7**:\n - F = \text{at most 1 tail} = {HH, HT, TH} \implies P(F) = 0.75$.
G = \text{two same faces} = \{HH, TT\} \implies P(G) = 0.5$.\n - H = \text{head on first flip} = {HH, HT} \implies P(H) = 0.5$.
are not mutually exclusive.
are mutually exclusive.
Try It 3.7 (Box with 1 White, 1 Red Ball, Sampling With Replacement):
.
F = \text{white twice} = \{WW\} \implies P(F) = 0.25$.\n - G = \text{different colors} = {WR, RW} \implies P(G) = 0.5$.
H = \text{white on first pick} = \{WW, WR\} \implies P(H) = 0.5$.\n - F \cap G = \emptyset \implies P(F \cap G) = 0 \implies F, G are mutually exclusive.\n - G \cap H = {WR} \implies P(G \cap H) = 0.25 e 0 \implies G, H are not mutually exclusive.\n\n- **Examples 3.8 & 3.9 / Try Its 3.8 & 3.9 (Die, Language, Math/Science, Marbles)**:\n - **Example 3.8 (Single Die Roll)**:\n - S = {1, 2, 3, 4, 5, 6}A = {1, 3, 5}B = {2, 4, 6}.\n - C = \text{odd } > 2 = {3, 5}D = \text{even } < 5 = {2, 4}P(C \cap D) = 0 \implies C, D mutually exclusive.\n - E = \text{faces } < 5 = {1, 2, 3, 4}CEC \cap E = {3, 5} \implies P(C \cap E) = \frac{2}{6} e 0$.
.
Try It 3.8 (Language Learning):
, , P(A \cap B) = 0.08$.\n - Test independence: P(A)P(B) = 0.4 \times 0.2 = 0.08 = P(A \cap B)AB are independent.\n - **Example 3.9 (Math and Science Classes)**:\n - P(G) = 0.6P(H) = 0.5P(G \cap H) = 0.3$.
P(G|H) = \frac{P(G \cap H)}{P(H)} = \frac{0.3}{0.5} = 0.6 = P(G)$.\n - P(G)P(H) = 0.6 \times 0.5 = 0.3 = P(G \cap H)$.
Thus, and are independent.
Try It 3.9 (Red and Green Marbles in a Bag):
Bag contains red marbles () and green marbles (). Total N = 10$.\n - Sample space S = {R1, R2, R3, R4, R5, R6, G1, G2, G3, G4}.\n - Event G = \text{green marble}O = \text{odd-numbered marble}.\n - Outcomes in G \cap O = {G1, G3}.\n - P(G \cap O) = \frac{2}{10} = 0.2$.
Example 3.10 & Try It 3.10 (Class Enrolments & Library Checks):
Example 3.10:
, , , P(C \cap D) = 0.225$.\n - a. Independent? Yes, because P(C|D) = 0.75 = P(C)P(C)P(D) = 0.75 \times 0.3 = 0.225 = P(C \cap D)).\n - b. Mutually exclusive? No, because P(C \cap D) = 0.225 e 0$.
c. P(D|C) = \frac{P(C \cap D)}{P(C)} = \frac{0.225}{0.75} = 0.3$.\n - **Try It 3.10**:\n - P(B) = 0.40P(D) = 0.30P(B \cap D) = 0.20$.
a. P(B|D) = \frac{0.20}{0.30} = \frac{2}{3} \approx 0.6667$.\n - b. P(D|B) = \frac{0.20}{0.40} = 0.50$.
c. Independent? No, because .
d. Mutually exclusive? No, because P(B \cap D) = 0.20 \ne 0$.\n\n- **Example 3.11 & Try It 3.11 (Numbered Cards & Arena Fans)**:\n - **Example 3.11**:\n - Box with 3R1, R2, R35B1, B2, B3, B4, B5N = 8$.
, , (mutually exclusive).
Even cards E = \{R2, B2, B4\} \implies P(E) = \frac{3}{8}$.\n - Conditionals: P(E|B) = \frac{2}{5}P(B|E) = \frac{2}{3}$.
Let G = \text{cards } > 3 = \{B4, B5\} \implies P(G) = \frac{2}{8} = \frac{1}{4}$.\n - Let H = \text{blue cards between 1 and 4} = {B1, B2, B3, B4}$.
. Since , and are independent.
Try It 3.11:
P(\text{home}) = 0.70 \implies P(\text{away}) = P(A) = 0.30$.\n - P(\text{blue}) = P(B) = 0.25$.
Given: , P(B|A) = 0.67$.\n - Independent? No, because P(B|A) = 0.67 e P(B) = 0.25$.
Mutually exclusive? No, because P(B \cap A) = 0.20 \ne 0$.\n\n- **Example 3.12 & Try It 3.12 (Class Hair Length & Route Selection)**:\n - **Example 3.12**:\n - Given: P(W) = 0.60P(L) = 0.50P(W \cap L) = 0.45P(L|W) = 0.75$.
Independent? No, because P(L|W) = 0.75 \ne P(L) = 0.50$.\n - **Try It 3.12**:\n - Routes IFP(I) = 0.44P(F) = 0.56P(I \cap F) = 0$.
P(I \cup F) = P(I) + P(F) - P(I \cap F) = 0.44 + 0.56 - 0 = 1.00$.\n\n- **Example 3.13 & Try It 3.13 (Coin/Die Combination & Ball Draw)**:\n - **Example 3.13**:\n - Coin outcomes = 2H, T61, 2, 3, 4, 5, 6).\n - Total sample space size = 2 \times 6 = 12.\n - Outcomes: {H1, H2, H3, H4, H5, H6, T1, T2, T3, T4, T5, T6}.\n - A = \text{heads followed by even} = {H2, H4, H6} \implies P(A) = \frac{3}{12} = 0.25$.
B = \text{heads followed by 3} = \{H3\} \implies P(B) = \frac{1}{12}$.\n - Mutually exclusive? Yes, P(A \cap B) = 0$.
Independent? No, P(A)P(B) = \frac{1}{4} \times \frac{1}{12} = \frac{1}{48} \ne P(A \cap B) = 0$.\n - **Try It 3.13**:\n - Box with 112 draws).\n - T = \text{white twice} = {WW}$, F = \text{white first} = \{WW, WR\}$, S = \text{white second} = {WW, RW}$.
a. P(T) = \frac{1}{4} = 0.25$.\n - b. P(T|F) = \frac{1/4}{2/4} = 0.50$.
c. and independent? No, P(T|F) = 0.50 \ne P(T) = 0.25$.\n - d. FSF \cap S = {WW} \implies P(F \cap S) = 0.25 e 0$.
e. and independent? Yes, .
Example 3.14 & Try It 3.14 (Vacations and Car Purchases):
Example 3.14:
, . , , P(A \cap B) = 0$.\n - P(A \cup B) = 0.60 + 0.35 = 0.95$.
Probability of no vacation = 1 - 0.95 = 0.05$.\n - **Try It 3.14**:\n - P(A) = 0.25P(B) = 0.65P(A \cap B) = 0$.
P(A \cap B) = 0$.\n - P(A \cup B) = 0.25 + 0.65 = 0.90$.
Example 3.15 & Try It 3.15 (Sports Performance Probabilities):
Example 3.15 (Soccer Goals):
, , P(B|A) = 0.90$.\n - a. P(A \cap B) = P(A)P(B|A) = 0.65 \times 0.90 = 0.585$.
b. P(A \cup B) = P(A) + P(B) - P(A \cap B) = 0.65 + 0.65 - 0.585 = 0.715$.\n - c. Independent? No, P(B|A) = 0.90 e P(B) = 0.65$.
d. Mutually exclusive? No, P(A \cap B) = 0.585 \ne 0$.\n - **Try It 3.15 (Basketball Free Throws)**:\n - P(C) = 0.75P(D) = 0.75P(D|C) = 0.85$.
P(\text{makes both}) = P(C \cap D) = P(C)P(D|C) = 0.75 \times 0.85 = 0.6375$.\n\n- **Example 3.16 & Try It 3.16 (Swim Team and High School Senior Counts)**:\n - **Example 3.16 (Swim Team, Total N = 150)**:\n - Groups: Advanced (A = 75I = 47N = 150 - 75 - 47 = 28).\n - Practice 4x/week (P403010P = 80$.
a. P(N) = \frac{28}{150} \approx 0.1867$.\n - b. P(P) = \frac{80}{150} = \frac{8}{15} \approx 0.5333$.
c. P(A \cap P) = \frac{40}{150} = \frac{4}{15} \approx 0.2667$.\n - d. P(A \cap I) = 0. Mutually exclusive because a swimmer cannot belong to two skill levels simultaneously.\n - e. Independent? P(N) = \frac{28}{150} \approx 0.1867P(N|P) = \frac{10}{80} = 0.125P(N|P) e P(N), they are dependent.\n - **Try It 3.16 (High School Seniors, Total N = 200)**:\n - Destinations: College = 14040200 - 140 - 40 = 20.\n - Sports participants: College sports = 5030585$.
Probability senior is taking a gap year: P(\text{Gap Year}) = \frac{20}{200} = 0.10$.\n\n- **Example 3.17 & Try It 3.17 (Course Enrollments & Library Items)**:\n - **Example 3.17 (Felicity at Modesto JC)**:\n - P(M) = 0.20P(S) = 0.65P(M|S) = 0.25$.
a. P(M \cap S) = P(M|S)P(S) = 0.25 \times 0.65 = 0.1625$.\n - b. P(M \cup S) = P(M) + P(S) - P(M \cap S) = 0.20 + 0.65 - 0.1625 = 0.6875$.
c. Independent? No, P(M|S) = 0.25 \ne P(M) = 0.20$.\n - d. Mutually exclusive? No, P(M \cap S) = 0.1625 e 0$.
Try It 3.17 (Library Book and DVD Borrowing):
, , P(D|B) = 0.50$.\n - a. P(B \cap D) = P(D|B)P(B) = 0.50 \times 0.40 = 0.20$.
b. P(B \cup D) = P(B) + P(D) - P(B \cap D) = 0.40 + 0.30 - 0.20 = 0.50$.\n\n- **Example 3.18, 3.19 & Try Its 3.18, 3.19 (Medical Screening & Senior Probabilities)**:\n - **Example 3.18 (Breast Cancer Screening)**:\n - Given parameters: P(B) = \frac{1}{7} \approx 0.1429P(N|B) = 0.02P(N) = 0.85$.
a. , P(N) = 0.85$.\n - b. P(N|B) = 0.02$.
c. P(B \cap N) = P(N|B)P(B) = 0.02 \times \frac{1}{7} \approx 0.002857$.\n - d. P(B \cup N) = P(B) + P(N) - P(B \cap N) = \frac{1}{7} + 0.85 - 0.002857 \approx 0.9900$.
e. Independent? No, P(N|B) = 0.02 \ne P(N) = 0.85$.\n - f. Mutually exclusive? No, P(B \cap N) \approx 0.002857 e 0$.
Try It 3.18 (High School Senior College and Sports Probability):
Total seniors = , Seniors going to college and playing sports = 50$.\n - P(\text{College } \cap \text{ Sports}) = \frac{50}{200} = 0.25$.
Example 3.19 (Follow-up to Example 3.18, ):
a. P(P|B) = 1 - P(N|B) = 1 - 0.02 = 0.98$.\n - b. P(B \cap P) = P(P|B)P(B) = 0.98 \times \frac{1}{7} \approx 0.1400$.
c. P(B') = 1 - P(B) = 1 - \frac{1}{7} = \frac{6}{7} \approx 0.8571$.\n - d. P(P) = 1 - P(N) = 1 - 0.85 = 0.15$.
Try It 3.19 (Library Complementary and Joint Probabilities):
Given: , , P(D|B) = 0.50$.\n - a. P(B') = 1 - P(B) = 1 - 0.40 = 0.60$.
b. P(D \cap B) = P(D|B)P(B) = 0.50 \times 0.40 = 0.20$.\n - c. P(B|D) = \frac{P(D \cap B)}{P(D)} = \frac{0.20}{0.30} = \frac{2}{3} \approx 0.6667$.
d. P(D \cap B') = P(D) - P(D \cap B) = 0.30 - 0.20 = 0.10$.\n - e. P(D|B') = \frac{P(D \cap B')}{P(B')} = \frac{0.10}{0.60} = \frac{1}{6} \approx 0.1667$.