Definitive Guide to Probability Theory: Fundamentals, Addition Rules, Complements, and Applied Models

Fundamentals of Probability

• Experiment: Any process that allows researchers to obtain observations. Standard examples include flipping a coin, rolling a die, or drawing a card from a standard deck.

• Sample Space: The complete set or list of all possible outcomes in a given experiment.

• Probability: The mathematical likelihood that one or more specific outcomes in the sample space occur.

• Probability Notation and Symbols:

  • $P$ denotes a probability.
  • Sample spaces are denoted using set notation, such as $\text{Coin Flip} = \{H, T\}$ or $\text{Die Roll} = \{1, 2, 3, 4, 5, 6\}$.
  • Capital letters $A, B, C, \dots$ denote specific outcomes or events.
  • $n$ denotes the total number of possible outcomes or the total number of repeated trials.
  • $P(A)$ denotes the probability that event $A$ occurs.

• Fundamental Probability Formula:   $P(A) = \frac{\text{Number of times event } A \text{ occurs}}{\text{Total number of times trial was repeated}}$

• Probability Range Rules:   $0 \le P(A) \le 1$

  • A probability of $0$ ($P(A) = 0$) indicates that an event is impossible to occur.
  • A probability of $1$ ($P(A) = 1$) indicates that an event is certain to occur.
  • An event is categorized as rare or unusual if its probability is strictly less than $0.05$ ($P(A) < 0.05$).

• Law of Large Numbers Principle: As an experiment is repeated a larger number of times, the empirical relative frequency of an event gets progressively closer to its theoretical probability value.

Standard Probability Models and Sample Spaces

• Standard 52-Card Deck Applications:

  • A standard deck contains $52$ total cards divided into $4$ suits (Hearts, Diamonds, Clubs, Spades) of $13$ cards each, with $12$ face cards (Jacks, Queens, Kings).
  • Probability of drawing a Queen:     $P(\text{queen}) = \frac{4}{52} = \frac{1}{13}$
  • Probability of drawing the Queen of Hearts:     $P(\text{queen of hearts}) = \frac{1}{52}$
  • Probability of drawing a Heart:     $P(\text{heart}) = \frac{13}{52} = \frac{1}{4}$
  • Probability of drawing a face card:     $P(\text{face card}) = \frac{12}{52} = \frac{3}{13}$
  • Probability of drawing a card that is not a Two:     $P(\text{not a two}) = 1 - P(2) = 1 - \frac{4}{52} = \frac{48}{52} = \frac{12}{13}$

• Calendar and Birthday Models:

  • Assuming a non-leap year containing $365$ total days:
  • Probability of selecting a person born on May 9th:     $P(\text{May 9th}) = \frac{1}{365}$
  • Probability of selecting a person born in Spring ($91$ days):     $P(\text{Spring}) = \frac{91}{365} = \frac{1}{4}$
  • Probability of selecting a person born in May ($31$ days):     $P(\text{May}) = \frac{31}{365}$
  • Probability of Mother's Day occurring on a Tuesday in a given year:     $P(\text{Tuesday}) = \frac{0}{365} = 0\%$
  • Probability of Mother's Day occurring on a Sunday in a given year:     $P(\text{Sunday}) = \frac{1}{1} = 100\%$

• Alphabet Vowel Selection:

  • Standard English alphabet contains $26$ letters, with $5$ primary vowels ($A, E, I, O, U$):     $P(\text{vowel}) = \frac{5}{26}$

• Continuous Time Traffic Light Probability Model:

  • Traffic light cycle breakdown: Green for $45\,s$, Yellow for $5\,s$, Red for $30\,s$.
  • Total cycle time:     $45\,s + 5\,s + 30\,s = 80\,s$
  • Probability distribution model:
  • Red Signal:       $P(\text{Red}) = \frac{30}{80} = \frac{3}{8} = 0.375$
  • Yellow Signal:       $P(\text{Yellow}) = \frac{5}{80} = \frac{1}{16} = 0.0625$
  • Green Signal:       $P(\text{Green}) = \frac{45}{80} = \frac{9}{16} = 0.5625$

• Discrete Empirical and Guessing Scenarios:

  • Multiple Choice Guessing: On a question with $5$ possible options, guessing the wrong answer:     $P(\text{wrong}) = \frac{4}{5} = 0.8 = 80\%$
  • Tax Audit Rate: Sample of $900$ taxpayers with $25$ audited:     $P(\text{audited}) = \frac{25}{900} \approx 0.0278$
  • Hotel Room Selection: Hotel with $75$ smoking rooms and $190$ non-smoking rooms ($265$ total rooms):     $P(\text{smoking room}) = \frac{75}{265} \approx 0.283$
  • Eye Color Sample Distribution:
  • Brown eye frequency: $22$
  • Blue eye frequency: $15$
  • Green eye frequency: $13$
  • Total group size:       $22 + 15 + 13 = 50$
  • Probability of selecting an individual with green eyes:       $P(\text{green}) = \frac{13}{50} = 0.26$

• Multi-Child Family Gender Models:

  • Independent assumptions with equal probability $P(\text{boy}) = 0.5$ and $P(\text{girl}) = 0.5$:
  • Probability that a couple with two children has two boys:     $0.5 \times 0.5 = 0.25 = \frac{1}{4}$
  • Probability that a couple with three children has three boys:     $0.5 \times 0.5 \times 0.5 = 0.125 = \frac{1}{8}$

• Two-Dice Sum Probability Matrix:

  • Rolling two standard six-sided dice yields $6 \times 6 = 36$ equally likely sample space outcomes.
  • Complete sum outcome distribution grid across Die 1 ($1-6$) and Die 2 ($1-6$):
  • Die 1 = $1$: $2, 3, 4, 5, 6, 7$
  • Die 1 = $2$: $3, 4, 5, 6, 7, 8$
  • Die 1 = $3$: $4, 5, 6, 7, 8, 9$
  • Die 1 = $4$: $5, 6, 7, 8, 9, 10$
  • Die 1 = $5$: $6, 7, 8, 9, 10, 11$
  • Die 1 = $6$: $7, 8, 9, 10, 11, 12$
  • Probabilities calculated from the sum sample space:
  • Probability of rolling a sum of $6$ ($5$ combinations: $(1,5), (2,4), (3,3), (4,2), (5,1)$):       $P(6) = \frac{5}{36} \approx 0.1389$
  • Probability of rolling a sum of $11$ ($2$ combinations: $(5,6), (6,5)$):       $P(11) = \frac{2}{36} \approx 0.0556$
  • Probability of rolling a sum less than $4$ ($3$ combinations: $(1,1), (1,2), (2,1)$):       $P(\text{sum } < 4) = \frac{3}{36} \approx 0.0833$

The Addition Rule for Probability

• Disjoint (Mutually Exclusive) Events:

  • Events $A$ and $B$ are disjoint if they cannot occur at the exact same time.
  • Disjointness evaluation for specific event pairs:
  • Selecting someone who colors their hair vs. Selecting someone who reads the newspaper: Not Disjoint (a person can color their hair and read the newspaper simultaneously).
  • Selecting an unmarried television viewer vs. Selecting a TV viewer with an employed spouse: Disjoint (an unmarried individual does not have a spouse).
  • Selecting a new car with no defects vs. Selecting a new car with inoperative headlights: Disjoint (a car with no defects cannot possess non-functional headlights).
  • Selecting an Ace out of a standard deck vs. Selecting a Spade out of a standard deck: Not Disjoint (the Ace of Spades satisfies both outcomes simultaneously).

• Formal Addition Rules:

  • Addition Rule for Disjoint Events:     $P(A \text{ or } B) = P(A) + P(B)$
  • Example for disjoint events (drawing an Ace or a King):       $P(\text{ace or king}) = P(\text{ace}) + P(\text{king}) = \frac{4}{52} + \frac{4}{52} = \frac{8}{52} = \frac{2}{13}$
  • General Addition Rule for Non-Disjoint Events:     $P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$
  • Example for non-disjoint events (drawing an Ace or a Spade):       $P(\text{ace or spade}) = P(\text{ace}) + P(\text{spade}) - P(\text{ace and spade}) = \frac{4}{52} + \frac{13}{52} - \frac{1}{52} = \frac{16}{52} = \frac{4}{13}$

• Worked Addition Rule Examples:

  • Marble Container Selection: A box contains $3$ red, $4$ blue, $5$ green, and $2$ black marbles.
  • Total number of marbles:       $3 + 4 + 5 + 2 = 14$
  • Probability of picking a red or blue marble:       $P(\text{red or blue}) = \frac{3}{14} + \frac{4}{14} = \frac{7}{14} = \frac{1}{2} = 0.5$
  • Birth Date Probability: Probability of a baby being born in June or on the 1st day of a month in a $365$-day year.
  • Total days in June = $30$
  • Total 1st days of a month in a year = $12$
  • Overlap (June 1st) = $1$
  • Calculation:       $P(\text{June or 1st}) = \frac{30}{365} + \frac{12}{365} - \frac{1}{365} = \frac{41}{365}$
  • Single Die Roll: Probability of rolling an odd number or a number less than $4$ on a single six-sided die.
  • Odd outcomes: $\text{Odd} = \{1, 3, 5\}$ ($3$ outcomes)
  • Less than four outcomes: $\text{Less than 4} = \{1, 2, 3\}$ ($3$ outcomes)
  • Overlapping outcomes: $\text{Odd and Less than 4} = \{1, 3\}$ ($2$ outcomes)
  • Calculation:       $P(\text{odd or } < 4) = \frac{3}{6} + \frac{3}{6} - \frac{2}{6} = \frac{4}{6} = \frac{2}{3}$
  • Two Dice Sum Addition: Probability of rolling a sum of $7$ or $11$ on two dice.
  • Combinations equaling $7$: $6$ outcomes
  • Combinations equaling $11$: $2$ outcomes
  • Sums of $7$ and $11$ are disjoint.
  • Calculation:       $P(7 \text{ or } 11) = \frac{6}{36} + \frac{2}{36} = \frac{8}{36} = \frac{2}{9}$

Complementary Events

• Definition and Core Identities:

  • The complement of event $A$, denoted as $\text{not } A$ (or $A^c$ or $\bar{A}$), consists of all outcomes in the sample space in which event $A$ does not occur.
  • Sum of complementary probabilities:     $P(A) + P(\text{not } A) = 1$
  • Formula for finding the complement probability:     $P(\text{not } A) = 1 - P(A)$

• Complement Identifications:

  • Event: A coin landing on tails $\rightarrow$ Complement: Coin landing on heads.
  • Event: Rolling a $4$ on one die $\rightarrow$ Complement: Rolling a 1, 2, 3, 5, \text{ or } 6$.\n * Event: Drawing a Heart or Spade from a deck \rightarrow Complement: Drawing a Diamond or Club.\n * Event: Eating at least 3$cookies$\rightarrow$Complement: Eating$0, 1, \text{ or } 2 cookies.\n * Event: Rolling a sum less than 11$on two dice$\rightarrow$Complement: Rolling a sum of$11$or$12$.

• Calculations Using Complements:

  • Exam Failure Probability: If the probability of passing an exam is $0.72$:     $P(\text{failing}) = 1 - P(\text{passing}) = 1 - 0.72 = 0.28$
  • Card Deck Selection: Probability of drawing a card that is not a Two:     $P(\text{not a two}) = 1 - P(2) = 1 - \frac{4}{52} = \frac{48}{52} = \frac{12}{13}$
  • Two-Dice Sum Less Than 11: Probability of rolling a sum less than $11$ on two dice:
  • Complementary sums are $11$ and $12$ ($3$ total outcomes: $(5,6), (6,5), (6,6)$).
  • Calculation:       $P(\text{sum } < 11) = 1 - P(11 \text{ or } 12) = 1 - \frac{3}{36} = \frac{33}{36} = \frac{11}{12}$

Contingency Tables and Multi-Variable Analysis

• Titanic Passenger Data Matrix:
  • Structural contingency table representing $2,223$ total passengers aboard the Titanic:

  | Passenger Category | Survived | Died | Total |   |---|---|---|---|   | Men | $332$ | $1360$ | $1692$ |   | Women | $318$ | $104$ | $422$ |   | Boys | $29$ | $35$ | $64$ |   | Girls | $27$ | $18$ | $45$ |   | Totals | $706$ | $1517$ | $2223$ |

• Calculated Probabilities from Contingency Table:
  • Probability of selecting a Woman:     $P(\text{woman}) = \frac{422}{2223} \approx 0.190$
  • Probability of selecting a Survivor:     $P(\text{survivor}) = \frac{706}{2223} \approx 0.318$
  • Probability of selecting a Man who died:     $P(\text{man and died}) = \frac{1360}{2223} \approx 0.612$
  • Probability of selecting a Man or a Boy:     $P(\text{man or boy}) = \frac{1692 + 64}{2223} = \frac{1756}{2223} \approx 0.790$
  • Probability of selecting a Man or a Survivor:     $P(\text{man or survivor}) = \frac{1692 + 706 - 332}{2223} = \frac{2066}{2223} \approx 0.929$
  • Probability of selecting a Female or someone who died:
  • Total Females = $422 + 45 = 467$
  • Total Died = $1517$
  • Overlap (Females who died) = $104 + 18 = 122$
  • Calculation:       $P(\text{female or died}) = \frac{467 + 1517 - 122}{2223} = \frac{1862}{2223} \approx 0.838$
  • Probability of selecting someone who is not a Boy:     $P(\text{not a boy}) = 1 - P(\text{boy}) = 1 - \frac{64}{2223} = \frac{2159}{2223} \approx 0.971$

Graphical and Geometric Probability Applications

• First-Grade Class Demographic Pie Chart Analysis:

  • Class Distribution Parameters: Total student population = $24$.
  • Gender breakdown: $12$ Boys, $12$ Girls.
  • Hair color breakdown: $8$ Redheads, $4$ Blondes, $12$ Brunettes.
  • Demographic Probabilities:
  • Probability of selecting a Brunette:       $P(\text{brunette}) = \frac{12}{24} = 0.5$
  • Probability of selecting a Girl:       $P(\text{girl}) = \frac{12}{24} = 0.5$
  • Probability of selecting a Redhead or a Blonde:       $P(\text{redhead or blonde}) = \frac{8 + 4}{24} = \frac{12}{24} = 0.5$
  • Probability of selecting a Girl or a Blonde:       $P(\text{girl or blonde}) = \frac{12 + 8 - 1}{24} = \frac{19}{24} \approx 0.792$
  • Probability of selecting a Boy or a Brunette:       $P(\text{boy or brunette}) = \frac{12 + 12 - 12}{24} = \frac{12}{24} = 0.5$
  • Probability of selecting a student who is not a Redhead:       $P(\text{not a redhead}) = 1 - P(\text{redhead}) = 1 - \frac{4}{24} = \frac{20}{24} = \frac{5}{6} \approx 0.833$

• Geometric Figures Sample Space Analysis:

  • Collection parameters: Total of $12$ geometric figures.
  • Figure Selection Probabilities:
  • Probability of selecting a Circle ($5$ circles total):       $P(\text{circle}) = \frac{5}{12} \approx 0.417$
  • Probability of selecting a Circle or a Star ($5$ circles, $6$ stars):       $P(\text{circle or star}) = \frac{5}{12} + \frac{6}{12} = \frac{11}{12} \approx 0.917$
  • Probability of selecting a Star ($6$ stars total):       $P(\text{star}) = \frac{6}{12} = \frac{1}{2} = 0.5$
  • Probability of selecting a Star contained within a Circle ($4$ such figures):       $P(\text{star within a circle}) = \frac{4}{12} = \frac{1}{3} \approx 0.333$
  • Probability of selecting a Square with a Heart inside ($5$ such figures):       $P(\text{square with a heart inside}) = \frac{5}{12} \approx 0.417$
  • Probability of selecting a Square or a Heart ($8$ total matching figures):       $P(\text{square or heart}) = \frac{8}{12} = \frac{2}{3} \approx 0.667$