Probability, Conditional Probability, and Expected Value Study Guide
Basic Concepts of Probability
Union Rule for Probability: For any two events and , the probability of their union (the probability that event or event or both occur) is calculated as:
Union Rule for Mutually Exclusive Events: Two events and are defined as mutually exclusive if they cannot occur at the same time, meaning their intersection is empty ( and ). For mutually exclusive events, the union rule simplifies to:
Example 1: Card Selection Draw a single card from a standard deck of playing cards. Find the probability that the card drawn is a heart or a king.
Let be the event of drawing a heart: .
Let be the event of drawing a king: .
The event of drawing a card that is both a heart and a king is (the King of Hearts): .
Applying the Union Rule:
Example 2: Two Dice Outcomes

Roll two fair six-sided dice. The total number of equally likely outcomes in the sample space is .
Part a: Find the probability that the first die shows a or , or the sum of the two dice is .
Let = First die is a or . The outcomes are:
Let = The sum of the dice is . The outcomes are:
The intersection contains outcomes where the first die is or AND the sum is :
Using the Union Rule:
Part b: Find the probability that the sum is or exactly one die shows a .
Let = The sum is : .
Let = Exactly one die shows a . Outcomes are: Note that is excluded because both dice show a . Thus, .
Check intersection : If a die shows a , the maximum possible sum is . A sum of cannot contain a . Thus, and (mutually exclusive).
Applying the Union Rule:
Complement Rule: The complement of an event , denoted as , consists of all outcomes in the sample space that are not in .
Formula for probability of event :
Formula for probability of complement :
Example 3: Complement Rule Applications
Part a: Roll two dice. Find the probability that a sum of is not rolled.
Let be the event that a sum of is rolled: .
.
The event that a sum of is NOT rolled is . Applying the complement rule:
Part b: There is a chance of rain tomorrow (). Determine the probability that it will not rain tomorrow.
Odds:
If the odds favoring event are to (written ), then:
If the odds favoring event are to , then the odds against event are to .
The odds in favor of event represent the ratio of the probability that occurs to the probability that does not occur:
Example 4: Odds Calculations
Part a: The probability of rain tomorrow is . Find the odds in favor of rain tomorrow.
,
Part b: Suppose the odds in favor of passing an exam are to . Find the probability of passing the exam.
Given and :
Part c: Suppose the odds against Texas A&M winning the national title are to . Find the probability that Texas A&M will not win the national title.
Odds against winning are to Odds in favor of winning are to ().
Part d: Find the odds in favor of rolling a sum of when two dice are rolled.
Outcomes resulting in a sum of : outcomes.
Example 5: Set Probabilities from Venn Diagrams

Given , , and . Find the following probabilities:
Part a:
Rearranging the Union Rule:
Part b:
Part c:
Event represents outcomes in but not in :
Part d:
Event is the complement of (by De Morgan's Law):
Probability Keywords Translation:
"and", "but" Intersection ()
"or", "either or" Union ()
Example 6: Political Survey Probabilities A survey of people was conducted regarding political views. people were older than , were older than and Republican, and were Republican. Find the probability that a randomly chosen person:
Let = Older than ()
Let = Republican ()
Let = Older than AND Republican ()
Part a: Is older than and a Republican ():
Part b: Is older than or a Republican ():
Part c: Is not a Republican ():
Part d: Is older than but not a Republican ():
Contingency Tables and Empirical Probability
Structure of Two-Way Contingency Tables: A contingency table classifies sample observations according to two categorical variables (e.g., driver age group and accident frequency). The row events () are mutually exclusive and exhaustive. Similarly, the column events () are mutually exclusive and exhaustive.

Driver Accident Data Summary Table:
Driver's Age Categories:
: years old (Total = )
: years old (Total = )
: years old (Total = )
: years old (Total = )
: years old (Total = )
Accident Categories (Past Year):
: accidents (Total = )
: accidents (Total = )
: accidents (Total = )
Total Sample Size ():
Example 1: Probabilities from Contingency Table
Part a: Find the probability that a driver was years old () or had or more accidents () in the past year.
Part b: Find the probability that a driver was older than years old () or had not been in an accident in the past year ().
Number of drivers older than :
Number of drivers with zero accidents:
Overlap (drivers older than AND zero accidents):
Calculation:
Part c: Find the probability that a driver was years old () or older than ().
Since age categories and are mutually exclusive ():
Conditional Probability and Probability Trees
Definition of Conditional Probability: The conditional probability of event occurring, given that event has already occurred, is denoted and defined as: Alternatively, using event counts from a finite sample space:
Example 1: Conditional Probability from Venn Diagram Data Consider a universal sample space divided into four regions with given probabilities:
Region () =
Region () =
Region () =
Region () =
Marginal probabilities: ,
Part a:
Part b:
Part c:
Part d:
Product Rule of Probability: By rearranging the conditional probability formula, the probability of the intersection of two events and is given by:
Example 2: Tree Diagram with Marble Selection (Without Replacement) A box contains red (), black (), and white () marble (Total = marbles). Two marbles are drawn sequentially without replacement.
Part a: Find the probability that the first marble is black ().
Part b: Find the probability that the second marble is black given that the first marble was white ().
If the first marble drawn was white, marbles remain in the box, of which are black:
Part c: Find the probability that both marbles are red ().
Part d: Find the probability that one marble is red and one marble is white (in any order).
Two mutually exclusive paths exist: or .
Part e: Find the probability that the second marble is red ().
Sum the probabilities of all pathways leading to a red marble on the second draw (, , ):
Example 3: Sequential Card Selection Two cards are drawn sequentially without replacement from a standard deck of cards.
Part a: Probability that the second card is a club given that the first card is a club.
Remaining clubs = , remaining cards = :
Part b: Probability that both cards are diamonds.
Part c: Probability that a spade and a heart are drawn in any order.
Example 4: Voter Preference Tree Application In a community, of voters are Republican (), are Democrats (), and are Independents (). Voting preference for Candidate A ():
Part a: Probability that a registered voter was a Republican AND voted for Candidate A:
Part b: Total percent of registered voters who voted for Candidate A ():
Part c: Percent of registered voters who were Republican OR voted for Candidate A ():
Example 5: Conditional Probabilities from Contingency Table Using the driver accident table ():
Part a: Driver was years old () given that the driver did NOT have an accident in the past year ():
Part b: Driver had accidents () knowing that the driver was or older ():
Part c: Driver was years old () if he or she had been in at least one accident ():
Part d: Probability a teenage driver () had or more accidents () [Conditional ]:
Part e: Driver was a teenager AND had or more accidents [Joint ]:
Independence of Events
Definition of Independent Events: Two events and are independent if the occurrence of one event has no effect on the probability of the occurrence of the other. Formally, and are independent if and only if: If events are not independent, they are defined as dependent events.
Product Rule for Independent Events: Events and are independent if and only if:
Example 1: Conceptual Identification of Independence
Scenario a: Draw two cards from a deck of without replacement. First card is a diamond, second card is red.
Dependent: Drawing the first card without replacement alters the total number of cards and red cards remaining, affecting the probability of the second draw.
Scenario b: The Houston Astros lose a baseball game and the Dallas Cowboys win a football game.
Independent: The outcome of one sports team's game has no direct mathematical effect on the outcome of an unrelated game by another team.
Scenario c: Roll two dice. First die shows a , second die shows a .
Independent: The outcome of the first die roll does not physically or probabilistically influence the outcome of the second die roll.
Example 2: Mathematical Test for Independence Given events and such that , , and . Determine if and are independent.
Check product condition:
Since , events and are independent.
Example 3: Weather and Traffic Analysis On a typical January day, , , and . Are snowing and traffic jams independent?
First, calculate using the Union Rule:
Test product rule:
Since , the events are independent.
Example 4: Dice Roll Events Independence Test Roll two fair dice. Let = sum of eight is rolled, and = exactly one is rolled. Are and independent?
Intersection
Test product rule:
Compare
Since , the events are dependent.
Example 5: Independence Test from Contingency Table From the driver accident table, test if event (driver is or older) and event (driver had accidents) are independent.
Test product rule:
Since , the events are independent.
Random Variables and Probability Distributions
Definition of Random Variable: A random variable is a function that assigns a unique real number to each outcome of a probability experiment. Random variables are categorized into three types:
Finite Discrete: The random variable can take on a finite number of distinct values (e.g., counting the number of aces in a -card hand).
Infinite Discrete: The random variable can take on an infinite, countable sequence of distinct values (e.g., rolling a die repeatedly until a six appears and counting the number of rolls required).
Continuous: The random variable can take on any real number within a continuous interval (e.g., measuring the distance between two arbitrary points on Earth).
Example 1: Random Variables and Outcome Sets
Scenario a: Draw marbles from a bag containing red, blue, and white marbles without replacement. Let be the number of red marbles drawn.
Possible values for :
Scenario b1: Roll two fair six-sided dice. Let be the number of sixes rolled.
Possible values for :
Scenario b2: Roll two fair six-sided dice. Let be the sum of the dice.
Possible values for :
Definition of Probability Distribution: A probability distribution is a table, graph, or formula that lists all possible numerical values of a discrete random variable alongside their corresponding probabilities , satisfying:
Example 2: Constructing Probability Distribution Tables
Part a: Drawing marbles from red, blue, and white (Total = marbles). Let = number of red marbles.
Total ways to choose marbles from :
(Choose non-red from ):
(Choose red from , non-red from ):
(Choose red from ):
Distribution Table: \begin{array}{|c|c|c|c|}\n \hline\n X & 0 & 1 & 2 \\\n \hline\n P(X) & \frac{28}{153} & \frac{80}{153} & \frac{45}{153} \\\n \hline\n \end{array}
Part b1: Roll two fair dice. Let = number of sixes rolled.
(Neither die is ):
(One die is ):
(Both dice are ):
Distribution Table: \begin{array}{|c|c|c|c|}\n \hline\n X & 0 & 1 & 2 \\\n \hline\n P(X) & \frac{25}{36} & \frac{10}{36} & \frac{1}{36} \\\n \hline\n \end{array}
Part b2: Roll two fair dice. Let = sum of the dice.
Distribution Table: \begin{array}{|c|c|c|c|c|c|c|c|c|c|c|c|}\n \hline\n X & 2 & 3 & 4 & 5 & 6 & 7 & 8 & 9 & 10 & 11 & 12 \\\n \hline\n P(X) & \frac{1}{36} & \frac{2}{36} & \frac{3}{36} & \frac{4}{36} & \frac{5}{36} & \frac{6}{36} & \frac{5}{36} & \frac{4}{36} & \frac{3}{36} & \frac{2}{36} & \frac{1}{36} \\\n \hline\n \end{array}
Expected Value and Decision Analysis
Definition and Formula for Expected Value: Suppose a discrete random variable can take on values with corresponding probabilities . The expected value (or mean ) is the weighted average outcome over long-term repetition:
Example 1: Expected Value Computations
Part a: Find for the marble selection experiment:
Part b: Find for the sum of two fair dice:
Games of Chance and Decision Rules: Expected value determines long-term profitability in decision analysis:
If (Positive expected winnings): The player should play.
If (Negative expected winnings): The player should not play.
Fair Game: A game is mathematically fair if and only if its expected value is zero ().
Example 2: Card Game Expectation Between Two Players Player A draws a card from a deck of . If a face card (Jack, Queen, King; total) is drawn, Player A wins \. If any other card ( total) is drawn, Player A loses \20$.\n * Random Variable X = Player A's net payoff.\n * Distribution Table:\n \begin{array}{|c|c|c|} \hline X & +80 & -20 \ \hline P(X) & \frac{12}{52} = \frac{3}{13} & \frac{40}{52} = \frac{10}{13} \ \hline \end{array}\n * Expected value per game:\n E(X) = (80)\left(\frac{3}{13}\right) + (-20)\left(\frac{10}{13}\right) = \frac{240 - 200}{13} = \frac{40}{13} \approx \$3.08\n * Expected status after 10 games:\n \text{Expected Winnings} = 10 \times \frac{40}{13} = \frac{400}{13} \approx \30.77 \text{ (Up } \30.77)\n\n* **Example 3: Raffle Prize Expected Winnings**\n Frank pays \14000 total balls. Prizes contained in the balls:\n * One \500 gift card\n * Four \100 gift cards\n * Ten \50 gift cards\n * Remaining 3985 balls contain no prize (\0).\n * Compute net winnings X (Prize minus \1 entry fee):\n * Net \499P = \frac{1}{4000}\n * Net \99P = \frac{4}{4000}\n * Net \49P = \frac{10}{4000}\n * Net \-1P = \frac{3985}{4000}\n * Expected value equation:\n E(X) = (499)\left(\frac{1}{4000}\right) + (99)\left(\frac{4}{4000}\right) + (49)\left(\frac{10}{4000}\right) + (-1)\left(\frac{3985}{4000}\right)\n E(X) = \frac{499 + 396 + 490 - 3985}{4000} = \frac{-2600}{4000} = -\$0.65\n * Frank loses an average of \0.65 per drawing.\n\n* **Example 4: Casino Roulette Analysis**\n\n\n\n An American roulette wheel contains 3818182 Green). Sally places a \100 bet on Red and a \50 bet on Green (Total outlay = \150).\n * **Payout Rules**:\n * Red landing (18/38): Wins back \100 bet + \100 profit on Red. Loses \50+100 - 50 = +\$50.\n * Green landing (2/38): Wins back \5020 \times 50 = \$1000 profit on Green. Loses \100+1000 - 100 = +\$900.\n * Black landing (18/38-\$150.\n * Expected Winnings E(X):\n E(X) = (50)\left(\frac{18}{38}\right) + (900)\left(\frac{2}{38}\right) + (-150)\left(\frac{18}{38}\right)\n E(X) = \frac{900 + 1800 - 2700}{38} = \frac{0}{38} = \$0\n * **Fairness**: The game is **fair** because E(X) = \$0.\n\n* **Example 5: Spinner Game Analysis**\n\n\n\n Hank spins an 85S3F).\n * Probabilities for a single spin: P(S) = \frac{5}{8}P(F) = \frac{3}{8}\n * Two-spin probabilities:\n * Two happy faces (SSP(SS) = \frac{5}{8} \times \frac{5}{8} = \frac{25}{64}, Net win = \50\n * Exactly one happy face (SF \text{ or } FSP(1S) = 2 \times \left(\frac{5}{8} \times \frac{3}{8}\right) = \frac{30}{64}, Net win = \10\n * Two frowny faces (FFP(FF) = \frac{3}{8} \times \frac{3}{8} = \frac{9}{64}, Net loss = \-100\n * **Expected Value for one game**:\n E(X) = (50)\left(\frac{25}{64}\right) + (10)\left(\frac{30}{64}\right) + (-100)\left(\frac{9}{64}\right)\n E(X) = \frac{1250 + 300 - 900}{64} = \frac{650}{64} = \frac{325}{32} \approx \$10.16\n * **Expected status after 20 games**:\n \text{Total Expected Winnings} = 20 \times \frac{650}{64} = \frac{13000}{64} = \frac{1625}{8} = \203.125 \approx \203.13\n * **Fairness**: The game is **not fair** because E(X) eq 0E(X) \approx \$10.16$$).