Probability and Statistics: Core Concepts and Applications

Early Mentions (Brown/Low Sugar Era): While specific context is missing, the mention of "Low or brown sugar" suggests early informal understandings or references to chance.
Ancient Greece ( $600 ext{ BC}$ to $400 ext{ BC}$ ): Significant early developments in thought that predate formal probability theory.
Middle Ages & Arabic Mathematics: Arabic scholars in Baghdad made substantial contributions to mathematics, laying groundwork for later advancements in probability.
Jacob Bernoulli: Key figure who "opened the door" to modern probability theory, particularly with concepts related to the Law of Large Numbers.
$18^{th}$ - $19^{th}$ Centuries: Period of major advancements and formalization in probability.
Early $20^{th}$ Century onwards: Rapid acceleration and movement forward in the field of statistics and probability, enabling powerful predictive capabilities.

Core Concept: The LLN states that as the number of trials increases, the relative frequency of an event will converge to its theoretical probability.
Illustrative Example (Coin Flips):
- 10 Flips: If you flip a coin $10$ times, it is highly unlikely to get exactly $5$ heads and $5$ tails. The chances are small.
- 100 Flips: Similarly, flipping $100$ times might not yield exactly $50$ heads and $50$ tails, though the probability of being close is higher than with $10$ flips compared to total possible outcomes.
- 1 Billion Flips ( $1,000,000,000$ ): If you flip a coin one billion times, the relative frequency of getting heads will be extremely close to $0.5$ . This convergence is the essence of the LLN, a concept introduced by Jacob Bernoulli.

Purpose: Tree diagrams are visual tools used to map out all possible outcomes of a sequence of events and calculate their probabilities.
Constructing a Tree Diagram:
1. Start with the initial event (e.g., first child's gender).
2. Branch out for each possible outcome, assigning its probability to the branch (e.g., $P( ext{Boy}) = 0.6$ and $P( ext{Girl}) = 0.4$ for the first child if these are given probabilities).
3. For subsequent events, continue branching from the end of each previous branch.
Calculating Probabilities with Branches (Multiplication Rule):
- When moving along the branches (i.e., considering a sequence of events), you multiply the probabilities of the branches to find the probability of that sequence of outcomes.
- Example: For a first child's gender, if $P( ext{Boy}) = 0.6$ and $P( ext{Girl}) = 0.4$ , and assuming similar probabilities for the second child (or specified conditional probabilities):
  - Probability of having two girls: $P( ext{Girl then Girl}) = P( ext{Girl first}) imes P( ext{Girl second} | ext{Girl first}) = 0.4 imes 0.4 = 0.16$ .
Completing Tree Diagrams: The first step is always to complete all probabilities on every branch. Once the tree is fully labeled, any probability question related to the sequence of events can be answered.

This distinction is crucial for correctly calculating probabilities:

Multiplication: Use when events occur in sequence or when you are finding the probability of multiple independent events all occurring. This is applied when moving along branches in a tree diagram to find the probability of a specific path.
- Example: $P( ext{Event A AND Event B})$ . If A and B are independent, $P(A ext{ and } B) = P(A) imes P(B)$ .
Addition: Use when considering mutually exclusive events (events that cannot happen at the same time) that all satisfy a given condition. You sum the probabilities of these distinct events.
- Example 1 (Single Die Roll): What is the probability of rolling an even number? The possibilities are $2, 4,$ , or $6$ . These are mutually exclusive outcomes from a single roll.
  $P( ext{Even}) = P(2) + P(4) + P(6)$ (assuming a fair six-sided die, this would be $rac{1}{6} + rac{1}{6} + rac{1}{6} = rac{3}{6} = rac{1}{2}$ ).
- Example 2 (Combined Paths in a Tree Diagram): What is the probability that the second child is a girl? This involves combining different paths leading to the desired outcome (e.g., Boy then Girl OR Girl then Girl).
  $P( ext{2nd is Girl}) = P( ext{1st Boy AND 2nd Girl}) + P( ext{1st Girl AND 2nd Girl}))$ .
  (If $P( ext{Boy})=0.6$ , $P( ext{Girl})=0.4$ for both children independently, then $(0.6 imes 0.4) + (0.4 imes 0.4) = 0.24 + 0.16 = 0.40$ ).

Purpose: Visual representations of sets and their relationships, particularly useful for understanding union and intersection of events.
Key Concepts:
- Union ( $A ext{ or } B$ ): Denoted as $A \bigcup B$ , this represents the event where A occurs, or B occurs, or both occur. In a Venn diagram, it is the entire area covered by both circles.
  - Formula: $P(A \bigcup B) = P(A) + P(B) - P(A \bigcap B)$ .
  - The term $- P(A \bigcap B)$ is subtracted because the intersection (common part) is counted twice when just adding $P(A)$ and $P(B)$ .
- Intersection ( $A ext{ and } B$ ): Denoted as $A \bigcap B$ , this represents the event where both A and B occur simultaneously. In a Venn diagram, it is the overlapping region of the circles, which represents the common part.

Definition: The sample space is the set of all possible outcomes of an experiment.
Example 1 (Flipping two coins): The sample space is ${HH, HT, TH, TT}$ , containing $4$ possible outcomes.
Example 2 (Rolling two dice): If you roll two dice and record the face values, there are $6 imes 6 = 36$ possible outcomes (e.g., $(1,1), (1,2), ext{…}, (6,6)$ ). Using a tree diagram for this would be excessively complex due to the large number of branches, making other methods (like tables for sums) more practical.

Concept: The probability of an event not happening is $1$ minus the probability that it does happen.
Formula: $P( ext{not } A) = 1 - P(A)$ .
Example: If $P( ext{social responsibility}) = 4\%$ , then $P( ext{not social responsibility}) = 1 - 0.04 = 0.96$ or $96\%$ .