1- Probability for Discrete Variables
Foundations and Fundamental Definitions of Probability
Core Concepts:
Experiment: An action, operation, or procedure that produces an event or a well-defined set of events.
Sample Space (): The comprehensive set comprising all possible elementary events or outcomes of an experiment. For discrete variables, outcomes can be nominal categories (e.g., ).
Event / Outcome (): A specific subset of outcomes within the sample space (e.g., drawing a blue ball from a container).

Fundamental Probability Axioms / Rules:
Probability Range Rule: For any event occurring within sample space , the probability is bounded between zero and one inclusive:
Certainty of Sample Space: The probability that an outcome falls somewhere within the entire sample space equals one:
Marginal Probability and Complements
Marginal / Unconditional Probability:
Definition: The probability of a single discrete event occurring independently of any other events, denoted as .
Equally Likely Elementary Outcomes: If a sample space consists of a finite total of equally likely elementary occurrences, and a specific discrete event consists of of those occurrences, the marginal probability is calculated as:
Complement of an Event:
Definition: The complement of event , denoted as , is the event that does not occur.
Formula: The probability of the complement is the remainder when the event's probability is subtracted from unity:
Worked Numerical Example (Urn/Bag Model):
A container holds total balls of nominal categories: blue, red, and green.
Number of blue balls: .
Marginal probability of drawing a blue ball:
Complement probability of drawing a ball that is not blue:
Set Operations and Event Relationships

Intersection / Joint Probability ():
Represents the simultaneous occurrence of both event and event .
Denoted as .
Set Complement Partitions:
represents all elements in the sample space that belong to event but do not belong to event .
represents all elements in the sample space that belong to event but do not belong to event .
Union of Events ():
Represents the occurrence of either event , event , or both events simultaneously.
Denotes the occurrence of any event within the combined region:
The event alone is a possibility.
The event alone is a possibility.
The intersection is a possibility.
Conditional Probability ():
Represents the probability of event occurring given that event is known to have already occurred.
Denoted as .
Classification of Event Relationships:
Mutually Exclusive (Disjoint) Events:
Events and cannot occur at the same time.
The intersection contains zero elements: .
Independent Events:
The occurrence of event provides no information about the occurrence of event , and vice versa.
The conditional probability equals the unconditional marginal probability: .
Dependent Events:
The occurrence of event provides information regarding the occurrence of event (i.e., it alters the probability that occurs), and vice versa.
Sampling Strategies and Dependency

Sampling With Replacement:
After an item is selected from sample space , it is returned to the pool prior to the next draw.
The total number of items and the relative composition remain unchanged.
Successive draws remain strictly independent.
Sampling Without Replacement:
After an item is drawn from sample space , it is permanently removed and not returned to the pool.
In a finite sample space, removing elements shifts the denominator and relative proportions for subsequent draws.
Sampling without replacement directly creates dependencies among successive events.
Computational Probability Rules for Discrete Data
Additive Rule of Probability:
For Mutually Exclusive Events: When two discrete events and cannot occur together, the union equals the direct sum of their marginal probabilities:
General Additive Rule (Non-Mutually Exclusive Events): When two events can occur simultaneously, adding their marginal probabilities double-counts their overlap; the joint probability must be subtracted:
Multiplicative Rule of Probability:
For Independent Events: The joint probability of two independent events equals the product of their individual marginal probabilities:
For Dependent Events: The joint probability is computed using conditional probability:
Conditional Probability Formulation:
The formal definition of conditional probability is derived by rearranging the multiplicative rule:
Summary Matrix of Formulas across Event Types:
Probability Type | Mutually Exclusive Events | Independent Events | Dependent Events |
|---|---|---|---|
Union: | |||
Joint: | |||
Conditional: |
Deduction Requirements for Dependent Events:
To solve calculations involving dependent events, one must either be directly given the joint probability , given the conditional probability , or provided sufficient context to deduce them.

Discrete Probability Distributions
Probability Mass Function (PMF):
Definition: A function that maps each discrete outcome of a discrete random variable to its exact probability of occurrence, denoted as:

Likert Category PMF Example:
A discrete PMF evaluated over five ordered categories (Likert_Category 1 through 5) exhibits the following empirical probability values:
Category 1:
Category 2:
Category 3:
Category 4:
Category 5:
The sum of all discrete probability masses across the distribution equals one:
Joint Probability Mass Function (Contingency Structure):
For two independent binary events and and their respective complements and , the joint PMF is organized in a cross-tabulated contingency table where inner cells represent intersections and outer margins represent marginal probabilities:
Event Partition | Event | Event | Marginal Row Probability |
|---|---|---|---|
Event | |||
Event | |||
Marginal Column Probability |

Misinterpretations and Real-World Applications of Probability
Ecological Fallacy / Population vs. Individual Probability:
A reported group-level efficacy rate cannot be directly converted into an individual's personal probability.
Clinical Drug Example:
Scenario: A scientific study demonstrates that a novel pharmaceutical drug is effective in of study participants.
Fallacy: Assuming that any individual patient has a chance () of experiencing drug efficacy.
Reality: The chances that the drug was effective for a specific person (e.g., Participant 4 in the study) are unknown on an individual deterministic level (efficacy is an individual outcome, either or ).
Individual Inference: The exact probability that the drug will be effective for a new external individual is entirely unknown without specific individual conditional data.
Health and Lifetime Risk Reporting:
Epidemiological statistics are frequently presented as aggregate lifetime risks.
Risk Perception vs. Actuarial Reality:
Human risk perception commonly deviates from actuarial probability calculations, often magnifying rare, dramatic threats while underestimating commonplace hazards.