4.1
Chapter 4: Probability and Inference
- Statistical inference focuses on the question:
- "How often would this method give the correct answer if used many times?"
- Probability theory provides the essential framework needed to address this question.
Section 4.1: Randomness
- Definition of Randomness:
- When tossing a coin, the outcome cannot be predicted in advance; however, over a long series of trials, a pattern emerges (e.g., the expectation of heads and tails).
- Clarification:
- The term random does not mean haphazard; rather, it denotes a specific type of order that reveals itself over time, even when individual outcomes are uncertain.
Understanding Probability
- Probability of Outcomes:
- The probability of any specific outcome in a random phenomenon is defined as the proportion of times that outcome would be expected to occur over a very long series of repetitions.
- This definition of probability is recognized as the frequentist definition and is the only definition presented in Section 4.1 of the textbook.
Other Definitions of Probability
There are several other frameworks for defining probability, including:
- Classical Probability:
- Based on the assumption of equal probabilities for outcomes, commonly exemplified in gambling scenarios.
- Geometric Probability:
- Based on areas or spatial considerations.
- Subjective Probability:
- Derived from personal beliefs or opinions about the likelihood of events occurring.
A comprehensive framework that encompasses all four probability approaches was established by A. N. Kolmogorov in 1936, known as the axiomatic definition of probability.
Example Using Smarties®
- Practical Example:
- Count the number of Smarties® of each color, with a focus particularly on red ones.
- Investigate whether the packages of Smarties® are filled at random.
- Additional task: Count the total number of Smarties® in a package to analyze the randomness of their distribution in terms of color variety.