Evaluating Samples and Research Designs
Sample Evaluation and Representativity
Sample Quality and Representativity:
- The quality of any research sample is determined by its representativity.
- Representative Sample: A sample in which the characteristics of the sample precisely match the characteristics of the target population, differing only in size ( except for size).
Demonstration: Psychology Students Population vs. Representative Sample:
- Population Distribution:
- Gender: men, women, other.
- Track: bilingual, English.
- Representative Sample ( participants):
- Gender: men, women, other.
- Track: bilingual, English.
Sampling Methods and Representativity:
- Probability Sampling: The only methodological approach that ensures a representative sample can be obtained.
- Non-Probability Sampling: Introduces substantial risk of the sample becoming distorted or systematically biased.

Potential Sample Distortions: Sampling Bias and Response Bias
Sampling Bias:
- Occurs when there is an underrepresentation or overrepresentation of a specific segment of the population within the sample.
Response Bias and Response Rate:
- Response Rate: The percentage of individuals originally selected for the sample who actually agree to participate and complete the study.
- Core Evaluative Question: Are the respondents comparable to the non-respondents? If individuals who choose to participate systematically differ in views, behaviors, or traits from those who decline, response bias occurs.
Empirical Case Study: Shere Hite (1987):
- Reference: Hites, S. (1987). Woman and love: A cultural revolution in progress. New York: Knopf.
- Methodology:
- Target sample approached: women contacted.
- Format: Questionnaire study.
- Completed responses received: respondents.
- Calculated Response Rate: .
- Reported Findings:
- of respondents reported having engaged in an extra-marital affair.
- felt emotionally abused by their partner.
- Methodological Limitation:
- With a response rate of only , severe response bias is present; the women who chose to complete and return the questionnaire likely held stronger grievances, negative experiences, or differing relationship behaviors compared to the of women who did not respond.
Descriptive Research and Empirical Domains
Definition of Descriptive Research:
- Research designed specifically to provide an accurate, systematic description of the behaviors, thoughts, or feelings of a particular group or population.
Survey Studies:
- Involve soliciting self-reported information regarding attitudes, convictions, opinions, political leanings, and related constructs.
- Often used for public opinion polling and political seat projections.

Political Seat Projection Details (Dutch House of Representatives / Tweede Kamer):
Compares historical general election results (TK23) with successive polling snapshots (17-feb-25 and 17-mrt-25), incorporating confidence intervals/error margins across political parties:
- PVV: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- GL-PvdA: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- VVD: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- CDA: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- D66: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- PvdD: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- SP: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- DENK: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- CU: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- JA21: seat (TK23), seats (17-feb-25), seats (17-mrt-25).
- Volt: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- BBB: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- FvD: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- SGP: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
- NSC: seats (TK23), seats (17-feb-25), seats (17-mrt-25).
Demographic Research:
Focuses on quantifying and describing elementary life events, demographic transitions, and population milestones (e.g., birth rates, fertility, marriage rates, mortality, age milestones).

Definitional Fallacies in Demographics:
Data tracking teen pregnancy rates illustrates how classification definitions dictate distributions: pregnancies rise through the teen years (ages through , peaking around age ), before dropping precipitously to zero at age , which occurs purely because individuals aged and older are no longer categorized as teenagers.
Epidemiological Research:
Gathers empirical data on the occurrence, prevalence, and incidence of diseases, mental disorders, and physical health conditions within populations.

- CBS Health Data on Sleep (2022):
- Evaluates individuals affected by sleep deprivation and suffering from general sleeping problems across cohorts (, , and total population) categorized by gender (Total, Female, Male):
- Total Population:
- Affected by sleep deprivation: Approximately (), (), and (Total).
- Sleeping problems: Approximately (), (), and (Total).
- Females:
- Affected by sleep deprivation: Approximately (), (), and (Total).
- Sleeping problems: Approximately (), (), and (Total).
- Males:
- Affected by sleep deprivation: Approximately (), (), and (Total).
- Sleeping problems: Approximately (), (), and (Total).
- Evaluates individuals affected by sleep deprivation and suffering from general sleeping problems across cohorts (, , and total population) categorized by gender (Total, Female, Male):
Explanatory Research in Psychology
Descriptive vs. Explanatory Focus:
- Most research within psychological science is non-descriptive.
- Rather than aiming solely to catalog population parameters, psychological investigations predominantly seek to explain functional and causal relationships between variables.
Three Primary Pillars of Explanatory Psychological Science:
- 1. Hypothesis Testing: Formulating theoretical expectations regarding how variables interact and testing them systematically against empirical observations.
- 2. Replications: Conducting repeated studies across diverse conditions and contexts to confirm whether observed effects and relationships remain stable.
- 3. Universal Phenomena: Investigating basic cognitive, neurological, affective, and behavioral mechanisms presumed to operate universally across human populations, reducing the absolute necessity for representative demographic matching when examining universal psychological architecture.