Psychological Research Methods, Pseudoscience, and Cognitive Biases

Course Structure, Exam Policy, and Learning Strategy

  • PowerPoint presentations are provided on Canvas; copying every word or taking photos of slides during class is unnecessary.
  • Classroom expectations prioritize active cognitive engagement, including active listening, critical thinking, asking questions, and offering illustrative examples when prompted.
  • Passively copying slide text verbatim during class engages the brain in unproductive mechanics without learning benefits.
  • Classroom note-taking should be reserved for capturing unique examples, context, or personal insights rather than transcribing slide text.
  • PowerPoint presentations serve as the official study guide for examinations; no separate or supplemental study guide is provided.
  • Examination coverage is strictly limited to topics explicitly included in the PowerPoint slides.
  • Textbook readings (whether physical or digital) contain additional topics; topics omitted from PowerPoint slides will not be tested on examinations.

Historical Foundations of Psychology and Pseudoscience

  • Historical Origins: Psychology evolved from philosophical inquiries into human behavior, social relationships, and individual identity.
  • Early Biological Hypotheses: Early thinkers postulated that human personality and behavioral differences stemmed directly from physical biology and biological matter.
  • Historical Practice of Phrenology:
    • Phrenology (historically referred to as brainology) posited that individual personality traits could be evaluated by examining, feeling, and mapping the skull's physical contours, bumps, valleys, nooks, and crannies.
    • Phrenologists claimed skull contours indicated specific personality attributes, such as possessing a hot temper or a kind nature.
    • Phrenologists presented themselves in formal professional attire, evaluated clients' skulls, provided personal life advice, and charged fees for services.
    • Individuals would even shave their heads to make their skull contours clearly visible for phrenological analysis.
  • Definition and Characteristics of Pseudoscience:
    • Phrenology is categorized as a pseudoscience (fake science).
    • Pseudoscience refers to claims, theories, or practices presented as scientific and authoritative, but lacking empirical support, valid methodology, or scientific merit.
    • Pseudoscientists adopt external markers of authority and expertise without delivering valid, evidence-based knowledge.

Information Sources: Intuition vs. Scientific Knowledge

  • Evaluating Sources of Information: Navigating modern information environments requires discerning legitimate, evidence-based knowledge from pseudoscientific sources (e.g., unverified social media or Instagram accounts promoting phrenology).
  • Internal vs. External Sources: Information evaluated for belief can originate externally or internally from self-generated gut feelings and intuition.
  • Characteristics and Functions of Intuition:
    • Intuition is an inner voice or a rapid best guess generated from an individual's accumulated knowledge under time constraints.
    • Intuition is primarily utilized when time is insufficient to collect data, interview individuals, or comprehensively analyze a situation.
    • Emergency Scenario Example: Walking home from a bus stop and noticing a stranger on the opposite side of the street requires immediate decision-making (walking fast, running, entering a yard, or continuing calmly) without time to survey the environment.
  • Limitations of Intuition: Intuitive judgements are context-dependent individual reactions; they cannot be generalized as universal advice or applied to broader populations.
  • Science vs. Intuition: Scientific knowledge is deliberately gathered over extended timeframes, adhering to rigorous methodological rules and public accountability, distinguishing it from rapid intuition or common sense.

Scientific Responsibility and Human Cognitive Biases

  • Societal Stakes of Scientific Information: Scientific research is compiled for application across large populations (hundreds of thousands or millions of people\text{hundreds of thousands or millions of people}).
  • Consequences of Error: Disseminating false, unverified, or flawed information at scale inflicts widespread negative consequences on society.
  • Responsibility of Scientists: Scientists must exercise extreme caution during data collection and active deliberation to ensure conclusions are empirical and reliable.
  • Systematic Cognitive Biases: Human thinking inherently possesses systematic cognitive biases.
  • Personal vs. Scientific Bias:
    • Everyday personal biases (e.g., a mother believing her two sons are professional models while others disagree) carry minor personal implications.
    • Scientific bias compromises data and negatively impacts populations, necessitating systematic controls to prevent biased conclusions.

Hindsight Bias

  • Definition: Hindsight bias (commonly summarized as "hindsight is 20/2020/20") is the tendency to believe, after an outcome has occurred, that the event was predictable or expected all along.
  • Mechanism: Looking back at past events creates perfect retroactive clarity, convincing individuals that an outcome was obvious prior to its occurrence.
  • Concrete Examples of Hindsight Bias:
    • Lateness: Asserting that a person arriving 2 minutes2\,\text{minutes} late to class was predictably late due to perceived disorganization or laziness.
    • Sex Prediction: Claiming certainty about a friend's newborn baby's biological sex ("I knew it was going to be a boy") post-birth, despite the actual baseline probability being exactly 50/5050/50 (50%50\%) prior to birth.
  • Human Predictive Limitations: Humans possess poor predictive accuracy across all domains, including:
    • Meteorological forecasting (weather predictions).
    • Economic and stock market forecasting.
    • Course grade predictions (predicting an A versus a B grade).
    • Personal behavior predictions (predicting whether an individual will attend the gym the next day).
  • The Arrogance of "I Knew It": Asserting "I knew it" reflects a false belief that an individual possessed past foresight of a future event.
  • Scientific Safeguards:
    • Scientists prevent hindsight bias by committing predicted outcomes to writing on paper prior to conducting experiments, collecting data, or administering medical treatments/vaccines.
    • Pre-registration of hypotheses forces researchers to face objective reality if a hypothesis is disproven, preventing retroactive rationalization.
  • Examination Methodology:
    • Examinations require students to commit to a specific multiple-choice answer before disclosing the correct key.
    • Disclosing answers prematurely triggers hindsight bias, convincing students they "knew" the correct answer for all 5050 questions.
    • Mandatory commitment forces accurate self-assessment regarding study effectiveness and conceptual mistakes.

Overconfidence Bias and Scientific Humility

  • Definition: Overconfidence bias is the systematic tendency to overestimate one's knowledge, skills, or capabilities relative to objective reality ("thinking we know more than we do"\text{"thinking we know more than we do"} or "thinking we are better than we are"\text{"thinking we are better than we are"}).
  • Driving Ability Study:
    • Over 80%80\% of surveyed individuals rate their driving ability as "above average".
    • Statistical Impossibility: It is mathematically impossible for 80%80\% of drivers to perform above average. Objective evaluators (such as passengers or the Department of Motor Vehicles / DMV) provide far more accurate assessments.
  • Anagram Performance:
    • Individuals presented with an anagram alongside its solved key overestimate how rapidly they could have solved the anagram unassisted.
  • Relationship Between Confidence and Mistake Costs:
    • Higher overconfidence directly correlates with an increased likelihood and magnitude of costly mistakes.
  • Scientific Humility and Provisional Truth:
    • Science serves to humble individuals by emphasizing the vast scope of unknown phenomena.
    • Scientific statements represent provisional truth—the best available model of reality based on current evidence—subject to modification when superior empirical data emerges.
    • Absolute 100%100\% certainty in any claim should be approached with skepticism.
  • Everyday Manifestations of Overconfidence:
    • Navigation: Refusing to admit being lost while driving, preferring to drive around blocks repeatedly rather than admitting error.
    • Study Planning: Overestimating personal study efficiency and leaving exam preparation for the final day, leaving no margin for unexpected disruptions.
    • Risk Miscalculation: Attempting high-risk physical stunts (e.g., wearing a helmet while attempting an extreme jump) due to overflowing optimism unaligned with physical realities.
  • Drawing Valid Conclusions: Science requires drawing conclusions strictly from carefully collected, verifiable data rather than relying on personal anecdotes, intuition, legend, family advice, or cultural traditions.

Questions and Audience Dialogue

  • Question: How is phrenology categorized from a modern scientific standpoint?
    • Response: It is primitive and categorized as pseudoscience (fake science presented as authoritative material).
  • Question: What is the operational definition of intuition from a personal standpoint?
    • Response: Intuition is defined as an inner voice or the best guess an individual can make given everything they know under time constraints.
  • Question: What is the actual mathematical probability of correctly predicting a baby's biological sex prior to birth without medical diagnostics?
    • Response: The probability is exactly fifty-fifty (50%50\% or 50/5050/50).