Notes on Sampling, Experimental Design, Operational Definitions, and Historical Neuroscience

Sampling and Biases

  • You cannot study the entire population; you study a sample instead.
  • Types of samples and their impact on validity:
    • Random sampling (gold standard) – every member of the population has an equal chance of selection; maximizes representativeness.
    • Convenience sampling – often used in practice; representative convenience samples are common; cross-cultural samples when relevant.
  • Biases in research:
    • Subject biases you can control with methods like blinding.
    • Single-blind vs double-blind designs.
    • Some biases cannot be eliminated entirely; recognize their potential impact.
  • Practical example of subject bias in reaction-time experiments:
    • If you test a mixed group (e.g., ADHD vs non-ADHD) and ADHD individuals are slower due to ADHD symptoms, you might incorrectly attribute slower reaction time to the experimental manipulation rather than the ADHD condition.
    • This can create a false difference between groups if not properly controlled.
  • Random assignment (critical for experiments):
    • Definition: each person in the sample has an equal opportunity to be placed in any condition (e.g., control vs treatment).
    • Purpose: to equalize individual differences that could bias results, including conditions like ADHD. If groups are balanced on such traits, observed differences more likely reflect the manipulation.
    • Formal notion (simple case): if there are k conditions, then for each participant, the probability of assignment to a given condition is P( ext{assignment to a given condition}) = rac{1}{k}.
    • Consequence: increases internal validity by reducing confounds from participant differences.
  • Pros and Cons of experimental design
    • Pros:
    • Massive control of extraneous variables to support causal claims (i.e., IV causes DV).
    • High internal validity due to control of confounds.
    • Cons (trade-offs):
    • External validity/generalizability may suffer because lab conditions are highly controlled, contrived, and artificial.
    • Resource-intensive: cost of participants, equipment, and dedicated lab space.
    • Time-consuming: may require many trials and long participation times for data collection.
    • Costs can range from a few thousand to millions of dollars (e.g., brain-scanning facilities).
  • Generalizability and applicability
    • Observational studies tend to have better external validity than tightly controlled experiments.
    • External validity relates to the ability to generalize results to different groups or situations.
    • Applicability is the real-world applicability of findings.
    • Lab vs field example: a reading technique study showed a lab result where a new method improved reading scores, but real-world implementation without one-on-one attention failed to replicate the effect.
    • Key takeaway: lab results may not generalize due to confounds; scientists often start with a lab study (internal validity) and then perform observational/field studies to test applicability/generalizability.
  • Observational vs Experimental progression
    • Researchers may begin with a lab experiment (high internal validity) and follow up with observational work to assess generalizability.
    • The balance between internal and external validity is a core methodological consideration.
  • The problem of operationalizing variables
    • Conceptual vs operational definition:
    • Conceptual: broad idea (e.g., aggression, anxiety).
    • Operational: concrete procedures to measure the concept (how you quantify aggression).
    • Why operational definitions matter:
    • They determine what you actually measure and how you interpret results.
    • Different operational definitions can yield different conclusions for the same concept.
    • Examples of operational definitions for aggression:
    • Physical: count the number of hits a child makes.
    • Verbal: count aggressive utterances or derogatory statements.
    • Instrument-based: use validated scales (surveys) to measure aggression as a constructed score.
    • Problems with scales and validity:
    • Scales are valid operational definitions when they measure the intended construct; but validity depends on the construct alignment.
    • Self-esteem example: trait, state, and domain self-esteem are distinct constructs; using a domain self-esteem scale to measure trait self-esteem can invalidate results because you’re not measuring the intended construct.
    • How to choose operational definitions:
    • Look to past research for established definitions and measures when possible.
    • If new, conduct thorough development and validation, which can be time-consuming.
  • Operational definition practice and exam-style example
    • Question format in class: which option is a good operational definition for anxiety?
    • Conceptual definitions (a, b, d) describe anxiety but do not specify measurement.
    • Operational definition (c) provides a measurable method (e.g., a PRSS score on a scale of anxiety).
    • Correct answer highlights the importance of specifying measurement procedures, not just conceptual meaning.
  • The sledgehammer effect
    • Definition: when a manipulation appears to have an effect at a higher dose/level, regardless of real-world applicability, leading to inflated or non-generalizable conclusions.
    • Example domain: THC/memory studies in the late 1960s–early 1970s using very high doses in animals; results showed strong effects that did not translate to realistic human use.
    • Consequences: high internal validity but poor external validity; results may not generalize to real-world conditions or developing brains.
  • Real-world relevance
    • Understanding these concepts helps researchers design studies that balance internal validity (causal inference) with external validity (generalizability) and applicability (real-world usefulness).
  • Connections to practice
    • When planning research, consider: sample type, random assignment, potential biases, control of extraneous variables, and the intended generalizability of findings.
    • Prioritize establishing strong internal validity first, then assess external validity and applicability with observational or field studies.

Historical perspective on neuroscience and brain biology in psychology

  • Franz Joseph Gall and phrenology
    • Phrenology posited that bumps on the skull reflect underlying brain regions and associated mental faculties or disorders.
    • Gall suggested specific skull areas correspond to distinct psychological traits (e.g., anxiety, mood).
    • Notable practice included readings at places like the Perkins School for the Blind; e.g., Helen Keller was examined by Gall.
    • Outcome: phrenology was discredited, but it contributed a crucial idea: localization of function (different brain regions support different functions).
  • Pierre Flourens and surgical ablation
    • Flourens conducted early lesion studies by destroying brain areas (initially externally, then surgically) in animals (pigeons) to observe deficits.
    • He demonstrated that lesions in different brain areas produced different deficits, which supported the idea of localization of function and refuted strong versions of phrenology.
    • Legacy: established a systematic approach to linking brain regions with specific functions through controlled ablation studies.
  • Camillo Golgi and the Golgi stain (black reaction)
    • Golgi developed a staining method (the Golgi stain) that revealed detailed structures of individual neurons, enabling microscopic study of brain cells.
    • This stain led to the reticular theory: the brain is a continuous network where neurons function as a single, interconnected tissue.
    • This view argued against discrete, individual neurons as functional units.
  • Santiago Ramón y Cajal and neuron doctrine
    • Cajal used Golgi’s stain to document neuron structure and argued against the reticular theory.
    • He proposed the neuron doctrine: neurons are discrete cells that communicate by contact, not as a continuous syncytial net.
    • Key claims:
    • Neurons are polarized; information typically flows in one direction (from dendrites to axon).
    • Neurons may operate as independent units or networks rather than as a single continuous tissue.
    • Result: Cajal and Golgi shared the Nobel Prize in 1906 but continued to debate until their deaths; Cajal championed localization and neuron specificity.
  • Camillo Golgi vs. Ramon y Cajal debate and the neural doctrine
    • The debate highlighted two major questions in neuroscience:
    • Are brain functions localized to specific neurons and regions or distributed across the brain?
    • Do neurons communicate via discrete synapses rather than a continuous network?
    • The eventual consensus supported the neuron doctrine and localization of function, while acknowledging complex network interactions.
  • Brodmann and cytoarchitecture
    • Karl (Korbinian) Brodmann mapped the brain based on cytoarchitecture: the cellular composition of brain regions.
    • He identified distinct areas with similar cell types and organization; neighboring regions showed differences in cellular makeup.
    • Brodmann mapped many regions; his map remains foundational in neuroscience and neuropsychology.
    • Practical takeaway: Brodmann areas (e.g., areas 17, 18, 19) are associated with visual perception and processing.
  • Neuropsychology and classic lesion studies: Broca and Wernicke
    • Neuropsychology studies brain damage and its behavioral consequences to infer function.
    • Broca’s patient (left frontal region) showed nonfluent speech; Wernicke’s patient (left temporal region) showed fluent but nonsensical speech.
    • Post-mortem examination revealed different damaged areas corresponding to distinct language deficits.
    • Impact: demonstrated clear localization of language functions in the human brain and laid the groundwork for clinical neuropsychology.
  • Synthesis: trajectory from speculative to empirical brain science
    • Early ideas (phrenology) overstated localization through skull readings and lacked empirical support.
    • Flourens’ ablation experiments introduced systematic localization concepts but remained limited to animal models.
    • Golgi’s staining opened the door to cellular-level brain study, while Cajal’s neuron doctrine advanced our understanding of unitary neuronal function and signaling.
    • Brodmann’s cytoarchitectural map provided a practical catalog of brain areas.
    • Broca and Wernicke connected specific brain regions to language, demonstrating the real-world relevance of localization.
  • Practical implications for psychology today
    • The brain is organized with specialized regions, but behavioral outcomes depend on distributed networks and interactions.
    • Neuropsychology bridges biological brain structures with observable behaviors, supporting evidence-based interpretations of cognitive functions.
  • Summary takeaway
    • The historical progression shows a shift from speculative, broad claims about brain regions to precise, evidence-based localization and anatomy-based inferences about function.
    • Understanding these historical milestones helps contextualize contemporary approaches in cognitive neuroscience and psychology.

Quick synthesis and study prompts

  • Key concepts to remember:
    • Population vs sample; random vs convenience sampling; cross-cultural sampling.
    • Bias types; single-blind and double-blind designs; random assignment as a bias-control strategy.
    • Internal validity vs external validity; generalizability vs applicability.
    • Observational studies vs experiments; when to use each.
    • Operational definitions and the importance of measurement specificity and validity.
    • The sledgehammer effect and its implications for design and interpretation.
    • History of neuroscience: phrenology, Flourens, Golgi, Cajal, Brodmann, Broca, and Wernicke.
  • Exam-style reminders:
    • Distinguish conceptual definitions from operational definitions.
    • Recognize how the chosen operational definition can shape results and conclusions.
    • Be able to explain why random assignment improves internal validity and what its limitations are.
    • Explain why lab results may fail to generalize to real-world settings (external validity and applicability).
    • Identify the major findings of Broca and Wernicke and how they illustrate localization of language function.
  • Suggested memory anchors:
    • GFC: Gall (phrenology) → Flourens (ablation) → Golgi (stain) → Cajal (neuron doctrine) → Brodmann (cytoarchitecture) → Broca/Wernicke (neuropsychology).
  • Real-world relevance:
    • When evaluating studies, consider how sampling, design, and measurement choices influence the strength and applicability of conclusions.
  • Practice question recap:
    • Operational definitions provide measurable procedures; conceptual definitions describe ideas without measurement.
    • In aggression research, the operational choice (hits vs verbal aggression vs scales) can lead to different interpretations; choose definitions carefully based on the research question and prior literature.