Comprehensive Study Notes on Sensation, Perception, and Signal Detection Theory

Signal Detection Theory: Fundamental Principles and Outcomes

• Decision Making Under Uncertainty: Dr. Jardin defines Signal Detection Theory as the study of how decisions are made when only two possible choices exist. These decisions are judgments regarding the presence or absence of a stimulus against a background of "noise."

• The Pay-off Matrix: There are four possible outcomes based on the actual stimulus presence and the observer's decision:

  • Hit: Occurs when a signal is present and the observer correctly identifies it (e.g., a spam filter identifies an actual spam email, or a TSA agent identifies a genuine threat).

  • Miss: Occurs when a signal is present but the observer fails to identify it (e.g., a good email is accidentally sent to the spam folder, or a TSA agent fails to detect a person carrying a dangerous object).

  • Correct Rejection: Occurs when no signal is present and the observer correctly identifies its absence (e.g., an algorithm recognizes an email is not spam and lets it to the inbox; or an airport security check identifies that a passenger is not a threat).

  • False Alarm: Occurs when no signal is present, but the observer incorrectly reports one (e.g., spam makes its way into the inbox, or a TSA agent detains someone who is not carrying anything dangerous).

• Factors Influencing Detection:

  • Sensory Process: The inherent sensitivity of the observer to the stimulus.

  • Decision Process (Response Bias): The internal readiness or threshold of the observer to report a detection.

  • Fatigue and Attention: Prolonged periods of making yes/no decisions can tax the attentional system, making signal detection more difficult over time.

Basic Principles of Sensation and Perception

• Sensation vs. Perception Definitions:

  • Sensation: The process by which sense organs gather information from the environment and transmit it to the brain for initial processing.

  • Perception: The process by which the brain selects, organizes, and interprets these sensations to experience objects or events with form, order, and meaning.

• Key Principles:

  • Lack of One-to-One Correspondence: The mind does not directly reproduce the physical world like a photograph. The relationship is orderly and mathematical, but translated.

  • Active Processes: Sensation involves active orientation toward stimuli, and perception is a creative, constructive effort to mentalize the "phenomenological world" (the world as subjectively experienced).

  • Adaptive Nature: Senses evolved over millions of years. Examples include "bug detectors" in frog visual systems or the innate human tendency to attend to face-like forms.

• Transduction: The first step of sensation. It is the conversion of external energy (light, sound waves, physical pressure) into electrochemical signals (neural impulses/action potentials).

• Neural Coding: The brain interprets intensity and quality through neural codes.

  • Intensity: Coded by the number of neurons firing, the frequency of firing, or both.

  • Quality: Coded by the specific type of receptors and the pattern of impulses (e.g., different receptors for warmth vs. cold).

• Miller’s Doctrine of Specific Nerve Energies (1826): Proposed that the nature of sensation depends on which neurons are excited, rather than the stimulus itself. Modern biology confirms this; experience depends on the specific brain pathways activated.

Psychophysics: Measuring Thresholds and Intensity

• Absolute Threshold: The minimum amount of energy required to sense a stimulus $50\,\%$ of the time. Examples include:

  • Hearing: A watch ticking at $6\,m$ in quiet.

  • Vision: A candle flame at $50\,km$ on a dark, clear night.

  • Smell: One drop of perfume in a large house.

  • Taste: One teaspoon of sugar in $4\,L$ of water.

  • Touch: A fly wing falling on a cheek from a distance of $1\,cm$.

• Difference Threshold (Just Noticeable Difference/JND): The lowest level of stimulation required to sense a change.

  • Weber's Law: The second stimulus must differ by a constant proportion (Weber fraction) to be perceived as different. (e.g., $1/50$ for heaviness, $1/10$ for pitch at Middle C).

  • Fechner's Law: Subjective intensity ($S$) grows arithmetically while objective intensity ($I$) grows geometrically. Formula: $S = k \cdot \ln(I)$.

  • Stevens' Power Law: Perceived intensity grows as a power of actual magnitude. For brightness, the exponent is $0.33$; for electric shock, it is $3.5$.

• Sensory Adaptation: The tendency of receptors to respond less to unchanging stimuli, preventing the brain from being overwhelmed by redundant data. The visual system avoids total adaptation through tiny, quivering eye motions.

• Subliminal Perception: Perception below conscious awareness. Studies show subliminal cues can influence memory and rational decision-making.

Vision: The Stimulus of Light and Eye Anatomy

• Nature of Light: Electromagnetic radiation moving in waves (and sometimes particles).

  • Wavelength: The distance from one peak to another; determines the psychological experience of color (hue).

  • Amplitude: The height of the wave; determines the psychological experience of brightness (intensity).

  • Visible Spectrum: Humans discern a narrow band between approximately $400\,nm$ and $750\,nm$ (or $700\,nm$ in some readings).

  • Comparative Biology: Bees see ultraviolet light ($300\,nm$ to $700\,nm$), uncovering hidden patterns in flowers that guide them to pollen.

• Anatomy of the Human Eye:

  • Cornea: Tough, transparent tissue covering the front that refracts/focuses light.

  • Aqueous Humour: Clear fluid behind the cornea.

  • Iris and Pupil: The iris is a pigmented muscle that expands or contracts to control light entry. Dilation (darkness/arousal) and constriction (bright light) are managed by the "pupillary response."

  • Lens: Performs accommodation (rounding for near objects, flattening for distance) to focus light on the retina.

  • Retina: Light-sensitive tissue at the back of the eye. It is roughly the thickness of a single sheet of paper and contains several layers of cells.

  • Fovea: Small central region of the retina densely packed with cones; the site of sharpest vision and detailed color representation.

  • Optic Disc (Blind Spot): The area where the optic nerve leaves the eye; it lacks receptors.

Photoreceptors and Retinal Processing

• Rods vs. Cones:

  • Rods: Approximately $120$ million. Rod-like shape. High sensitivity to light; used for low-light/nocturnal vision. Cannot distinguish color (results in black/white vision). Concentrated in the periphery.

  • Cones: Approximately $8$ million. Pointed shape. Require bright light. Responsible for color vision and high visual acuity (sharpness). Concentrated in the fovea.

• Types of Cones (Trichromatic Theory):

  1. Short-Wavelength (Blue) Cones: Maximally sensitive to $424$-$440\,nm$.

  2. Middle-Wavelength (Green) Cones: Maximally sensitive to $534$-$545\,nm$.

  3. Long-Wavelength (Red) Cones: Maximally sensitive to $564$-$580\,nm$.

• Neural Layers of the Retina: Structure is "inverted"—light must pass through blood vessels and fluid to reach the innermost layer.

  1. Photoreceptors: Rods and cones transduce light into electrical signals.

  2. Bipolar Cells: Responding to receptors, they integrate information from multiple rods/cones.

  3. Ganglion Cells: Reached by bipolar cells; their axons form the Optic Nerve, which carries information to the brain.

• Nocturnal Adaptations: While diurnal animals (humans) have a Pigmented Epithelium to absorb stray photons and ensure crisp vision, nocturnal animals (cats/dogs) have a Reflecting Tapetum (Tapetum Lucidum). This membrane bounces photons back through receptors for a second chance at absorption, increasing night sensitivity at the cost of visual acuity.

Advanced Theories of Vision and Color

• Young-Helmholtz (Trichromatic) Theory: Proposes that the eye contains three types of receptors (red, green, blue) whose outputs are mixed to create all perceived colors. This accurately describes processing at the retinal level.

• Opponent-Process Theory: Proposed by Herring to explain after-images. It suggests three antagonistic systems: Black-White, Blue-Yellow, and Red-Green. Staring at one color (e.g., yellow) fatigues that part of the system; removing it causes the perception of the opposite color (e.g., blue). This applies to later stages of processing in the brain's visual centers.

• Visual Pathways:

  • Optic Chiasm: Where optic nerves cross (right visual field to left hemisphere).

  • Lateral Geniculate Nucleus (LGN): Thalamic nucleus that maps visual space.

  • Primary Visual Cortex (Striate Cortex): Contains feature detectors (Simple, Complex, and Hypercomplex cells).

  • The "What" Pathway: Inferior temporal cortex; identification of objects and colors. Damage results in Prosopagnosia (facial blindness).

  • The "Where" Pathway: Parietal lobes; locating objects and motion tracking. Damage results in Visual Neglect.

Audition: The Mechanics of Hearing

• Nature of Sound: Vibrations in air molecules traveling at $340\,m/s$.

  • Frequency (Hertz/Hz): Experienced as pitch ($15$-$20,000\,Hz$ for humans).

  • Amplitude (Decibels/dB): Experienced as loudness (>90\,dB causes damage, >130\,dB is painful).

  • Complexity: Experienced as timbre (texture).

• Ear Anatomy:

  • Outer Ear: Pinna and auditory canal.

  • Middle Ear: Tympanic membrane (eardrum) and ossicles (Malleus/hammer, Incus/anvil, Stapes/stirrup). The stapes strikes the oval window.

  • Inner Ear: Cochlea containing the Basilar Membrane and Hair Cells (receptors) within the Organ of Corti.

• Pitch Perception Theories:

  • Place Theory: Different areas of the basilar membrane respond to different frequencies (efficient for high frequencies).

  • Frequency Theory: The rate of neural firing matches the sound frequency (efficient for low frequencies).

  • Sound Localization: Binaural neurons detect differences in loudness and arrival timing between the two ears.

Other Senses and Perceptual Organization

• Chemical Senses:

  • Olfaction (Smell): Transduction in the olfactory epithelium. It is the only sense that bypasses the thalamus, projecting directly to the olfactory bulbs and cortex.

  • Gustation (Taste): Receptors in tastebuds. Four basic tastes: sweet, sour, salty, bitter.

• Skin Senses and Pain:

  • Gate-control theory: Large A-fibers (fast pain) can close spinal gates, while small C-fibers (slow pain) transmit it.

  • Phantom Limbs: Caused by reorganization of the somatosensory cortex.

• Proprioception:

  • Vestibular Sense: Sensed in the inner ear (semicircular canals) to determine gravity and balance.

  • Kinaesthesia: Receptors in joints and muscles providing limb position data.

• Perceptual Organization:

  • Gestalt Principles: Figure-ground, Similarity, Proximity, Good Continuation, Simplicity, and Closure.

  • Recognition-by-Components: Biederman’s theory that objects are identified via 20-30 geometric primitives called Geons.

  • Depth Perception: Binocular cues (convergence, retinal disparity) and monocular cues (interposition, linear perspective, motion parallax, etc.).

  • Perceptual Constancy: Stability in size, color, and shape despite changes in sensory input.

  • Bottom-up vs. Top-down: Bottom-up starts with raw data; Top-down starts with expectations/knowledge (perceptual set).