Ch 4

Historical Foundations of Cortical Visual Mapping

  • Early Insights from Brain Damage Studies
    • Historical understanding of localized brain function in vision originated from clinical case observations of head trauma.
    • Japanese physician Tatsuji Inouye (1904–1905) studied soldiers who survived occipital gunshot wounds during the Russo-Japanese War.
    • Inouye demonstrated a direct spatial correlation between the anatomical site of cortical injury and the specific region of visual field loss.
    • Wounds situated in the right cerebral hemisphere resulted in visual field deficits on the left side (contralateral field), and vice versa.
    • These clinical findings established two fundamental principles of visual neuroscience:
    • Functional Localization: The posterior region of the brain (occipital lobe) is dedicated to processing visual input.
    • Spatial Organization: Visual space maps systematically onto cortical tissue (retinotopic mapping).

Visual Pathway: From Retina to Visual Cortex

  • Anatomical Route from Eye to Brain

    • Visual processing begins with transduction at the retina, after which action potentials propagate along the axons of retinal ganglion cells forming the optic nerve.
    • Axons from both eyes converge at the optic chiasm, an X-shaped bundle of nerve fibers located on the underside of the brain.
    • Contralateral Organization:
    • At the optic chiasm, optic nerve fibers originating from the nasal hemiretinas cross over to the opposite hemisphere, whereas temporal hemiretinal fibers remain ipsilateral.
    • The functional result is that visual information from the right visual field (everything to the right of the central fixation point) is routed exclusively to the left cerebral hemisphere.
    • Visual information from the left visual field (everything to the left of fixation) is routed exclusively to the right cerebral hemisphere.
    • Each eye independently views portions of both left and right visual fields.
    • Subcortical Projections:
    • Approximately 90%90\% of retinal ganglion cell axons terminate in the lateral geniculate nucleus (LGN), situated within the thalamus of each hemisphere.
    • Approximately 10%10\% of retinal ganglion cell axons project to the superior colliculus, a midbrain structure responsible for controlling eye movements and spatial orienting.
    • The thalamus serves as a sensory relay station, filtering and modulating information before sending it to cerebral structures.

  • The Lateral Geniculate Nucleus (LGN)

    • Neurons in the LGN exhibit center-surround receptive fields, virtually identical to the receptive field organization found in retinal ganglion cells.
    • Functional Roles of the LGN:
    • Gating and Regulation: The neural signal output leaving the LGN toward the cortex is quantitatively smaller than the total sensory input received from the retina, indicating that the LGN regulates and dampens neural information flow.
    • Feedback Integration: The LGN receives a greater volume of descending, top-down neural projections (feedback) from the visual cortex than ascending projections (feedforward) from the retina. This feedback mechanism allows higher cortical centers to select and modulate incoming visual signals.

  • Primary Visual Cortex (Area V1 / Striate Cortex)

    • From the LGN, visual signals travel directly to the primary visual receiving area in the occipital lobe.
    • Terminology for this region:
    • Striate Cortex: Named for its striped microscopic appearance in cross-section (Stria of Gennari).
    • Area V1: Indicates that it is the primary and first visual cortical processing area.

Receptive Field Properties in the Visual System

  • Methodology for Mapping Receptive Fields

    • Nobel Laureates David Hubel and Thorsten Wiesel (1981 Nobel Prize in Physiology and Medicine) systematically decoded receptive field organization along the visual pathway.
    • Experimental Setup:
    • Anesthetized animals (cats or monkeys) were fitted with corrective lenses to focus their eyes onto an external projection screen.
    • Light stimuli (spots, bars, edges) were projected onto the screen while recording single-unit electrical activity from specific visual neurons.
    • Because the eye remains stationary, each specific visual coordinate on the projection screen corresponds precisely to a specific anatomical coordinate on the retina.
    • Universal Receptive Field Principle: Regardless of where in the brain a recording electrode is placed (retina, LGN, visual cortex, or temporal cortex), a neuron's receptive field is always located on the sensory receptor surface (the retina).

  • Cortical Neuron Types and Selective Responses

    • Simple Cortical Cells:
    • Feature excitatory and inhibitory regions arranged side-by-side rather than in a concentric center-surround configuration.
    • Respond maximally to stationary bars of light, lines, or oriented edges falling precisely within their excitatory zones.
    • Display orientation selectivity, quantified by an orientation tuning curve. A simple cell preferring a vertical bar (0degrees0^\text{degrees}) fires maximally (e.g., 25 impulses/second25\,\text{impulses/second}) to vertical stimuli; firing rate declines rapidly as the bar is rotated away from vertical (e.g., displaying minimal response at a 20degrees20^\text{degrees} tilt).
    • Complex Cortical Cells:
    • Discovered accidentally when the shadow edge of a projector glass slide moving downward triggered intense neural firing in a visual cortex cell.
    • Respond maximally to moving bars of light possessing a specific spatial orientation across the cell's entire receptive field.
    • Most complex cells exhibit directional selectivity, firing robustly only when the correctly oriented bar moves in a specific direction (e.g., left-to-right) across the receptive field, and showing no firing for opposite or stationary movements.
    • End-Stopped Cortical Cells:
    • Respond maximally to moving lines of a specific length, corners, angles, or moving edges.
    • Firing rate diminishes or disappears completely if a stimulus line extends beyond the boundaries of the receptive field (length-stopped suppression).
    • Feature Detectors: Simple, complex, and end-stopped cortical cells are collective classifications termed feature detectors, as each selectively fires in response to specific elemental features of visual stimuli (orientation, length, motion direction, corners).

Feature Detectors and Their Role in Perception

  • Selective Adaptation

    • Prolonged visual exposure to a stimulus featuring a specific property (e.g., orientation) causes continuous firing of tuned feature detectors, resulting in neural fatigue or adaptation.
    • Physiological Effects of Adaptation:
    • Reduction in the neuron's maximum firing rate.
    • Reduced neural response upon immediate subsequent re-exposure to the adapting stimulus orientation.
    • Psychophysical Measurement Protocol:
    • Step 1: Measure baseline contrast threshold for visual gratings across multiple orientations. Contrast threshold is defined as the minimum luminance difference between dark and light bars required for an observer to detect the grating pattern.
    • Step 2: Adapt the observer by having them view a high-contrast adapting grating (e.g., vertical lines) for 1 to 2 minutes1\text{ to } 2\,\text{minutes}.
    • Step 3: Remeasure contrast thresholds across all test orientations.
    • Experimental Findings:
    • Selective adaptation causes a dramatic increase in contrast threshold (selective loss of sensitivity) specifically centered at the adapting orientation (e.g., vertical).
    • Contrast thresholds for orientations tilted far away from the adapting orientation remain unaffected.
    • The psychophysically derived selective adaptation curve closely mirrors the single-unit orientation tuning curve of cortical simple cells, providing causal evidence that cortical feature detectors underlie human orientation perception.

  • Selective Rearing and Experience-Dependent Plasticity

    • Neural Plasticity (Experience-Dependent Plasticity): The biological phenomenon wherein the response properties of cortical neurons are structural and functionally shaped by an organism's environmental visual exposure.
    • Short-term exposure to a visual feature induces selective adaptation (fatigue), whereas long-term developmental exposure during critical periods induces selective rearing (structural rewiring).
    • Blakemore and Cooper (1970) Selective Rearing Experiment:
    • Neonatal kittens were kept in total darkness from birth until 2 weeks2\,\text{weeks} of age.
    • From 2 weeks2\,\text{weeks} to 5 months5\,\text{months}, kittens were placed for 5 hours/day5\,\text{hours/day} inside cylindrical tubes painted exclusively with high-contrast stripes of a single orientation (either purely vertical or purely horizontal).
    • Kittens stood on a central Plexiglas platform in a seamless tube with no visible corners or edges and wore neck collars to prevent head tilting.
    • Behavioral Outcomes: Behaviorally tested at 5 months5\,\text{months}, vertically reared kittens tracked vertical rods and completely ignored horizontal visual stimuli, displaying functional blindness to unexposed orientations.
    • Neurophysiological Findings: Single-unit recordings from V1 simple cells revealed that vertically reared cats possessed cortical cells tuned almost exclusively to vertical or near-vertical orientations, with zero recorded cells tuned to horizontal orientations. Unused orientation channels were permanently lost or converted.

  • The Oblique Effect

    • Human psychophysical testing reveals superior visual acuity and contrast sensitivity for horizontal (0degrees0^\text{degrees}) and vertical (90degrees90^\text{degrees}) orientations compared to oblique (slanted) orientations.
    • Functional brain imaging demonstrates that the human visual cortex generates significantly larger physiological responses when processing vertical and horizontal orientations than oblique orientations, reflecting evolutionary and environmental statistical distributions.

Spatial Organization and Cortical Architecture

  • The Retinotopic Map and Cortical Magnification

    • Retinotopic Mapping: Adjacent visual spatial coordinates on the retinal image project to adjacent anatomical locus coordinates within primary visual cortex (V1).
    • Cortical Magnification: The anatomical allocation of visual cortical surface area is severely distorted relative to retinal surface area.
    • The central fovea accounts for approximately 0.01%0.01\% of total retinal surface area.
    • Signals originating from the fovea map onto 8% to 10%8\%\text{ to } 10\% of the total surface area of primary visual cortex (V1).
    • fMRI Demonstration (Dougherty et al., 2003):
    • Presentation of small visual stimuli illuminating retinal areas immediately adjacent to the central fovea activates a large anatomical swath of visual cortex (magnified region).
    • Presentation of larger stimuli positioned far in the peripheral visual field activates a comparatively tiny anatomical surface region of visual cortex.
    • Functional Purpose: Cortical magnification allocates massive neural processing capacity to central vision, providing the elevated spatial resolving power required for fine-detail perceptual tasks such as reading, without expanding physical visual perception size.

  • Columnar Architecture of V1

    • Location Columns:
    • Microelectrode penetrations inserted strictly perpendicular to the cortical surface encounter visual neurons whose receptive fields all overlap at the exact same spatial location on the retina.
    • Orientation Columns:
    • Perpendicular electrode penetrations encounter neurons that all share identical preferred stimulus orientations (e.g., all cells fire maximally to horizontal lines).
    • Oblique electrode penetrations (cutting diagonally across cortical layers) reveal a continuous, orderly shift in preferred orientation. Preferred orientation shifts systematically by approximately 5degrees5^\text{degrees} per adjacent column.
    • Advancing an electrode across 1 mm1\,\text{mm} of cortical tissue traverses a complete spectrum (180degrees180^\text{degrees}) of orientation preferences.
    • Hypercolumns:
    • A hypercolumn is a functional processing block of visual cortex measuring approximately 1 mm1\,\text{mm} in width.
    • Each hypercolumn contains a single complete location column, a full set of orientation columns representing all 180degrees180^\text{degrees} of orientation space for that specific retinal locus, and two ocular dominance columns (dedicated sub-units responding preferentially to input from either the left eye or the right eye).
    • Tiling:
    • The entire visual field is completely covered by an array of adjacent and overlapping location columns/hypercolumns, creating a continuous grid-like mosaic that fully processes visual space.
    • Scene Representation in V1:
    • A continuous real-world visual object (e.g., a vertical tree trunk) is broken down in V1 into separate activations across distinct location columns, specifically exciting the 90degrees90^\text{degrees} orientation columns within each corresponding hypercolumn.
    • Cortical visual representation does not visually mirror external stimuli; it consists of distributed spatial code.

Dual Visual Streams: What, Where, and How

  • Extrastriate Visual Hierarchy

    • Signals propagate from V1 (striate cortex) into extrastriate visual cortical regions named V2, V3, V4, and V5 (MT).
    • As visual signals ascend this cortical processing hierarchy, neuronal receptive field sizes grow progressively larger, integrating elemental line orientations into complex visual patterns, motion vectors, visual colors, and object structures.

  • Ventral and Dorsal Visual Streams (Ungerleider and Mishkin, 1982)

    • Experimental Methodology: Brain Ablation (Lesioning):
    • Involves pre-testing animal behavioral baseline performance, surgically or chemically destroying a target brain region, and re-testing behavior post-lesion to isolate functional localization.
    • Behavioral Tasks in Rhesus Monkeys:
    • Object Discrimination Task: Monkeys are presented with a target object (e.g., a rectangular block) and a distractor (e.g., a triangular block). Selecting the correct target yields a food reward concealed in a well underneath.
    • Landmark Discrimination Task: Monkeys must choose the food well located closest to an external spatial landmark (e.g., a tall cylinder).
    • Ablation Results and Stream Identification:
    • Ablation of the inferior temporal lobe severely impaired performance on the Object Discrimination task while leaving Landmark Discrimination intact. Established the **Ventral Stream (