Comprehensive Study Guide: Classical Conditioning Principles and Mathematical Models

Factors Influencing Stimulus Effectiveness in Classical Conditioning

• Stimulus Novelty and Pre-Exposure Effects:

  • Pre-exposure to either a conditioned stimulus (CS) or an unconditioned stimulus (US) prior to conditioning trials retards the rate of subsequent learning.

  • Latent Inhibition Effect (CS-Preexposure Effect): Repeated presentation of a neutral stimulus alone prior to pairing it with a US causes slower development of conditioning or blocks learning entirely.

    • Mechanistic Explanations: Habituation processes lead the organism to categorize the repeatedly presented CS as irrelevant, reducing attentional allocation during subsequent conditioning.

    • Experimental Demonstration: Subjects pre-exposed to a tone display reduced fear responses when that tone is later conditioned to a shock compared to non-pre-exposed controls.

    *   *Autoshaping Example*: Pre-exposure to an extending lever mechanism reduces subsequent lever-pressing autoshaping performance when lever extension is paired with food delivery.

*   **US-Preexposure Effect**: Prior non-contingent presentations of a US impede subsequent CS-US associative learning.
    *   *Context Blocking Hypothesis*: Environmental contextual cues present during US pre-exposure acquire excitatory associative strength ($V$), which subsequently blocks conditioning to a novel CS.
    *   *Unpredictability Hypothesis*: Exposure to unsignaled US events leads organisms to encode the US as unpredictable (analogous to random natural phenomena like earthquakes), impairing the capacity of future predictive cues to acquire associative control.

• Stimulus Salience:

  • More perceptible or intense stimuli serve as more effective CSs and USs due to heightened attentional processing.

  • Overshadowing Effect: When a compound stimulus consisting of two CSs of unequal salience ($A$ and $X$, where $A$ is more salient than $X$) is paired with a US ($AX \rightarrow \text{US}$), the more salient stimulus $A$ acquires primary associative strength, yielding a weak conditioned response (cr) to $X$ tested alone compared to control acquisition ($X \rightarrow \text{US}$ yielding CR).

• Ecological Relevance and Naturalistic CSs:

  • Conditioning efficacy increases when artificial CSs are replaced with naturalistic stimuli relevant to an organism's ecological niche.

  • Sexual Behavior Conditioning in Quail: In male Japanese quail, pairings of a naturalistic taxidermic female head cue with access to a female mate elicit significantly stronger conditioned sexual behaviors (approaches, grabs, mounts, and cloacal contacts) than non-naturalistic or partial cues.

• CS-US Relevance (Belongingness) and Evolutionary Adaptation:

  • Selective associations form rapidly when the perceptual modality of the CS aligns biologically with the physiological nature of the US.

  • The Garcia Effect (Garcia & Koelling, 1966):

    • Rats conditioned with a compound CS (saccharin Taste + Audiovisual "bright noisy water") paired with Sickness (radiation/lithium chloride) develop strong aversion to Taste but not Audiovisual cues.

    • Rats conditioned with the same compound CS paired with Painful Shock develop strong aversion to Audiovisual cues but not Taste.

*   *Evolutionary Primate Predispositions*: Fear conditioning to evolutionary threat stimuli (such as visual cues of snakes) develops faster and persists longer in humans and primates than conditioning to neutral stimuli (such as pictures of flowers or mushrooms). Children as young as 3 years old locate hidden snake images significantly faster than non-threat objects.

Classical Conditioning Without Direct Unconditioned Stimuli

• First-Order versus Higher-Order Conditioning:

  • First-Order Conditioning: Direct pairing of a neutral stimulus ($\text{CS}_1$) with a primary unconditioned stimulus (US) that possesses intrinsic biological strength (such as food or pain).

  • Higher-Order (Second-Order) Conditioning:

    • An established $\text{CS}_1$ (e.g., a bell paired with lemon juice to elicit salivation) is used as a reinforcing event to condition a secondary neutral stimulus ($\text{CS}_2$, e.g., a buzzer).

    • Subsequent testing reveals that $\text{CS}_2$ elicits the conditioned response ($\text{CR}_2$) despite never having been directly paired with the original primary US.

• Sensory Preconditioning:

  • Demonstrates associative learning between two biologically neutral stimuli in the absence of a primary US during initial training.

  • Phase 1: $\text{CS}_2$ is repeatedly paired with $\text{CS}_1$ without any US present.

  • Phase 2: $\text{CS}_1$ is paired with a primary US until a robust CR is acquired ($\text{CS}_1 \rightarrow \text{US}$).

  • Test: $\text{CS}_2$ is presented alone and elicits the CR, proving that an association between $\text{CS}_2$ and $\text{CS}_1$ was stored during Phase 1.

Structural Determinants of the Conditioned Response

• Pavlovian Stimulus Substitution Model:

  • Postulates that classical conditioning forms direct neural connections between the CS pathway and US pathway, allowing the CS to substitute for the US and activate the pre-wired response circuit.

  • Empirical Support:

    • Dogs salivate in response to a food-predictive tone.

    • Human subjects perform eyeblink responses to a corneal air-puff predictive cue.

    • Jenkins and Moore (1973): Pigeons display open-mouth, swallow-like pecking movements to a water-predictive light key, but sharp, closed-beak biting pecks to a food-predictive light key.

• Modification of Response Structure by CS Characteristics:

  • Timberlake and Grant (1975) Live Rat CS Experiment:

    • When a live stimulus rat mounted on a movable platform served as the CS signaling food delivery to a participant rat, the participant rat displayed orientation, approach, sniffing, and social contact behaviors toward the CS rat rather than gnawing or biting responses expected under pure stimulus substitution.

*   *Defensive Conditioning Variations*: In rodent shock-conditioning studies, auditory tones signal overall environmental threat and elicit freezing (immobility), whereas localized physical shock-prods signal targeted physical threats and elicit defensive shock-rod burying behavior.

• Behavior Systems Theory:

  • Organisms possess inherited, organized behavioral systems optimized for biological tasks (such as foraging, defense, or mating).

  • Presentation of a US activates its corresponding behavior system. Classical conditioning integrates the CS into specific functional modules within that activated system.

  • Role of Temporal CS-US Interval:

    • The CS-US interval dictates which component of the behavioral sequence is conditioned to the CS.

    • General Search Behavior: Occurs early in a behavioral sequence when the US is temporally distant.

    • Focal Search Behavior: Occurs when the US is imminent, directing behavior focused directly on the cue or immediate environment.

    • Consummatory Behavior: Direct copulatory, ingestive, or defensive execution at US onset.

*   **Akins (2000) Quail Conditioning Study**:
    *   Male Japanese quail conditioned with a 1-minute CS-US interval before female access exhibited high focal search behavior (spending over 70% of trial time in immediate proximity to the CS).
    *   Male quail conditioned with a 20-minute CS-US interval exhibited elevated general search behavior (increased spatial crossings across the chamber) rather than remaining near the CS.

The Underlying Structure of Associative Learning: S-R versus S-S Learning

• Theoretical Models:

  • Stimulus-Response (S-R) Learning: Conditioning establishes a direct reflex arc or neural link between the CS and the motor response pathway ($\text{CS} \rightarrow \text{CR}$). The internal state or memory representation of the US is bypassed once the connection is established.

  • Stimulus-Stimulus (S-S) Learning: Conditioning forms a cognitive association between the CS and the mental representation of the US ($\text{CS} \rightarrow \text{US Representation} \rightarrow \text{CR}$).

• US Devaluation Testing:

  • Logic: If learning is S-S, post-training manipulation of the US's biological value (without further CS presentations) must directly alter the magnitude of the CR elicited by the CS.

  • Phase 1: Experimental and Control groups receive identical standard conditioning ($\text{CS} \rightarrow \text{US}$).

  • Phase 2: The US representation is devalued in the Experimental group (e.g., via conditioned taste aversion, high-intensity satiety, or illness) while remaining unchanged in the Control group.

  • Test Phase: CS is presented alone.

  • Outcome: Experimental animals display significantly reduced CR strength compared to Controls, confirming that conditioned responses rely on intact, active US representations (supporting S-S learning).

• US Inflation Experiments (Rescorla, 1973):

  • Phase 1: Group 1 and Group 2 receive identical Tone paired with moderate Foot-Shock conditioning ($\text{Tone} \rightarrow \text{Shock}$).

  • Phase 2: Group 2 receives unsignaled presentations of a significantly larger, higher-intensity Foot-Shock, elevating the value of the shock representation. Group 1 receives no extra shocks.

  • Test Phase: Tone is presented alone to both groups.

  • Outcome: Group 2 demonstrates an elevated, inflated CR compared to Group 1's normal CR, confirming S-S cognitive associative structures.

Physiological Homeostasis and Conditioned Drug Tolerance

• Homeostatic Regulation:

  • Biological systems maintain physiological stability around fixed internal set-points (e.g., thermoregulation, blood glucose, osmotic balance).

• Conditioned Compensatory Response Model:

  • Pharmacological Priming: Psychoactive drug administration disrupts internal homeostasis, causing primary physiological deviations.

  • US and UR Definitions:

    • US: The primary physiological effect of the drug (e.g., hypothermia, analgesia, elevated heart rate, euphoria).

    • UR: The body's innate compensatory feedback response designed to restore set-point homeostasis (e.g., hyperthermia, hyperalgesia, bradycardia, dysphoria).

  • CS Conditioning: Environmental cues repeatedly present during drug administration (syringes, room context, olfactory stimuli) become conditioned stimuli.

  • Conditioned Response (CR): Drug-predictive CSs elicit anticipatory compensatory responses prior to drug absorption.

  • Drug Tolerance Mechanics: When a drug is taken in the presence of familiar CSs, the CR counteracts the primary drug effects, resulting in an attenuated net drug reaction (tolerance).

Informational Variables in Conditioning: Contiguity, Blocking, and Contingency

• Failure of Temporal Contiguity: Kamin's Blocking Effect (1968):

  • Temporal pairing of a CS and US is insufficient for association formation if the US provides no new information.

  • Experimental Design:

    • Phase 1: Experimental group receives conditioning with Stimulus $A$ ($A \rightarrow \text{US}$) until maximum response strength is reached. Control group receives no training or unpaired presentations.

    • Phase 2: Both groups receive compound conditioning with Stimulus $A$ and Stimulus $B$ paired simultaneously with the same US ($[A + B] \rightarrow \text{US}$).

    • Test: Stimulus $B$ is presented alone.

    • Results: Experimental group displays negligible conditioned responding to $B$, whereas Control group displays strong conditioned responding to $B$. Pre-existing learning to $A$ blocks conditioning to B$.\n\n\n\n* **Rescorla's Contingency Theory (1968)**:\n * Conditioning depends on the predictive contingency between CS and US rather than simple pairing frequency.\n * *Contingency Equation*: Defined by the difference between two conditional probabilities:\n        P(\text{US} \mid \text{CS Present}) \quad \text{versus} \quad P(\text{US} \mid \text{CS Absent})\n * *Conditioning Conditions*:\n * **Excitatory Conditioning**: P(\text{US} \mid \text{CS Present}) > P(\text{US} \mid \text{CS Absent})$(Standard baseline:$P = 1.0$vs$P = 0.0).\n * **Conditioned Inhibition**: P(\text{US} \mid \text{CS Present}) < P(\text{US} \mid \text{CS Absent})$(Standard baseline:$P = 0.0$vs$P = 1.0).\n * **Uncorrelated / Zero Contingency**: P(\text{US} \mid \text{CS Present}) = P(\text{US} \mid \text{CS Absent}) (No conditioning occurs despite frequent CS-US co-occurrences).\n\n\n\n* **Rescorla (1968) Experimental Grid Analysis**:\n * Tested 10 distinct rat groups across combinations of P(\text{US} \mid \text{CS Present})$and$P(\text{US} \mid \text{CS Absent}):\n * Evaluated probability combinations: .4-.4$,$.2-.2$,$.1-.1$,$0-0$,$.4-.2$,$.4-.1$,$.4-0$,$.2-.1$,$.2-0$,$.1-0.\n * *Findings*: Suppression ratios were dictated strictly by the mathematical difference between P(\text{US} \mid \text{CS Present})$and$P(\text{US} \mid \text{CS Absent}). As background US probability in the absence of the CS increased, conditioned fear suppression to the CS systematically decreased.\n\n\n\n# Formal Mathematical Learning Theory: The Rescorla-Wagner Model\n\n* **Core Theoretical Postulate**:\n * Learning occurs on a trial-by-trial basis only when the occurrence of the US is unexpected or surprising.\n * **Mathematical Equation**:\n        \Delta V = k(\lambda - V)\n * \Delta V$: The change in associative strength ($V) of a CS on a given trial.\n * k$: A constant bounded between$0$and$1$reflecting stimulus salience (combining CS salience$a$and US salience$b).\n * \lambda: The maximum associative capacity supported by the US (the asymptote of learning).\n * V$: The total combined associative value of all stimuli present on that trial ($V_{\text{total}} = V_A + V_B + \dots).\n * (\lambda - V): The numerical error term representing US surprise or prediction error.\n\n\n\n* **Dynamics Across Conditioning Phase**:\n * *Early Trials*: Initial associative value is low (V \approx 0$), making prediction error$(\lambda - V)$large. Consequently,$\Delta V gains per trial are large.\n * *Late Trials*: As V$approaches$\lambda$, prediction error$(\lambda - V)$approaches$0$, causing$\Delta V increments to asymptote.\n\n\n\n* **Mechanistic Application to Experimental Phenomena**:\n * **Explanation of Kamin's Blocking Effect**:\n * Phase 1 (A \rightarrow \text{US}$): Stimulus$A$is conditioned to asymptote ($V_A = \lambda).\n * Phase 2 ([A + B] \rightarrow \text{US}$): Compound$AB$is presented. Total associative value$V_{\text{total}} = V_A + V_B = \lambda + 0 = \lambda.\n * Prediction Error: (\lambda - V_{\text{total}}) = (\lambda - \lambda) = 0$.

    • Since error is zero, $\Delta V_B = k(0) = 0$. Stimulus $B$ acquires zero associative strength.

  • The Overexpectation Effect:

    • Phase 1: Stimulus $A$ and Stimulus $B$ are trained independently to asymptotic baseline with a 1-pellet US ($V_A = \lambda$, $V_B = \lambda$).

    • Phase 2: Compound $AB$ is presented together and paired with the same 1-pellet US ($\lambda$).

    • Total Expectancy: $V_{\text{total}} = V_A + V_B = \lambda + \lambda = 2\lambda$ (Animal expects 2 pellets).

    • Prediction Error Calculation: (\lambda - V_{\text{total}}) = (\lambda - 2\lambda) = -\lambda$.\n * *Outcome*: On compound trials, prediction error is negative. Both V_A$and$V_B$lose associative value until$V_A + V_B = \lambda, demonstrating that continued US pairing can decrease associative strength under overexpectation.\n\n\n\n * **Conditioned Inhibition Mechanics**:\n * *Excitatory Trials* (\text{CS}+ \rightarrow \text{US}$):$V_{\text{CS}+}$increases toward$\lambda$.

    • Inhibitory Compound Trials ($[\text{CS}+ + \text{CS}-] \rightarrow \text{No US}$): As $\text{US} = 0$, asymptotic capacity \lambda = 0$.\n * *Expectancy*: V_{\text{total}} = V_{\text{CS}+} + V_{\text{CS}-}$.

    • Since $V_{\text{CS}+} > 0$, for $V_{\text{total}}$ to equal $\lambda = 0$, $V_{\text{CS}-}$ must become negative ($V_{\text{CS}-} < 0$).

    • Extinction Prediction: Presenting an inhibitory cue ($\text{CS}-$) repeatedly alone without a US causes its negative associative value to decay back toward zero, paradoxically extinguishing its inhibitory properties.