Comprehensive Notes on Classical Conditioning: Theories, Applications, and Treatments
Stimulus-Substitution Theory
Origin: Pavlov (1927)
Core idea: the CS acts as a direct substitute for the US in the conditioning process.
Example: tone paired with food → tone becomes substitute for food and elicits salivation (CR).
Example: click paired with air puff to the eye → click substitutes for air puff and elicits eyeblink (CR).
Neurological interpretation (Pavlov’s view): CS-US substitutions reflect underlying brain activity
US (e.g., food) activates a “food center” in the cortex, which then activates a “salivation center” that produces UR.
Neutral stimulus (e.g., light) activates a different cortical area; when the light precedes food, connections form between light-activated area and food-activation area, so light alone can trigger salivation.
Limitations and corrections: the actual conditioning processes are more complex than Pavlov proposed; however, certain aspects remain informative
In some cases, the CS appears to be treated by the organism as if it were the US (e.g., dog salivating to light similar to salivation to food; sign-tracking).
Sign tracking
Phenomenon: animals react to a CS as if it were the US; e.g., dog approaches the light and licks it, as if light is edible.
More detailed discussion in Chapter 12.
Critical limitations of stimulus-substitution theory
Problem: CR is not always the same as UR
Example: US = foot shock (US) leads to jump (UR); CS = light paired with shock may lead to freezing (CR).
Question: Why would CR sometimes resemble UR and sometimes differ (e.g., jump vs freezing)?
Insight: the function of the CR may be to prepare the organism for the US, not merely imitate the UR.
Preparatory-Response Theory (Kimble; 1961, 1967)
Core idea: the purpose of the CR is to prepare the organism for the US (preparation for the upcoming event)
Dog salivates to tone to get ready for food.
Rat freezes in response to light to get ready for the shock.
Flexibility of CR vs UR
Depending on the situation, the CR may be similar to or opposite to the UR.
Example: heroin conditioning where the CS (environmental cues) becomes associated with the primary response to heroin but can also elicit a compensatory response before the US is delivered (see Compensatory-Response Model).
Compensatory-Response Model (Opponent-Process Theory of Emotion)
Core idea: the CR is a preparatory/compensatory response (b-process) that counteracts the US-driven primary response (a-process)
Basic sequence (heroin example):
US = heroin, which directly elicits a primary response (a-process): a decrease in blood pressure.
This primary response elicits a compensatory increase in blood pressure (b-process).
With repeated heroin use, cues in the environment (CSs) become associated not with heroin itself but with the primary response to heroin (the decrease in blood pressure), and eventually come to elicit the compensatory response (increase in blood pressure).
Why the body adapts preemptively
According to opponent-process theory, compensatory reactions serve homeostasis.
If the compensatory response is elicited before the US, it can blunt the disturbance produced by the US (e.g., a pre-emptive increase in BP before heroin injection reduces the observed drop in BP).
How this explains drug conditioning and tolerance
CSs in the environment predict the drug effect and generate anticipatory compensatory responses, contributing to tolerance in familiar contexts.
Craving and withdrawal symptoms can be understood as conditioned compensatory responses elicited by drug-related cues.
Evidence and implications
Observed cue-presentation effects in humans and animals demonstrate CS-driven compensatory responses that prepare for drug effects.
Implications for treatment: extinguishing CS–US associations with drug cues may reduce conditioned withdrawal-like symptoms and cravings.
Drug Conditioning: Variants and Complexities
Typical sequence: drug (US) → immediate UR (e.g., BP drop) → CSs associated with the US become predictors of that effect and elicit a CR (e.g., compensatory BP increase).
Alternate conditioning outcomes
In some cases, cues elicit drug-like responses (not compensatory) or both drug-like and compensatory responses in different systems.
Example: cocaine administration environment can condition CSs that enhance cocaine effects (drug-like reactions).
A decaffeinated coffee cue can produce caffeine-like alertness and a compensatory decrease in salivation.
Why these patterns occur is not fully understood; conditioning outcomes are influenced by the biological system and the environment.
Practical implications for addiction and treatment: cue exposure, extinction, and cue-management strategies aim to reduce conditioned compensatory responses and cravings.
Conditioned Compensatory Responses and Drug Overdose
Overdose can occur when a drug is taken in a novel environment lacking the usual compensatory cues.
Siegel (1984, 1989) and case studies
heroin-tolerant individuals may tolerate a high dose in a familiar context (with cues) but overdose in a different context due to weaker compensatory responses in the absence of those cues.
Observed that environmental context and procedural changes can disrupt learned compensatory reactions, increasing overdose risk.
Extinction, Incubation, US Revaluation, and Related Concepts
Extinction generally occurs when CS is presented without the US; however, some conditions can prevent extinction or even strengthen fear (incubation).
Incubation (Eysenck, 1968): brief exposures to the CS can strengthen conditioned fear rather than extinguish it; covert exposure (worry) can also incubate fear.
US Revaluation (Davey, 1992): changing the intensity of the US after conditioning can alter the strength of the CS response; observed in real-world phobias and observationally learned fears.
Observational learning and verbal information can contribute to US revaluation (e.g., hearing about a danger can inflate the US value).
Selective Sensitization (Rachman, 1977): an unrelated stressful event can increase reactivity to fear-relevant stimuli (agoraphobia, driving fears during a divorce, etc.).
Preparedness vs Temperament vs Observational Learning
Preparedness: innate predisposition to fear certain stimuli (e.g., snakes, spiders) due to evolutionary history; easier acquisition of fear for fear-relevant stimuli than for fear-irrelevant stimuli.
Temperament: genetically influenced baseline of emotional reactivity; temperament affects ease of conditioning; e.g., shy dogs conditioned more readily than bold dogs; similar patterns suggested in humans.
Observational Learning: fear can be learned by watching others’ fear responses or by observational models; can lead to vicarious conditioning and higher-order conditioning.
Observational Learning and Fear Acquisition
Observing others’ fear responses can serve as an unconditioned stimulus (US) eliciting fear (UR) in the observer; the observed fear reaction becomes a conditioned stimulus (CS) for fear (CR).
Model-based imitation and higher-order conditioning can occur; evidence from animals (Cook & Mineka, 1989) and humans (Soares & Öhman, 1993) using subliminal stimuli.
Preparedness interacts with observational learning: fear-relevant stimuli are more readily learned as feared stimuli.
Phobias: Factors Beyond Direct Conditioning
Not all phobias arise from direct conditioning; many people with phobias cannot recall a conditioning event.
Additional contributing factors:
Observational learning
Temperament and Preparedness
Incubation and US Revaluation
Selective sensitization
Incubation, US revaluation, and observational learning can promote phobic development even without a direct conditioning event.
Case Study: Watson & Rayner and Little Albert (1920)
Brief summary: attempted to condition an 11-month-old infant (Albert) to fear a white rat by pairing the rat (NS) with a loud noise (US).
Findings (as reported): rat became CS; loud noise was US; Albert’s fear generalized to similar furry objects; fear persisted after a 30-day break.
Critical issues and debates
Possible pseudoconditioning (sensitization to noise rather than conditioning to rat).
Number of pairings and duration of conditioning were limited; fears in real life often require only one pairing.
Ethical concerns: no informed consent, potential harm, and lack of humane safeguards.
Contemporary developments and controversies
Later discussions about whether the subject was actually Little Albert; recent investigations (Beck et al., 2009; Powell et al., 2014) continue to debate identity and outcomes.
Ethical considerations continue to shape historical interpretation.
Temperament, Preparedness, and Phobic Acquisition (Expanded)
Temperament
Individual differences in emotional reactivity; genetically influenced; affects conditioning ease.
Early Pavlov observations: shy dogs conditioned more readily than active dogs.
Preparedness
An innate predisposition to form aversive associations with certain stimuli (e.g., snakes, spiders).
Valentine (1930) demonstrated variability in conditioned fear depending on the stimulus pairings (e.g., caterpillar vs opera glasses).
Cook & Mineka (1989); Soares & Öhman (1993) provide evidence in primates and humans that fear is easier to acquire for fear-relevant stimuli.
Distinction for students: temperament = general emotional reactivity; preparedness = predisposition toward certain fear types.
Incubation, US Revaluation, and Selective Sensitization (Practical Implications)
Incubation
Brief encounters can strengthen conditioned fear; particularly relevant in exposure-based therapies and real-world fears.
US Revaluation
Changing the perceived intensity of the US can alter the conditioned response strength; can occur via observational or verbal information.
Selective Sensitization
Stressful life events can increase sensitivity to fear-related stimuli, exacerbating phobias during turbulent times.
Treatments for Phobias: Systematic Desensitization and Flooding
Systematic Desensitization (Wolpe, 1958)
Based on counterconditioning and reciprocal inhibition
Three components:
1) Training in relaxation (e.g., Jacobson’s deep muscle relaxation; )
2) Hierarchy of imaginary scenes with increasing fear (10–15 scenes typical)
3) Pairing each hierarchy item with relaxationImaginal desensitization: use of imagined scenarios; in vivo desensitization uses real stimuli
Role of relaxation: relaxation may be necessary for severe phobias; some argue it is not strictly required (extinction vs counterconditioning debate)
Öst’s rapid single-session approach combines gradual exposure with prolonged exposure and may include participant modeling; often effective for specific phobias
Flooding
Prolonged exposure to the feared stimulus to maximize extinction opportunities; more direct extinction than counterconditioning
Imaginal flooding vs. in vivo flooding
Pros: rapid exposure; Cons: high distress and potential medical risks; not suitable for all phobias (e.g., PTSD considerations)
Hybrid and modern exposure therapies
Exposures often combine elements of systematic desensitization and flooding; include observational learning and modeling (Öst, 1989; Spiegler & Guevremont, 2010)
Aversion Therapy
Decreases attractiveness of a target behavior by pairing it with an aversive stimulus (e.g., nausea with alcohol; shock with smoking)
Covert or imaginal sensitization can be used when real aversion is impractical
Applications include addressing nicotine/alcohol use and certain offender behaviors (pedophilia)
Covert Sensitization
Imagined aversive consequences used when real exposure is impractical or dangerous
Controversies and evidence
Systematic desensitization often effective for specific phobias; less so for social phobias
The exact mechanism is not fully understood; extinction and counterconditioning may both contribute
Aversion Therapy and Covert Sensitization: Details and Examples
Examples of aversion procedures
Tasting alcohol paired with nausea using an emetic; alcohol taste becomes associated with nausea and reduced desire
Nicotine aversion: rapid smoking to induce nausea and suppression of smoking; relapse prevention can augment effectiveness
Covert sensitization
Imagery-based aversion procedures (e.g., imagining nausea) used when real stimuli are not feasible
Effectiveness and safety
Aversion therapy tends to be more effective when the aversive stimulus is biologically relevant to the behavior (e.g., nausea for ingestion)
Potential risks and ethical considerations must be considered with high distress interventions
Medical Applications of Classical Conditioning
Immunosuppression conditioning
Ader & Cohen (1975): pairing an innocuous taste with an immunosuppressive drug led to later immunosuppression when the taste was presented alone
Bovbjerg et al. (1990): hospital environment associated with immunosuppression in chemotherapy patients
Enhancing immune functioning
Sherbet taste paired with adrenaline increased natural killer cell activity; demonstrates conditioned immune responses in humans (Buske-Kirschbaum et al., 1994)
Placebo effects and conditioning
Placebo effects can be understood as classical conditioning: appearance of drug (NS) paired with active pharmacological effects (US) leading to conditioned responses
Placebo effects are stronger after prior active-drug treatment; extinction-like reductions can occur with repeated placebos
Practical implications
Conditioning mechanisms can be leveraged to reduce drug side effects, enhance treatment efficacy, or manage placebo responses in clinical settings
Rescorla-Wagner Theory (Rescorla & Wagner, 1972)
Core claim: a given US has a maximum amount of conditioning it can support; this value is distributed among the CSs present on a trial
Key assumptions
Stronger USs and more salient CSs support more conditioning
Associative value is distributed across competing CSs in a compound stimulus
Notation used in standard presentation
V_i: associative value acquired by CS i
Max (λ): maximum associative value the US can support
∑V_j: total associative value of all CSs present (the total predicted US)
α_i: salience of CS i; β: learning-rate parameter for the US
Change in associative value on a conditioning trial for CS i:
Key consequences and phenomena
Blocking: if one CS (e.g., tone) already predicts the US to its maximum (Max), a second CS (e.g., light) added to a compound will gain no associative value; testing the two CSs separately reveals the blocking of the new CS
Overshadowing: when two CSs of different salience are paired with the US to the same extent, the more salient CS acquires more associative value, leaving the weaker CS with less
Example: tone vs light; tone may gain 6 units and light 4 units if Max is 10
If the tone is even more salient (e.g., loud tone vs faint light), the tone may gain 9 and light 1
Overexpectation effect: conditioning two CSs separately to maximum associative value (10 each) and then presenting them together with a US that can support only 10 units leads to a decrease in the total associative value for each CS when tested separately
After several pairings with the compound, the total associative value is reduced to match the US limit; each CS’s individual value decreases (counterintuitive: more training can weaken previously strong CSs)
Cognitive interpretation
A high associative value CS becomes a strong predictor of the US; it leads to strong expectations about the US when the CS is encountered
In blocking, the highly predictive tone makes the presence of the light redundant; no additional learning about the light occurs
Model limitations and debates
Not all predictions have been consistently replicated; debates exist about whether the theory implies mentalistic inferences about beliefs/expectations
Some researchers argue that associative value is a useful, measurable construct rather than a metaphor for cognitive processes
Other Key Historical and Conceptual Points
Little Albert revisited (Watson & Rayner, 1920; later discussions)
Original claim: conditioned fear of a rat via pairing with a loud noise; fear generalized to furry objects
Critiques: lack of controls for pseudo-conditioning; ethics concerns; questions about true phobia conditioning versus sensitization and incidental bias; later historical investigations questioned the identity of Albert (Little Albert controversy)
Phobia development: multiple pathways
Direct conditioning is one route
Observational learning, temperament, preparedness
Incubation and US revaluation can strengthen or alter fear responses
Selective sensitization explains the amplification of fears during stress
Quick Reference: Key Terms and Abbreviations
CS: Conditioned Stimulus
US: Unconditioned Stimulus
UR: Unconditioned Response
CR: Conditioned Response
V: Associative value of a CS
Max/λ: Maximum associative value supported by the US
α: Salience/noticeability of CS
β: Learning-rate parameter for the US
a-process: primary response to the US
b-process: compensatory/oppose response to the US
NS: Neutral Stimulus (before conditioning becomes CS)
US Revaluation: changing the US intensity after conditioning
Incubation: strengthening fear due to brief exposures
Preparedness: innate predisposition to learn certain fears
Temperament: genetically influenced emotional reactivity
Observational Learning: learning by watching others’ responses
Systematic Desensitization: relaxation paired with hierarchical exposure to fear-eliciting stimuli
Flooding: prolonged exposure to feared stimulus without avoidance
Aversion Therapy: pairing a desired stimulus with an aversive event
Covert Sensitization: imaginal aversive conditioning
Placebo Effect: conditioned expectancy leading to real symptoms changes
Immunosuppression/Immunity conditioning: classical conditioning of immune responses
Connections to Broader Topics and Real-World Relevance
The three major theories of conditioning (Stimulus-Substitution, Preparatory-Response, Compensatory-Response) collectively help explain why CS–UR relationships can be diverse across contexts and species, and why drug-related cues can trigger tolerance, craving, withdrawal, or overdose risk depending on the environment and history.
Rescorla-Wagner provides a mathematically explicit account of how associative strength is allocated when multiple cues compete for the same US, predicting phenomena like blocking, overshadowing, and overexpectation, and offering a bridge between behavioral and cognitive interpretations.
Observational learning, temperament, and preparedness highlight that fear conditioning is not just a reflexive pairing of stimuli; social context, biology, and evolution shape what is learned, when, and how strongly.
Treatment implications are central: systematic desensitization, flooding, and aversion therapy illustrate how conditioning principles translate into effective interventions for phobias, addictions, and other problem behaviors, including modern, integrated exposure-based approaches.
Medical applications (immune conditioning, placebo, and conditioned illness) demonstrate that conditioning principles extend beyond reflexive responses to influence health, disease processes, and treatment outcomes.
// End of comprehensive notes on the transcript content
Treatments for Phobias: Systematic Desensitization and Flooding
Systematic Desensitization (Wolpe, 1958)
Based on counterconditioning and reciprocal inhibition
Three components:
1) Training in relaxation (e.g., Jacobson’s deep muscle relaxation; )
2) Hierarchy of imaginary scenes with increasing fear (10–15 scenes typical)
3) Pairing each hierarchy item with relaxation
Imaginal desensitization: use of imagined scenarios; in vivo desensitization uses real stimuli
Role of relaxation: relaxation may be necessary for severe phobias; some argue it is not strictly required (extinction vs counterconditioning debate)
Öst’s rapid single-session approach combines gradual exposure with prolonged exposure and may include participant modeling; often effective for specific phobias
Flooding
Prolonged exposure to the feared stimulus to maximize extinction opportunities; more direct extinction than counterconditioning
Imaginal flooding vs. in vivo flooding
Pros: rapid exposure; Cons: high distress and potential medical risks; not suitable for all phobias (e.g., PTSD considerations)
Hybrid and modern exposure therapies
Exposures often combine elements of systematic desensitization and flooding; include observational learning and modeling (Öst, 1989; Spiegler & Guevremont, 2010)
Aversion Therapy
Decreases attractiveness of a target behavior by pairing it with an aversive stimulus (e.g., nausea with alcohol; shock with smoking)
Covert or imaginal sensitization can be used when real aversion is impractical
Applications include addressing nicotine/alcohol use and certain offender behaviors (pedophilia)
Covert Sensitization
Imagined aversive consequences used when real exposure is impractical or dangerous
Controversies and evidence
Systematic desensitization often effective for specific phobias; less so for social phobias
The exact mechanism is not fully understood; extinction and counterconditioning may both contribute