Learning Theory – Key Vocabulary

Vocabulary flashcards summarizing foundational terms and concepts from the learning-theory lecture, covering classical and operant conditioning, key mechanisms, phenomena, and clinical implications.

Learning Theory

The scientific study of how experience produces lasting changes in behavior, thought, and emotion.

Pavlovian (Classical) Conditioning

Learning in which a neutral stimulus (CS) acquires the ability to elicit responses after being paired with a biologically significant stimulus (US).

Operant (Instrumental) Conditioning

Learning in which the probability of a voluntary behavior changes because it is followed by a reinforcing or punishing consequence.

Unconditional Stimulus (US)

An event that naturally and automatically elicits a response without prior learning.

Conditional Stimulus (CS)

Originally neutral cue that elicits a response after being paired with a US.

Unconditional Response (UR)

The innate reaction automatically elicited by the US.

Conditional Response (CR)

The learned reaction elicited by the CS after conditioning.

Reinforcer

Any consequence that increases the future probability of the behavior it follows.

Positive Reinforcement

Strengthening a response by presenting a pleasant stimulus after the behavior.

Negative Reinforcement

Strengthening a response by removing or preventing an aversive stimulus after the behavior.

Punishment

A consequence that decreases the probability of a behavior; may involve adding an aversive event or removing a positive one.

Law of Effect

Thorndike’s principle that behaviors producing satisfying outcomes become stronger, whereas those producing discomfort become weaker.

Extinction (Classical)

Reduction of a CR when the CS is repeatedly presented without the US.

Extinction (Operant)

Decline of an operant response when reinforcement is discontinued.

Renewal Effect

Return of an extinguished response when the context is changed after extinction.

Spontaneous Recovery

Reappearance of an extinguished response after a passage of time.

Blocking

Failure of a new CS to gain associative strength because another CS already predicts the US.

Conditioned Inhibitor

A stimulus that signals a decrease or absence of the US, thereby suppressing conditioned responding.

Prediction Error

Difference between expected and actual US; drives associative change in many conditioning theories.

Rescorla–Wagner Model

Mathematical model stating that associative strength changes proportionally to prediction error on each trial.

Latent Inhibition

Retarded conditioning that occurs when a CS is pre-exposed without the US before conditioning.

Sensory Preconditioning

Process in which two neutral stimuli are first associated; later pairing one with a US makes the other evoke a CR.

Second-Order Conditioning

Learning where a CS becomes able to evoke a CR after being paired with another CS that already elicits the CR.

Preparedness

Evolutionary predisposition to form associations between certain stimuli and specific outcomes (e.g., snakes with fear).

Counterconditioning

Eliminating an unwanted CR by pairing the CS with a new, incompatible US such as relaxation.

Exposure Therapy

Clinical method using repeated CS presentations without the US to extinguish pathological fear.

State-Dependent Learning

Memory phenomenon in which information learned in a particular physiological state is best retrieved in the same state.

D-Cycloserine

Partial NMDA receptor agonist studied for its ability to enhance extinction learning during exposure therapy.

Reconsolidation

Hypothesized process by which reactivated memories become labile and must restabilize, allowing possible modification.

Ratio Schedule

Intermittent reinforcement based on a set (fixed) or variable number of responses.

Interval Schedule

Intermittent reinforcement based on a set (fixed) or variable amount of time before a response is reinforced.

Quantitative Law of Effect

Equation stating that response strength depends on its own reinforcement rate relative to reinforcement for alternatives.

Impulsive Choice

Selection of a smaller, immediate reward over a larger, delayed one; often modeled by delay discounting of value.

Premack Principle

Idea that a high-probability activity can serve as a reinforcer for a low-probability activity.

Positive Contrast

Increase in vigor of responding when reward quality or quantity suddenly improves relative to previous experience.

Negative Contrast

Depression of responding when reward quality or quantity suddenly decreases relative to expectation.

Partial Reinforcement Extinction Effect

Greater persistence of behavior that was intermittently (vs. continuously) reinforced once reinforcement stops.

Incentive Learning

Process of learning how a specific outcome affects a motivational state, enabling that state to energize the instrumental action.

Pavlovian-Instrumental Transfer (PIT)

Increase or decrease in operant responding when a Pavlovian CS associated with the same outcome is presented.

Avoidance Learning

Acquisition of a response that prevents or postpones an aversive event, often involving both Pavlovian and operant processes.

Species-Specific Defensive Reaction (SSDR)

Innate withdrawal or escape response elicited by threats; can dominate avoidance behavior without explicit reinforcement.

Learned Helplessness

Deficit in learning to escape controllable aversive events after exposure to uncontrollable aversive events.

Reinforcer Devaluation

Experimental procedure showing that an instrumental action decreases when its outcome is made aversive or undesirable.

Occasion Setting

Stimulus function in which a cue signals which response-outcome relation is currently valid, without directly eliciting the response.

Habit Learning (S-R)

Automatic performance of an action in response to contextual cues, with little sensitivity to the current value of its outcome.

Resurgence

Reappearance of an extinguished behavior when a newly reinforced replacement behavior is itself extinguished.

Sign Tracking

Approach or contact behaviors elicited by a CS that predicts a positive US (e.g., pigeons pecking a lit key signaling food).

Compensatory Response

CR that counteracts the physiological effect of a drug US, contributing to tolerance and withdrawal.

Two-Factor Theory

Model proposing that avoidance learning involves Pavlovian fear conditioning plus operant escape from that fear.