Chapter 8: Conditioning and Learning

Blocking

In classical conditioning, the finding that no conditioning occurs to a new stimulus when it is paired with a previously conditioned stimulus, showing that surprise or prediction error is necessary for learning.

Categorize

To sort or arrange items into classes or groups.

Classical conditioning

A learning process in which an initially neutral stimulus (the conditioned stimulus, CS) is paired with an unconditioned stimulus (US) so that the CS comes to elicit a conditioned response (CR); also called Pavlovian conditioning.

Conditioned compensatory response

A conditioned response that opposes the unconditioned response, often seen when drugs serve as unconditioned stimuli.

Conditioned response (CR)

The learned response elicited by the conditioned stimulus after conditioning has occurred.

Conditioned stimulus (CS)

An initially neutral stimulus that elicits a conditioned response after being paired with an unconditioned stimulus.

Context

Background stimuli present during learning, including environmental, internal (e.g., mood, drug state), or temporal cues.

Discriminative stimulus

In operant conditioning, a stimulus that signals whether a response will be reinforced and “sets the occasion” for the behavior.

Extinction

The decrease in strength of a learned response when the unconditioned stimulus or reinforcement is no longer presented.

Fear conditioning

A type of classical conditioning in which a neutral stimulus becomes associated with an aversive stimulus, leading the neutral stimulus to evoke fear.

Goal-directed behavior

Instrumental behavior influenced by knowledge of the relationship between actions and their outcomes and the current value of the outcome.

Habit

Instrumental behavior that is automatic and no longer sensitive to the value of the reinforcer.

Instrumental conditioning

Learning about the relationship between one’s behavior and its consequences; also called operant conditioning.

Law of effect

The principle that behaviors followed by satisfying consequences are strengthened, while behaviors followed by discomfort are weakened.

Observational learning

Learning that occurs by observing the behavior of others.

Operant

A behavior that is controlled by its consequences.

Operant conditioning

See instrumental conditioning; learning in which behavior is shaped by reinforcement and punishment.

Pavlovian conditioning

See classical conditioning.

Prediction error

The discrepancy between expected and actual outcomes; learning occurs when outcomes are surprising.

Preparedness

The idea that evolutionary history makes certain associations easier to learn than others.

Punisher

A stimulus that decreases the likelihood of a behavior when it follows that behavior.

Quantitative law of effect

A mathematical rule stating that the effectiveness of a reinforcer depends on the amount of reinforcement available for alternative behaviors.

Reinforcer

Any consequence that strengthens a behavior or increases the likelihood it will occur again.

Reinforcer devaluation effect

The reduction in responding when a reinforcer is made undesirable after learning has occurred.

Renewal effect

The recovery of an extinguished response when the context changes after extinction.

Social Learning Theory

The theory that people can learn new behaviors by observing others.

Social models

Individuals who serve as examples for behavior and are observed during learning.

Spontaneous recovery

The reappearance of an extinguished response after the passage of time.

Stimulus control

When an operant behavior is influenced by the presence of a particular stimulus.

Taste aversion learning

Learning in which a taste is paired with illness, leading to long-lasting avoidance of that taste.

Unconditioned response (UR)

An innate response elicited by an unconditioned stimulus before conditioning.

Unconditioned stimulus (US)

A stimulus that naturally elicits a response without prior learning.

Vicarious reinforcement

Learning that occurs by observing the reinforcement or punishment of another person’s behavior.