Chapter 4: Conditioning and Learning

Blocking

In classical conditioning, the finding that no conditioning occurs to a stimulus if it is combined with a previously conditioned stimulus during conditioning trials. Suggests that information, surprise value, or prediction error is important in conditioning.

Categorize

To sort or arrange different items into classes or categories.

Classical conditioning

The procedure in which an initially neutral stimulus (the conditioned stimulus, or CS) is paired with an unconditioned stimulus (or US). The result is that the conditioned stimulus begins to elicit a conditioned response (CR).

Conditioned compensatory response

In classical conditioning, a conditioned response that opposes, rather than is the same as, the unconditioned response. It functions to reduce the strength of the unconditioned response.

Conditioned response (CR)

The response that is elicited by the conditioned stimulus after classical conditioning has taken place

Conditioned stimulus (CS)

An initially neutral stimulus (like a bell, light, or tone) that elicits a conditioned response after it has been associated with an unconditioned stimulus.

Discriminative stimulus

In operant conditioning, a stimulus that signals whether the response will be reinforced. It is said to “set the occasion” for the operant response.

Extinction

Decrease in the strength of a learned behavior that occurs when the conditioned stimulus is presented without the unconditioned stimulus (in classical conditioning) or when the behavior is no longer reinforced (in instrumental conditioning).

Fear conditioning

A type of classical or Pavlovian conditioning in which the conditioned stimulus (CS) is associated with an aversive unconditioned stimulus (US), such as a foot shock.

Goal-directed behavior

Instrumental behavior that is influenced by the animal’s knowledge of the association between the behavior and its consequence and the current value of the consequence.

Instrumental conditioning (Operant conditioning)

Process in which animals learn about the relationship between their behaviors and their consequences. Also known as operant conditioning.

Law of effect

The idea that instrumental or operant responses are influenced by their effects. Responses that are followed by a pleasant state of affairs will be strengthened and those that are followed by discomfort will be weakened.

Observational learning

Learning by observing the behavior of others.

Operant

A behavior that is controlled by its consequences. The simplest example is the rat’s lever-pressing, which is controlled by the presentation of the reinforcer.

Prediction error

When the outcome of a conditioning trial is different from that which is predicted by the conditioned stimuli that are present on the trial (i.e., when the US is surprising).

Preparedness

The idea that an organism’s evolutionary history can make it easy to learn a particular association

Punisher

A stimulus that decreases the strength of an operant behavior when it is made a consequence of the behavior.

Reinforcer

Any consequence of a behavior that strengthens the behavior or increases the likelihood that it will be performed it again.

Renewal effect

Recovery of an extinguished response that occurs when the context is changed after extinction. Especially strong when the change of context involves return to the context in which conditioning originally occurred.

Social Learning Theory

The theory that people can learn new responses and behaviors by observing the behavior of others.

Social models

Authorities that are the targets for observation and who model behaviors.

Spontaneous recovery

Recovery of an extinguished response that occurs with the passage of time after extinction.

Unconditioned response (UR)

In classical conditioning, an innate response that is elicited by a stimulus before (or in the absence of) conditioning.

Unconditioned stimulus (US)

In classical conditioning, the stimulus that elicits the response before conditioning occurs.

Vicarious reinforcement

Learning that occurs by observing the reinforcement or punishment of another person