Behavioral Psychology: Extinction, Stimulus Control, and Reinforcement Strategies

Extinction

The loss of a previously reinforced response, the result of which is a decrease in the strength of that response.

Procedure/Process of Extinction

The method used to stop reinforcing a behavior, leading to its eventual cessation.

Behavior

The eventual cessation of calls made by Karla to Jana late in the evening.

Reinforcer

The consequence being withdrawn that is responsible for maintaining the behavior.

Extinction Burst

An increase in the frequency and intensity of a behavior immediately following the removal of reinforcement.

Variability

An increase in the different ways a behavior is expressed following extinction.

Aggression

A potential emotional response exhibited when reinforcement is removed.

Emotional Response

A reaction that can occur when a desired outcome is not achieved.

Depression

A temporary period that may follow extinction, characterized by a lack of response or engagement.

Resistance to Extinction

The extent to which responding persists after an extinction procedure is implemented.

Partial Reinforcement Effect

The phenomenon where responses maintained on an intermittent schedule show more resistance to extinction than those on a continuous schedule.

Variable Ratio (VR) Schedule

An intermittent schedule particularly likely to produce strong resistance to extinction.

Magnitude of Reinforcer

The strength of the reinforcer that influences resistance to extinction.

Direct Relationship

The correlation between resistance to extinction and the magnitude of the reinforcer.

Previous Experience with Extinction

Tends to produce a decrease in resistance to extinction.

Spontaneous Recovery

The reappearance of an extinguished response at a later point in time.

Weaker Response

The characteristic of a response during spontaneous recovery, which is less strong than before.

Stimuli

Factors that may be associated with the start of a session, influencing spontaneous recovery.

Differential Reinforcement of Other Behavior (DRO)

The procedure of reinforcing all behaviors except the particular target behavior that you wish to extinguish.

DRO Procedure

An example of reinforcing a dog for behaviors other than jumping up on visitors.

Reduce

The effect of differential reinforcement on side effects of extinction, such as an extinction burst or aggression.

Differential Reinforcement of Incompatible Behavior (DRI)

A precise type of DRO procedure in which the other behavior is specifically incompatible with the target behavior.

Stimulus Control

A behavior is said to be under strong stimulus control when it is highly likely to occur in the presence of a certain stimulus.

Stimulus Generalization

In operant conditioning, the term refers to the tendency for a response to be emitted in the presence of stimuli that are similar to the original SD.

Generalization Gradient

A graph that depicts the strength of responding to stimuli that vary along a continuum.

Generalization

A relatively flat gradient indicates more generalization and less discrimination.

Discrimination

A relatively steep gradient indicates more discrimination and less generalization.

Peak Shift Effect

An unusual effect often produced by discrimination training in which the peak of a generalization gradient shifts away from the SΔ to a stimulus that is further removed from the SD.

Intermittent (or VR) Schedule of Reinforcement

A schedule of reinforcement that results in persistence of behavior despite rejection.

Discriminative Stimulus

A stimulus indicating that a treat will soon become available.

SD

A stimulus that reinforces responses in its presence.

SΔ

A stimulus that does not reinforce responses in its presence.

Yellowish-Orange Key Light

The strongest response in the generalization gradient following discrimination training with a yellow key light as an SD.

Orange-Reddish Key Light

Another stimulus that elicits a strong response in the generalization gradient following discrimination training.

Behavioral Contrast

A phenomenon where the strength of a behavior changes when the conditions of reinforcement are altered.

Pestering for a Treat

Lucie's behavior that persisted despite Erin's instructions to stop giving treats.

Time Range for Lunch

Jonathan goes for lunch at about 12:30, with a range between 12:15 and 12:45.

stimulus discrimination

Gina running away from hornets but not houseflies one year later.

peak shift

Mehgan becoming more interested in meeting someone more educated than David after moving to Dallas.

multiple schedule

Consists of two or more independent schedules presented sequentially, each resulting in a reinforcer and having a distinctive SD.

procedure of extinction

Defined by the nonreinforcement of a previously reinforced response.

process of extinction

Defined by the resultant decrease in the strength of a response.

negative contrast

Asha becoming less interested in school after her parents won the lottery.

targeting

A behavior management technique similar to training Yan's son to stay close in a crowded city.

low resistance to extinction

Laura's behavior of trying to interact with Trish after spreading rumors.

contrast

A change in the rate of reinforcement on one component of a multiple schedule followed by an opposite change in rate on the other component.

upset (or angry/aggressive)

Laura's emotional state after Trish stopped talking to her.

positive contrast

Tamara becoming more interested in other activities after a frightening experience.

anticipatory contrast

Ahmed becoming more interested in studying after receiving poor grades.

errorless discrimination learning

Vern teaching his daughter letters more softly until she said them herself.

depressed

Laura eventually becoming depressed, a symptom associated with low activity.

high resistance to extinction

More persistent behavior compared to less persistent behavior.

habit

Shahram placing his keys in the dish beside the door without thinking.