L&B Ch 8: Operant Conditioning: Extinction, Schedules of Reinforcement, and Stimulus Control

Vocabulary practice flashcards covering extinction processes, side effects, resistance factors, basic reinforcement schedules, and stimulus control concepts.

Extinction

The nonreinforcement of a previously reinforced response, which results in a decrease in the strength of that response.

Procedure of Extinction

The specific nonreinforcement of a previously reinforced response.

Process of Extinction

The resultant decrease in response strength following the nonreinforcement of a behavior.

Extinction Burst

A temporary increase in the frequency and intensity of responding when an extinction procedure is first implemented.

Increase in Variability

A side effect of extinction characterized by an increase in the variations of a behavior as the individual attempts different ways to obtain the reinforcer.

Frustration and Aggression

An emotional side effect of extinction in which the omission of expected reinforcement produces frustration, often followed by aggressive acts.

Resurgence

The reappearance during extinction of other behaviors that had once been effective in obtaining reinforcement.

Depression-like Behavior

A side effect of extinction characterized specifically by very low levels of activity.

Resistance to Extinction

The extent to which responding persists after an extinction procedure has been implemented, categorized as either high or low.

Partial Reinforcement Effect

The principle that behavior maintained on an intermittent (partial) reinforcement schedule extinguishes more slowly than behavior maintained on a continuous schedule.

Spontaneous Recovery

The reappearance of an extinguished response following a rest period after extinction.

Differential Reinforcement of Other Behavior (DRO)

The reinforcement of any behavior other than the target behavior that is being extinguished, which reduces unwanted extinction side effects.

Functional Communication Training

A variant of differential reinforcement of other behavior (DRO) where an individual is trained to verbally communicate what they want to reduce misbehavior.

Schedule of Reinforcement

The response requirement that must be met in order to obtain a reinforcer.

Steady-State Behaviors

Stable response patterns that emerge after considerable exposure to a particular reinforcement schedule.

Fixed Ratio (FR) Schedule

A schedule in which reinforcement is contingent upon emitting a fixed, predictable number of responses.

Variable Ratio (VR) Schedule

A schedule in which reinforcement is contingent upon emitting a varying, unpredictable number of responses around an average.

Fixed Interval (FI) Schedule

A schedule in which reinforcement is contingent on the first response performed after a fixed, predictable period of time.

Variable Interval (VI) Schedule

A schedule in which reinforcement is contingent on the first response performed after a varying, unpredictable period of time.

Fixed Duration (FD) Schedule

A schedule where a behavior must be performed continuously for a fixed, predictable period of time to obtain reinforcement.

Variable Duration (VD) Schedule

A schedule where a behavior must be performed continuously for a varying, unpredictable period of time to obtain reinforcement.

Fixed Time (FT) Schedule

A noncontingent schedule where a reinforcer is delivered after a fixed, predictable period of time, regardless of behavior.

Variable Time (VT) Schedule

A noncontingent schedule where a reinforcer is delivered following a varying, unpredictable period of time, regardless of behavior; may account for superstitious behaviors.

Stimulus Control

A state in which the presence of a discriminative stimulus reliably affects the probability of a behavior.

Stimulus Generalization

The tendency for an operant response to be emitted in the presence of a stimulus that is similar to the $S^D$.

Generalization Gradient

A graph depicting the tendency to respond to stimuli varying in similarity to the $S^D$, showing stronger responding to more similar stimuli.

Stimulus Discrimination

The tendency for an operant response to be emitted more in the presence of one stimulus (usually the $S^D$) than another.

Discrimination Training

The reinforcement of responding in the presence of an $S^D$ and the nonreinforcement of responding in the presence of an $S^\Delta$.

$S^\Delta$ (S-delta)

A discriminative stimulus for extinction that signals the nonreinforcement of a response.

Peak Shift Effect

The shift in the peak of a generalization gradient following discrimination training from the original $S^D$ to a stimulus further removed from the $S^\Delta$.

Multiple Schedule

Two or more independent schedules presented in sequence, each resulting in reinforcement and accompanied by a distinctive $S^D$.

A phenomenon where a change in the rate of reinforcement on one component of a multiple schedule produces an opposite change in the rate of response on another component.

Negative Contrast Effect

A type of behavioral contrast where an increase in the rate of reinforcement on one schedule produces a decrease in the response rate on the other schedule.

Positive Contrast Effect

A type of behavioral contrast where a decrease in the rate of reinforcement on one schedule produces an increase in the response rate on the other schedule.

Anticipatory Contrast

A phenomenon in which the rate of response varies inversely with an upcoming or anticipated change in the rate of reinforcement.

Errorless Discrimination Training

A gradual discrimination training procedure in which the $S^\Delta$ is introduced early in a weak form and gradually strengthened, minimizing errors and adverse emotional reactions.

Targeting

A stimulus control application in which an animal is trained to touch a specific object (such as a stick) so the handler can guide its movement.