Operant Conditioning: Reinforcement, Schedules & Extinction

Thorndike

Conducted the first experimental studies of operant conditioning using puzzle boxes with cats.

Trial-and-Error Learning

Learning through repeated attempts in which successful responses are strengthened and unsuccessful responses are weakened.

Law of Effect

Behaviors followed by satisfying consequences are strengthened; behaviors followed by unsatisfying consequences are weakened.

Skinner

Developed the Skinner Box and expanded the study of operant conditioning.

Skinner Box

An operant chamber where an animal can make responses and receive consequences such as food.

Operant Conditioning

A type of learning in which the future probability of a behavior is affected by its consequences.

Operant Behavior

A behavior that operates on the environment to produce consequences.

Reinforcer

A consequence that increases the future probability of a behavior.

Punisher

A consequence that decreases the future probability of a behavior.

Three-Term Contingency (ABC)

Antecedent, Behavior, Consequence.

Antecedent

An event or stimulus that occurs before a behavior.

Behavior

An observable response emitted by an organism.

Consequence

An event that follows a behavior and affects its future occurrence.

Positive Reinforcement

Adding a desirable stimulus to increase behavior.

Negative Reinforcement

Removing an aversive stimulus to increase behavior.

Positive Punishment

Adding an aversive stimulus to decrease behavior.

Negative Punishment

Removing a desirable stimulus to decrease behavior.

Escape Behavior

A behavior that terminates an aversive stimulus that is already present.

Avoidance Behavior

A behavior that prevents an aversive stimulus from occurring.

Primary Reinforcer

A naturally reinforcing stimulus such as food, water, or shelter.

Secondary (Conditioned) Reinforcer

A stimulus that becomes reinforcing through association with a primary reinforcer.

Generalized Reinforcer

A conditioned reinforcer associated with many other reinforcers, such as money.

Shaping

Reinforcing successive approximations of a target behavior.

Fixed Schedule

A schedule in which reinforcement occurs in a predictable manner.

Variable Schedule

A schedule in which reinforcement occurs unpredictably around an average.

Ratio Schedule

Reinforcement based on the number of responses.

Interval Schedule

Reinforcement based on the passage of time.

Continuous Reinforcement

Reinforcement delivered after every response (FR-1).

Intermittent Reinforcement

Reinforcement delivered only after some responses.

Fixed Ratio (FR)

Reinforcement after a fixed number of responses.

Variable Ratio (VR)

Reinforcement after an unpredictable number of responses.

Fixed Interval (FI)

Reinforcement for the first response after a fixed time period.

Variable Interval (VI)

Reinforcement for the first response after varying time intervals.

Ratio Strain

A decrease in responding caused by increasing the response requirement too quickly.

Stretching the Ratio

Gradually increasing the response requirement to maintain behavior while avoiding ratio strain.

Fixed Duration Schedule

Reinforcement contingent on continuously performing a behavior for a specific amount of time.

Noncontingent Reinforcement

Reinforcement delivered independently of behavior.

Superstitious Behavior

Behavior that develops when accidental reinforcement strengthens a response.

Conjunctive Schedule

A complex schedule in which reinforcement requires meeting two or more schedule requirements.

Chained Schedule

A sequence of two or more simple schedules that must be completed in order.

Premack Principle

A high-probability behavior can reinforce a low-probability behavior.

Short-Circuiting the Contingency

Having control over the reinforcer, making it difficult to maintain reinforcement contingencies.

Extinction

The nonreinforcement of a previously reinforced behavior, resulting in a decrease in that behavior.

Extinction Procedure

Withholding reinforcement for a previously reinforced response.

Extinction Process

The decrease in response strength that occurs when reinforcement is removed.

Extinction Burst

A temporary increase in the frequency or intensity of a behavior when extinction begins.

Increase in Variability

Trying new forms of behavior when a previously reinforced behavior is no longer reinforced.

Emotional Behavior

Frustration or emotional responses that may occur during extinction.

Aggression

An emotional reaction that may occur when reinforcement is withheld.

Resurgence

The reappearance of previously reinforced behaviors during extinction.

Depression (Extinction)

Reduced activity levels that may occur during extinction.

Resistance to Extinction

The persistence of behavior after reinforcement has been removed.

Partial Reinforcement Effect

Behavior reinforced intermittently is more resistant to extinction than behavior reinforced continuously.

Differential Reinforcement of Other Behavior (DRO)

Reinforcing any behavior other than the target behavior.

Differential Reinforcement of Incompatible Behavior (DRI)

Reinforcing a behavior that cannot occur at the same time as the target behavior.

Response Cost

A form of negative punishment involving the loss of a specific reinforcer.

Time-Out

A form of negative punishment involving temporary removal from access to reinforcement.

Shuttle Avoidance Procedure

A procedure in which an animal moves back and forth to avoid an aversive stimulus.

Two-Process Theory of Avoidance

Theory stating that avoidance learning involves both classical and operant conditioning.

Process 1 of Two-Process Theory

Classical conditioning creates fear in response to a conditioned stimulus.

Process 2 of Two-Process Theory

Avoidance behavior reduces fear, which serves as negative reinforcement.

OCD

Considered a form of active avoidance behavior.

Phobia

Considered a form of passive avoidance behavior.

Problems with Punishment

Can cause fear, aggression, avoidance, and only temporary suppression of behavior.

Effective Punishment

Should be immediate, consistent, sufficiently intense, and paired with reinforcement of appropriate behavior.

Premack Principle of Punishment

Restricting access to a preferred activity contingent on an undesirable behavior.

Learned Helplessness

A condition in which repeated exposure to uncontrollable aversive events leads to passive behavior and failure to escape.