Chapter 7: Operant Conditioning: Schedules and Theories of Reinforcement

Schedule of Reinforcement

The response requirement that must be met to obtain reinforcement, which can be continuous or intermittent.

Continuous Reinforcement Schedule

A schedule where each specified response is reinforced. Each time a rat presses the lever, it obtains a food pellet

Intermittent Reinforcement Schedule

A schedule where only some responses are reinforced. Only some of the rats lever presses results in a food pellet

Fixed Ratio (FR) Schedule

Reinforcement is contingent upon a fixed, predictable number of responses.

Variable Ratio (VR) Schedule

Reinforcement is contingent upon an unpredictable number of responses.

Fixed Interval (FI) Schedule

Reinforcement is given after a fixed period of time, assuming the desired response occurs.

Variable Interval (VI) Schedule

Reinforcement is given after varying periods of time, assuming the desired response occurs.

Rich Schedule

Schedules where the reinforcer is easily obtained.

Lean Schedule

Schedules where the reinforcer is difficult to obtain.

Stretching the Ratio

The gradual increase of response requirement from a low to high ratio.

Ratio Strain

The problem that occurs when stretching the ratio too quickly, leading to decreased response rates.

Fixed Duration (FD) Schedule

Reinforcement is contingent upon continuous performance of a behavior for a fixed, predictable period.

Variable Duration (VD) Schedule

Reinforcement is contingent upon continuous performance of a behavior for a varying, unpredictable period.

Differential Reinforcement of High Rates (DRH)

Reinforcement is contingent upon emitting at least a certain number of responses within a specific time frame. Ex. a child struggles to do their homework quickly, and instead of rewarding them for completing the homework, set a timer and reward them when they finish in a specific time frame. Praise a small reward like extra screen time. The outcome is reinforcing the behavior when it's done quickly, encouraging the child to work at a faster pace.  

Differential Reinforcement of Low Rates (DRL)

Reinforcement is used to encourage less frequent behavior or longer pauses between responses. Slow motion exercise tai chi, more slowly the person moved the more throughout his muscles relaxed.

Noncontingent Reinforcement

Reinforcement delivered independently of any response.

Fixed Time (FT) Schedule

Reinforcement delivered following a fixed, predictable period of time, regardless of behavior.

Variable Time (VT) Schedule

Reinforcement delivered following a varying, unpredictable period of time, regardless of behavior.

Generalization Gradient

A representation of the degree of responding given various stimuli, indicating how similar stimuli elicit similar responses.

Discrimination Training

Reinforcing responses in the presence of one stimulus while ignoring them in the presence of another.

Peak Shift

The peak of a generalization gradient shifting away from the original stimulus following discrimination training.

Multiple Schedule

Two or more independent schedules presented in sequence, each resulting in reinforcement.

Chained Schedule

A sequence of two or more simple schedules, each with its own discriminative stimulus that leads to a terminal reinforcer.

Resistance to Extinction

The extent to which responding persists after an extinction procedure has been implemented.

DRO Procedure

Reinforcement of any behavior other than the target behavior being extinguished.

Contrast Effects

Changes in the strength of behavior in one setting as a consequence of behavior in another setting.