Chapter 7: Operant Conditioning: Schedules and Theories of Reinforcement

Schedule of Reinforcement

The response requirement that must be met to obtain reinforcement, which can be continuous or intermittent.

Continuous Reinforcement Schedule

A schedule where each specified response is reinforced. Each time a rat presses the lever, it obtains a food pellet

Intermittent Reinforcement Schedule

A schedule where only some responses are reinforced. Only some of the rats lever presses results in a food pellet

Fixed Ratio (FR) Schedule

Reinforcement is contingent upon a fixed, predictable number of responses.

Variable Ratio (VR) Schedule

Reinforcement is contingent upon an unpredictable number of responses.

Fixed Interval (FI) Schedule

Reinforcement is given after a fixed period of time, assuming the desired response occurs.

Variable Interval (VI) Schedule

Reinforcement is given after varying periods of time, assuming the desired response occurs.

Rich Schedule

Schedules where the reinforcer is easily obtained.

Lean Schedule

Schedules where the reinforcer is difficult to obtain.

Stretching the Ratio

The gradual increase of response requirement from a low to high ratio.

Ratio Strain

The problem that occurs when stretching the ratio too quickly, leading to decreased response rates.

Fixed Duration (FD) Schedule

Reinforcement is contingent upon continuous performance of a behavior for a fixed, predictable period.

Variable Duration (VD) Schedule

Reinforcement is contingent upon continuous performance of a behavior for a varying, unpredictable period.

Differential Reinforcement of High Rates (DRH)

Reinforcement is contingent upon emitting at least a certain number of responses within a specific time frame. Ex. a child struggles to do their homework quickly, and instead of rewarding them for completing the homework, set a timer and reward them when they finish in a specific time frame. Praise a small reward like extra screen time. The outcome is reinforcing the behavior when it's done quickly, encouraging the child to work at a faster pace.  

Differential Reinforcement of Low Rates (DRL)

Reinforcement is used to encourage less frequent behavior or longer pauses between responses. Slow motion exercise tai chi, more slowly the person moved the more throughout his muscles relaxed.

Noncontingent Reinforcement

Reinforcement delivered independently of any response.EX. a teacher providing a student with attention every ten minutes regardless of behavior

Fixed Time (FT) Schedule

Reinforcement delivered following a fixed, predictable period of time, regardless of behavior.

Variable Time (VT) Schedule

Reinforcement delivered following a varying, unpredictable period of time, regardless of behavior.

Generalization Gradient

A visual representation of the degree of responding given various stimuli, indicating how similar stimuli elicit similar responses.

Discrimination Training

Reinforcing responses in the presence of one stimulus while ignoring them in the presence of another.

Peak Shift

The peak of a generalization gradient shifting away from the original stimulus following discrimination training, towards a stimulus that is more different from the less favorable stimulus. 

Multiple Schedule

Two or more independent schedules presented in sequence, each resulting in reinforcement.

Chained Schedule

A sequence of two or more simple schedules, each with its own discriminative stimulus that leads to a terminal reinforcer.

Resistance to Extinction

The extent to which responding persists after an extinction procedure has been implemented. Ex. A dog that continues to beg for food at the dinner table for 20 minutes after everyone has stood feeding it is displaying much higher resistance to extinction than does a dog that stops begging after 5 minutes.  

DRO Procedure

Reinforcement of any behavior other than the target behavior being extinguished. This procedure tends to be more effective than extinction procedures because the target behavior is weakened both by lack of reinforcement for that behavior and by reinforcement of alternative behaviors coming to replace it.  

The occurrence of these contrast effects indicates that behaviors should not be viewed in isolation. Consequences for behavior in one setting can greatly affect the strength of behavior in another setting.  

What are the lessons derived from the contrast literature (in the first two sentences of 317,2)? 

Conjunctive Schedule

Two or more simple schedules must be met before a reinforcer is delivered. E.g A student must complete 15 math problems and complete another correct response after a 10-minute interval to earn reinforcement.

Adjusting Schedule

Response requirement changes as a function of the organism's performance while responding for the previous reinforcer.