Chapter 10: Choice, Matching, & Self-Control

Concurrent Schedule

Since VI schedules are time based and unpredictable, if you only stick to one alternative it could cause missing reinforces that are available in the other schedule. They would get the maximum amount # of reinforcers and if they only spend time on the richer schedules, they would be waiting for other reinforcers to become available on the leaner schedule

Why should choice between VR schedules always be exclusive?

Because the more you work on a VR schedule, the more reinforcement you get, leading to exclusive preference for the alternative that provides the most reinforcement.

Why should choice between VI schedules not be exclusive?

Because VI schedules are unpredictable and time-based, sticking to one alternative could cause missed reinforcers available on the other schedule.

Matching Law

The principle that the proportion of responses emitted on a particular schedule matches the proportion of the reinforcers obtained on that schedule.

Undermatching

The condition where the proportion of responses on the richer schedule versus the poorer schedule is less different than would be predicted by the Matching Law.

Overmatching

The condition where the proportion of responses on the richer schedule versus the poorer schedule is more different than would be predicted by the Matching Law.

How can you use a concurrent schedule to determine pigeon preference for mixed grain or pigeon chow?

By setting up a VI-30 schedule for mixed grain and a VI-60 for pigeon chow, you can measure responses, time spent pecking, and reinforcers earned to determine preference using the Matching Law.

Physical restraint (controlling response)

Manipulating the environment to avoid problem behaviors, e.g., leaving money at home to avoid overspending.

Depriving and Satiating (controlling response)

Using deprivation and satiation to influence the value of a reinforcer, e.g., dieting to reduce temptation for sweets after meals.

Doing something else (controlling response)

Performing an alternate behavior to prevent engaging in undesired behavior, e.g., chewing gum instead of smoking.

Self-reinforcement and self-punishment (controlling response)

One of Skinners four controlling responses: Reinforcing or punishing one's own behavior for self-control.

how the temporal aspects of reinforcers affect self-control

Lack of self-control arises from the fact that our behavior is more heavily influenced by immediate consequences than delayed consequences.  

Function shown in Figure 10.3

As the delay to a reward decreases, its perceived value increases slowly at first, then sharply as it becomes imminent.

Commitment responses

Actions taken early that reduce the value of a future temptation, e.g., setting a reading goal and sharing it with friends to increase accountability.