Chapter 10: Learning and Behavior - Choice, Matching, and Self-Control

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/24

flashcard set

Earn XP

Description and Tags

Vocabulary flashcards covering Chapter 10: Learning and Behavior, including concurrent schedules of reinforcement, the matching law, undermatching, overmatching, bias, melioration theory, Skinnerian self-control, the Ainslie–Rachlin model, and the small-but-cumulative effects model.

25 Terms

1
New cards

Concurrent Schedule

The simultaneous presentation of two or more independent schedules of reinforcement, each leading to a reinforcer, giving the subject a choice between responding for a reinforcer on one schedule versus another.

2
New cards

Matching Law

The principle stating that on concurrent VIVI schedules, the proportion (or percentage) of responses emitted on a schedule will approximately match the proportion of reinforcers earned on that schedule.

3
New cards

Matching Law Equation

The mathematical formula expressed as: RARA+RB=SARSAR+SBR\frac{R_A}{R_A + R_B} = \frac{S^R_A}{S^R_A + S^R_B}, in which RR represents the number of responses emitted on schedules AA and BB, and SRS^R represents the number of reinforcers earned on schedules AA and BB.

4
New cards

Undermatching

A deviation from matching where the proportion of responding on the richer versus poorer schedule is less different than predicted by matching, meaning the richer schedule is less preferred than predicted (e.g., obtaining proportions of 0.600.60 and 0.400.40 when matching predicts 0.750.75 and 0.250.25; often occurring when there is little cost for switching between schedules).

5
New cards

Changeover Delay (COD)

A short time delay or penalty imposed whenever a subject switches from one schedule to another in matching experiments, implemented to prevent undermatching.

6
New cards

Overmatching

A deviation from matching where the proportion of responding on the richer versus poorer schedule is more different than predicted by matching, meaning the richer schedule is more preferred than predicted (e.g., obtaining proportions of 0.900.90 and 0.100.10 when matching predicts 0.750.75 and 0.250.25; typically occurring when there is a high cost for switching between schedules).

7
New cards

Bias (in Matching)

A deviation from matching where one alternative receives a higher proportion of responding than predicted by matching regardless of whether it is the richer or poorer schedule, caused by a factor other than the amount of reinforcement (such as a tastier food item).

8
New cards

Maximization (Optimization) Theory

A theory proposing that matching relative responding to relative reinforcement occurs because doing so acts to maximize or optimize overall reinforcement.

9
New cards

Melioration Theory

A theory proposing that matching occurs because an organism shifts behavior toward a higher-value alternative regardless of its effect on the overall amount of reinforcement (to meliorate means "to make better").

10
New cards

Habituation in Melioration

A problem with melioration where overindulgence in a highly reinforcing alternative results in long-term habituation, thereby reducing its value as a reinforcer over time (e.g., playing a computer game so many hours a day that it becomes less enjoyable).

11
New cards

Self-Control (Skinner's Perspective)

The view that self-control is not an issue of willpower (which is a circular pseudo-explanation), but rather an issue of managing choices with conflicting outcomes (such as an immediate positive outcome paired with a delayed negative outcome).

12
New cards

Controlling Response

In Skinner's analysis of self-control, an action that alters the frequency of a subsequent controlled response (e.g., telling friends not to let you drink too much at a party).

13
New cards

Controlled Response

In Skinner's analysis of self-control, the target response whose frequency is altered or regulated by a preceding controlling response (e.g., the amount of alcohol actually consumed).

14
New cards

Satiation (as a Controlling Response)

A controlling response in which an individual diminishes the value of a potential temptation prior to facing it, such as eating a full meal before grocery shopping to reduce the temptation to buy junk food.

15
New cards

Self-Reinforcement

A controlling response where an individual delivers a reinforcer to themselves contingent upon completing a target behavior (e.g., watching a favorite TV show only after studying for two hours).

16
New cards

Short-Circuiting the Contingency

A difficulty encountered in self-reinforcement where an individual delivers the reward to themselves without having actually completed the required contingency (e.g., watching TV even if one did not study).

17
New cards

Self-Control (Temporal Perspective)

The behavioral act of choosing a larger later reward (LLR) over a smaller sooner reward (SSR).

18
New cards

Impulsiveness

The behavioral act of choosing a smaller sooner reward (SSR) over a larger later reward (LLR).

19
New cards

Smaller Sooner Reward (SSR)

An immediate or near-term reinforcer of lesser value (commonly referred to as a temptation) that competes with a delayed, higher-value alternative.

20
New cards

Larger Later Reward (LLR)

A delayed reinforcer of greater magnitude or long-term value (such as good grades or health) that requires forgoing an immediate reward.

21
New cards

Mischel's Delay of Gratification Paradigm

An experimental procedure where children choose between waiting for a period of time to receive two marshmallows (an LLR) or taking one marshmallow immediately without waiting (an SSR).

22
New cards

Ainslie–Rachlin Model of Self-Control

A model of self-control based on the principle that the value of a reward is a hyperbolic function of its delay, meaning its value increases slowly when the reward is distant and then increases sharply as the reward becomes imminent.

23
New cards

Preference Reversal

A shift in choice described by the Ainslie–Rachlin model in which an individual initially prefers the larger later reward (LLR) when both rewards are distant, but switches preference to the smaller sooner reward (SSR) as the SSR becomes imminent and its value surpasses that of the LLR.

24
New cards

Commitment Response

An action taken at an early point in time before an SSR becomes imminent that either completely eliminates or greatly reduces the value of the SSR, thereby preventing a preference reversal away from the LLR.

25
New cards

Small-But-Cumulative Effects Model

A model stating that each individual choice has a small but cumulative effect on the likelihood of obtaining a desired long-term goal, explaining why it is easy to justify giving in to temptation "just this once."