1/24
Vocabulary flashcards covering Chapter 10: Learning and Behavior, including concurrent schedules of reinforcement, the matching law, undermatching, overmatching, bias, melioration theory, Skinnerian self-control, the Ainslie–Rachlin model, and the small-but-cumulative effects model.
Concurrent Schedule
The simultaneous presentation of two or more independent schedules of reinforcement, each leading to a reinforcer, giving the subject a choice between responding for a reinforcer on one schedule versus another.
Matching Law
The principle stating that on concurrent VI schedules, the proportion (or percentage) of responses emitted on a schedule will approximately match the proportion of reinforcers earned on that schedule.
Matching Law Equation
The mathematical formula expressed as: RA+RBRA=SAR+SBRSAR, in which R represents the number of responses emitted on schedules A and B, and SR represents the number of reinforcers earned on schedules A and B.
Undermatching
A deviation from matching where the proportion of responding on the richer versus poorer schedule is less different than predicted by matching, meaning the richer schedule is less preferred than predicted (e.g., obtaining proportions of 0.60 and 0.40 when matching predicts 0.75 and 0.25; often occurring when there is little cost for switching between schedules).
Changeover Delay (COD)
A short time delay or penalty imposed whenever a subject switches from one schedule to another in matching experiments, implemented to prevent undermatching.
Overmatching
A deviation from matching where the proportion of responding on the richer versus poorer schedule is more different than predicted by matching, meaning the richer schedule is more preferred than predicted (e.g., obtaining proportions of 0.90 and 0.10 when matching predicts 0.75 and 0.25; typically occurring when there is a high cost for switching between schedules).
Bias (in Matching)
A deviation from matching where one alternative receives a higher proportion of responding than predicted by matching regardless of whether it is the richer or poorer schedule, caused by a factor other than the amount of reinforcement (such as a tastier food item).
Maximization (Optimization) Theory
A theory proposing that matching relative responding to relative reinforcement occurs because doing so acts to maximize or optimize overall reinforcement.
Melioration Theory
A theory proposing that matching occurs because an organism shifts behavior toward a higher-value alternative regardless of its effect on the overall amount of reinforcement (to meliorate means "to make better").
Habituation in Melioration
A problem with melioration where overindulgence in a highly reinforcing alternative results in long-term habituation, thereby reducing its value as a reinforcer over time (e.g., playing a computer game so many hours a day that it becomes less enjoyable).
Self-Control (Skinner's Perspective)
The view that self-control is not an issue of willpower (which is a circular pseudo-explanation), but rather an issue of managing choices with conflicting outcomes (such as an immediate positive outcome paired with a delayed negative outcome).
Controlling Response
In Skinner's analysis of self-control, an action that alters the frequency of a subsequent controlled response (e.g., telling friends not to let you drink too much at a party).
Controlled Response
In Skinner's analysis of self-control, the target response whose frequency is altered or regulated by a preceding controlling response (e.g., the amount of alcohol actually consumed).
Satiation (as a Controlling Response)
A controlling response in which an individual diminishes the value of a potential temptation prior to facing it, such as eating a full meal before grocery shopping to reduce the temptation to buy junk food.
Self-Reinforcement
A controlling response where an individual delivers a reinforcer to themselves contingent upon completing a target behavior (e.g., watching a favorite TV show only after studying for two hours).
Short-Circuiting the Contingency
A difficulty encountered in self-reinforcement where an individual delivers the reward to themselves without having actually completed the required contingency (e.g., watching TV even if one did not study).
Self-Control (Temporal Perspective)
The behavioral act of choosing a larger later reward (LLR) over a smaller sooner reward (SSR).
Impulsiveness
The behavioral act of choosing a smaller sooner reward (SSR) over a larger later reward (LLR).
Smaller Sooner Reward (SSR)
An immediate or near-term reinforcer of lesser value (commonly referred to as a temptation) that competes with a delayed, higher-value alternative.
Larger Later Reward (LLR)
A delayed reinforcer of greater magnitude or long-term value (such as good grades or health) that requires forgoing an immediate reward.
Mischel's Delay of Gratification Paradigm
An experimental procedure where children choose between waiting for a period of time to receive two marshmallows (an LLR) or taking one marshmallow immediately without waiting (an SSR).
Ainslie–Rachlin Model of Self-Control
A model of self-control based on the principle that the value of a reward is a hyperbolic function of its delay, meaning its value increases slowly when the reward is distant and then increases sharply as the reward becomes imminent.
Preference Reversal
A shift in choice described by the Ainslie–Rachlin model in which an individual initially prefers the larger later reward (LLR) when both rewards are distant, but switches preference to the smaller sooner reward (SSR) as the SSR becomes imminent and its value surpasses that of the LLR.
Commitment Response
An action taken at an early point in time before an SSR becomes imminent that either completely eliminates or greatly reduces the value of the SSR, thereby preventing a preference reversal away from the LLR.
Small-But-Cumulative Effects Model
A model stating that each individual choice has a small but cumulative effect on the likelihood of obtaining a desired long-term goal, explaining why it is easy to justify giving in to temptation "just this once."