1/50
Looks like no tags are added yet.
Concurrent schedules of reinforcement
The simultaneous availability of two or more independent reinforcement schedules, allowing an organism to choose.
Matching law
The proportion of responses allocated to an alternative matches the proportion of reinforcers obtained from that alternative.
Matching law equation
RA/(RA + RB) = SR+A/(SR+A + SR+B)
Undermatching
When response allocation is less extreme than reinforcement allocation; preferences are closer to indifference.
Overmatching
When response allocation is more extreme than reinforcement allocation; preferences favor one alternative disproportionately.
Bias from matching
When an alternative consistently receives more responses than predicted by its reinforcement rate.
Changeover delay (COD)
A brief period after switching alternatives during which responses cannot produce reinforcement.
Reinforcer quality
The relative attractiveness or value of a reinforcer, which can influence response allocation.
Melioration theory
The tendency for behavior to shift toward alternatives with greater immediate value, even when doing so reduces overall reinforcement.
Self-control
A choice involving a smaller, sooner reinforcer versus a larger, later reinforcer.
Impulsiveness
Choosing a smaller, sooner reinforcer instead of a larger, later reinforcer.
Self-management
Managing behavior by changing the conditions that influence one's own responses.
Controlling response
A response that changes the likelihood or frequency of another, controlled response.
Physical restraint
Manipulating the environment to prevent an unwanted behavior from occurring.
Deprivation and satiation
Altering the effectiveness of a stimulus as a reinforcer by changing access to it.
Doing something else
Engaging in an alternative activity that makes an unwanted response less likely.
Self-reinforcement and self-punishment
Personally delivering a consequence contingent on one's own behavior.
Delay of gratification
Choosing to forgo a smaller immediate reward to obtain a larger delayed reward.
Walter Mischel
Researcher associated with early systematic delay-of-gratification experiments involving children.
Mischel's delay-of-gratification strategies
Children used distraction, physical restraint, and abstract representations to help resist immediate rewards.
Preference reversal
A change in preference when a smaller-sooner reward becomes imminent and gains relative value.
Ainslie-Rachlin theory
The value of a reinforcer increases as its delay decreases, producing potential reversals in preference.
Hyperbolic discounting
The tendency for the subjective value of a reward to decline disproportionately as its delay increases.
Commitment response
An early action that eliminates or substantially reduces the value of a future temptation.
Behavioral contracting
A formal arrangement specifying rewards for desired behavior or punishers for undesired behavior.
Precommitment
Restricting future choices in advance to make self-control more likely.
Small-but-cumulative effects model
Repeated small choices can accumulate into substantial long-term consequences.
Delayed consequences
Consequences that often exert weaker behavioral control because they are distant and less certain.
Biological preparedness
An innate tendency to learn certain associations or behaviors more readily than others.
Taste aversion conditioning
A conditioned aversion develops when a food is associated with gastrointestinal illness.
Conditioned taste aversion (CTA)
The learned avoidance of a food or flavor previously associated with illness.
Specificity of associations
The tendency to associate particular stimuli with biologically relevant consequences.
Stimulus generalization of CTA
An acquired aversion to one food or flavor extends to similar foods or flavors.
Extinction of CTA
A conditioned food aversion weakens when the food is repeatedly consumed without subsequent illness.
Overshadowing in CTA
One stimulus becomes a stronger predictor of illness than another simultaneously presented stimulus.
Blocking in CTA
An established association prevents a new stimulus from acquiring predictive value when both are presented together.
Latent inhibition
Previous exposure to a stimulus without consequences makes it harder to condition that stimulus later.
CS-US relevance
The biological compatibility between a conditioned stimulus and an unconditioned stimulus influences learning.
Species-specific defense reaction (SSDR)
An innate defensive response that an organism tends to perform in threatening situations.
Instinctive drift
A learned behavior gradually shifts toward an organism's innate behavioral tendencies.
Sign tracking
Approaching or interacting with a stimulus that signals the availability of a biologically significant event.
Autoshaping
The development of a response to a stimulus paired with response-independent reinforcement.
Stimulus-substitution theory
The idea that a conditioned stimulus elicits a response resembling the response originally produced by the unconditioned stimulus.
Negative automaintenance
Responding persists toward a food-predictive stimulus even when that response prevents reinforcement.
Adjunctive behavior
An additional behavior that emerges as a side effect of intermittent reinforcement of another behavior.
Interreinforcement interval
The time between successive reinforcers in a reinforcement schedule.
Displacement activity
An apparently unrelated activity that occurs when an organism is conflicted or unable to perform a competing behavior.
Activity anorexia
A pattern in which restricted feeding and excessive wheel running reinforce a potentially dangerous cycle in laboratory animals.
Behavior systems theory
The idea that behavior is organized into motivational systems, such as feeding, mating, and predator avoidance.
Environmental cues
Features of the environment that guide or influence behavior within an organism's motivational system.
Heredity and learning
Both inherited biological tendencies and individual learning experiences contribute to behavior.