L&B Exam 3

Intrinsic motivation

The behavior is reinforcing in and of itself

Extrinsic motivation

Reinforcement is external to the behavior

Learned industriousness

Getting pleasure from hard work

Reduction of intrinsic motivation

Knowing you will receive extrinsic motivation reinforcement ahead of time may reduce the intrinsic motivation of a behavior

Extrinsic rewards more likely to undermine intrinsic motivation when

1. Reinforcement expected

2. Reinforcement is visible/tangible

3. Reinforcement is given simply just for performing the activity

Extrinsic reinforcement works best when

1. Reinforcement is based on performance

2. Reinforcement is unexpected

3. Reinforcement is not overemphasized

6 steps to modify behavior

1. Identify behavior

2. Observe target behavior (baseline measurement)

3. Monitor antecedents and consequences of baseline behaviors

4. Design intervention

5. Enlist social support

6. Monitor and record progress

ABA (B) designs

A= Baseline/no intervention

B= Intervention

Once target behavior is reached

Switch to maintenance schedule: CRF to partial reinforcement, extrinsic motivation to intrinsic motivation

Fixed ratio

A fixed number of responses must be performed for each reinforcement

Post-reinforcement pausing

Occurs after a reinforcement due to the predictability of the schedule (fixed ratio)

Ratio run

A rapid burst of behavior that occurs between a reinforcement and the behavior required for the next reinforcement

Ratio strain

Like burnout at a job, the reinforcement requires too much effort

Variable ratio

Different number of responses are performed for each reinforcement (varies, but all centered around an average) (golf, gambling)

Fixed interval

Fixed amount of time must pass before reinforcement is delivered

Fixed interval scallop

Once the timing is learned, as the time for the availability of the next reinforcer approaches, the response rate increases

Variable interval

A different amount of time must pass on each trial before a response is reinforced (centers around an average)

Schedules that gives highest rate of responding

Ratio schedules (or fixed?)

Schedules that gives a more steady rate of responding

Variable schedules

Duration schedule

Behavior must be performed continuously for a set amount of time before reinforcement is delivered

Non-contingent schedules

Reinforcement is delivered after a set amount of time, no matter if the organism performs the behavior or not

Superstitious behavior

Can be created by non-contingent reinforcement

Unconditional positive regard

Receiving love, respect, and acceptance for who you are from significant people in your life, regardless of behavior. Can lead to learned laziness or spoiled behavior

Reinforcement

A pleasurable stimulus

Drive Reduction Theory

Reinforcer is associated with a reduction in a physiological drive. Deprivation and reinforcement are opposing processes.

Premack principle

Reinforcement is a special kind of behavioral response, not a stimulus. Bar pressing to eat food (the act of eating the food is reinforcing, not the food itself)

Two behaviors of Premack principle

1. One behavior that is being reinforced (the operant- Low Probability Behavior)

2. One behavior that acts as the reinforcement (High Probability Behavior)

Response Deprivation Hypothesis

Reinforcement is a special kind of behavioral response, but it is special because it is being deprived. ONLY the restriction matters

Extinction in operant conditioning

Behavioral response no longer followed by expected reinforcement

What might you see when extinction occurs

1. Extinction bursts

2. Variability in operant behavior

3. Emotional side effects

4. Frustration responses

What schedule leads to higher resistance to extinction

Variable schedule (extinction)

Partial reinforcement extinction effect

Behaviors that have been partially reinforced take longer to extinguish

What influences how quickly behaviors extinguish

1. Schedule of reinforcement the organism was on

2. History of reinforcement (if behavior was reinforced more in the past, it will be harder to extinguish)

3. Degree of deprivation (if deprived of the reinforcer for longer, the longer extinction will take)

Differential reinforcement of other behavior

Ignore target behavior (inappropriate behaviors), reinforce all appropriate behaviors

In a multiple choice situation, each behavior:

1. Produces a different type of behavior

2. Is reinforced on a different schedule

3. Is reinforced at different times (immediate vs. delayed)

4. Is different in its commitment

Concurrent schedule

Simultaneous presentation of two or more independent schedules, each of which leads to a reinforcer and can be freely chosen at any time

VR-VR concurrent schedule

Leads to exclusive preference for the choice that requires less work for the reinforcement

VI-VI concurrent schedule

Leads to distribution of responses in a way that maximizes total reinforcement

The Matching Law

The proportion of responses emitted on a schedule should approximately match the proportion of reinforcers obtained on that schedule (works for a VI-VI schedule)

Deviations from matching law

1. Undermatching (less difference in response rates than predicted)

2. Overmatching (more difference in response rates than predicted)

3. Bias (spend more time on one choice just because of bias)

Changeover delay

Any response emitted immediately after switching from one choice to another does not receive a reinforcer for a brief period

Concurrent chain schedule

2 choices available, but once you select one, you are locked into it for a specific amount of time

Self-control

Being able to choose a larger, delayed reward over an immediate, smaller reward

How does time influence self-control

If humans have to wait for reinforcement, no matter the option, they are more likely to choose the larger option

Melioration theory

Organisms naturally shift their efforts towards whatever choice currently offers the greatest reinforcement in that moment

Examples of humans putting off punishment for immediate rewards

Continuing to smoke= immediate rewards, delayed consequences

Quitting smoking= immediate consequence, delayed reward

Ainslie-Rachlin Model

Predeicts that a switch in choice from an LLR to and SSR will occur as the time for the SSR gets closer

State self-control

The way someone chooses to behave at a particular moment in time

Trait self-control

An ability to demonstrate self-control as an element of one’s personality or disposition (higher conscientiousness)

How to make it easier to wait for LLR

1. Distract yourself while you wait

2. Pre-commit before being faced with the temptation of SSR

3. Reframe SSR in a way that reduces its emotional appeal

4. Reframe LLR in a way that makes it appear more valuable