Operant Conditioning

Operant conditioning

Learning that occurs based on consequences of voluntary behavior

Law of Effect

¡Behaviors followed by pleasant outcome = more likely to be repeated

¡Behaviors followed by unpleasant outcome = less likely to be repeated

Cat in puzzle box

x scratch door, meow, put paws through openings

move lever (right)

Skinner box

¡Study operant learning in animals

¡Controlled environment

¡Focus on reinforcement and punishment

Reinforcement

any stimulus/event that strengthens/increases behavior

Punishment

any stimulus/event that weakens/decreases behavior

Positive

¡stimulus is presented

¡Something gets added

Negative

stimulus is removed

¡Something gets taken away

Continuous reinforcement

¡Reinforcement presented after EVERY response

¡Teaching new behavior or skill

¡Fast initial learning

¡Fast extinction – broken vending machine

Intermittent reinforcement

¡Response is sometimes reinforced, sometimes not

¡Slower initial learning

¡More resistant to extinction

¡Maintain and sustain behaviors over the long term

Fixed-interval schedule

Behavior reinforced after specific amount of time has passed

2-minute fixed-interval schedule

¡Behavior reinforced ONLY after 2 minutes has passed since the last reinforcement

¡Rats and pigeons = lots of responding as interval ending

Fixed-ratio schedule

¡Behavior reinforced after specific number of responses

¡Customer loyalty programs

Variable-ratio schedule

¡Behavior reinforced after an average number of responses

Slot machine pay off

Every 100 pulls, on average

Ratio schedules

greater response rates (compared to interval)

Unpredictable (variable) schedules

¡greater response rates (compared to fixed)

¡Slot machines, lottery tickets – keep playing because you never know when you could win!

Dash

reinforcement occurs

VR

steady, persistent (produces most responses)

FR

work steadily for reward

VI

gradual, steady (less predictable)

FI

increase, then drop off (lots of responding as interval ends, but then decreases)