unit 7 - learning

classical conditioning

• pavolvian

• ex) salivating

• automatic/involuntary behaviors

• pairing

• learning associations between stimuli

• US, UR, NS, CS, CR

operant conditioning

• instrumental

• ex) sitting

• voluntary behaviors

• reinforcement and punishment

• positive and negative

• learning about action and consequence

unconditioned stimulus (US)

a stimulus that unconditionally—naturally and automatically—triggers a response —> food

unconditioned response (UR)

a naturally occurring response to an unconditioned stimulus —> salivation in response to food

neutral stimulus (NS)

a stimulus that elicits no response before conditioning —> tone

conditioned response (CR)

a learned response to a previously neutral (but now conditioned) stimulus —> salivation to the tone

conditioned stimulus (CS)

an originally irrelevant stimulus that after association with an unconditioned stimulus, comes to trigger a conditioned response —> tone when it produces salivation

classical conditioning 6 principles

1. acquisition

2. stimulus generalization

3. stimulus discrimination

4. extinction

5. spontaneous recovery

6. higher-order conditioning

acquisition (CC)

• when NS is consistently followed by an US

• increasing response is shown by the subject with repeated trails or exposure

stimulus generalization (CC)

• no actual pairing needed

• a stimulus similar to the original conditioned stimulus (CS) elicits a conditioned response (CR)

stimulus discrimination (CC)

• reversing generalization later/after

• only the conditioned stimulus (CS) elicits a conditioned response (CR)

extinction (CC)

• CS without US

• the gradual weakening and disappearance of a conditioned behavior or response, occurring when reinforcement (in operant conditioning) or the conditioned stimulus (in classical conditioning) is no longer presented

spontaneous recovery (CC)

sudden, temporary reappearance of a previously extinguished CR

higher-order conditioning (CC)

• requires pairing

• a classical conditioning process where a previously conditioned stimulus (CS1) acts as an unconditioned stimulus (US) to train a new neutral stimulus (CS2) to elicit the same conditioned response (CR)

reinforcement

• increases behavior

• primary and secondary

punishment

• decreases behavior

• primary and secondary

primary reinforcers

• unlearned/innate

  • food, water, sex, connection, endorphins

secondary reinforcers

• learned

  • money, video game quests, stickers/tokens

primary punishers

• unlearned/innate

  • pain, deprivation (of food or water)

secondary punishers

• learned

  • legal consequences, fines, low grades

positive

• consequence involves arrival/addition of something new

  • ex) give dog a treat after sitting

negative

• consequence involves removal/subtraction of something that was already there

• ex) shock collar dog after sitting

positive reinforcement

• adding a stimulus

  • usually one thats wanted

• ex) arrival of delicious food

negative reinforcement

• removing a stimulus

  • usually one thats not wanted

• removal of cold

positive punishment

• adding a stimulus

  • usually one thats not wanted

• ex) “No!”, hitting/slapping

negative punishment

• removing a stimulus

  • usually one thats wanted

• ex) revoking privileges (grounded)

shaping

• rewarding successive approximation of a task

• ex) giving dog treat for laying down, then rolling over

operant conditioning 4 principles

1. acquisition

2. generalization

3. discrimination

4. extinction

acquisition (OC)

an organism voluntarily links a response with a consequence (such as a reward)

generalization (OC)

an organism voluntarily responds to a new stimulus as if it were the previously learned stimulus

discrimination (OC)

the learned ability to distinguish between similar stimuli and to respond accordingly

extinction (OC)

a gradual diminishing of a response when it is no longer reinforced

intermittent reinforcement

• specific patterns of reinforcement that determine when a behavior will be maintained; may be fixed or variable

• ratio and interval schedules

ratio schedules

• response based

• fixed ratio (FR)

• variable ratio (VR)

fixed ratio (FR)

• where a reward is provided only after a specific, consistent number of responses

• ex) buy 9 get 10th free

variable ratio (VR)

• where reinforcement (a reward) is delivered after an unpredictable number of responses

• ex) gambling, claw machine

interval schedules

• time based

• fixed interval (FI)

• variable interval (VI)

fixed interval (FI)

• where the first response is rewarded only after a set, predictable amount of time has passed

• ex) weekly paychecks

variable interval (VI)

• where reinforcement (a reward) is delivered after an unpredictable, varying amount of time has passed, provided a specific response is made

• pop quizzes for attendance