chapter 8 extinction

extinction

is the nonreinforcement of a previously reinforced R, the result of which is a decrease in the strength of that R, the procedure is the nonreinforcement of a previously reinforced R and the process is the resultant decrease in R strength

extinction burst

a temporary increase in frequency and intensity of R when extinction is first implemented, ie. rat will press lever more rapidly and forcefully when extinction is first exposed

increase in variability

change in how B is performed after extinction is presented to see if rein. will be delivered, ie. if the rat typically pressed the lever with its right paw, it might now try pressing with left paw

emotional behavior

also frustration, or B after extinction is just presented, ie. angry B in response to a vending machine

agression

an emotional R to extinction, ie. uncooperative vending machines are sometimes attacked

resurgence

the reapperance during extinction of other B that had once been effective in obtaining rein., ie. a husband faced with a wife who largely ignores him might begin spending more time with old friends

depression

low activity is a common symptom of depression, ie. if someone dies, people become depressed

side effects of extinction

side effects often impede successful implementation of extinction and can inadvertedly strengthen B if one suddenly gives in and provides subject with soughtafter rein., ie. whining child

resistance to extinction

the extent to which responding persists after an extinction procedure has been implemented, persistent R have high resistance, ie. dog begging for food

schedule of reinforcement

resistance to extinction is particularly strong when B has been maintained on a variable ratio schedule, less frequent the rein. the longer it takes to “discover” that the rein. is no longer available

partial reinforcement effect

B that has been maintained on an intermittent schedule will extinguish more slowly than B that has been maintained on a continuous schedule

removing unwanted B

partial rein. effect helps account for unwanted B that are difficult to eliminate, it helps to spend first several days reinforcing each instance of unwanted B, ie. gambling

history of reinforcement

the more rein. an individual has received for a B, the greater the resistance to extinguish, ie. a rat reinforced 10 times will be weaker than a rat reinforced 100 times

magnitude of the reinforcer

large magnitude rein. sometimes results in increase resistance than small magnitude, ie. preferred food harder to extinguish v. less preferred food

degree of deprivation

greater level of deprivation=greater resistance, ie. a rat that has 90% free feeding will will stop lever pressing quicker than 80% free will

previous experience with extinction

greater number of prior exposures to extinction=quicker B will extinguish during subsequent exposures, ie. a child learns to stop whining in the store after a short period of time

distinctive signal for extinction

extinction is greatly facilitated when there is a distinctive S that signals onset of extinction (SD)

spontaneous recovery

in o.c., is the reapperrance of an extinguished R following a rest period after extinction, the B will likely be weaker than it was at the start of extinction the day before, ie. a child re-enters store after learning not to whine

to fully extinguish a behavior

when applying an extinction procedure, you have to be persistent

differential reinforcement of other behavior (DRO)

the rein. of any B other than the target B that is being extinguished, ie. paying attention to a child only if he is doing something other than fighting with little sister

differential reinforcement of incompatible behavior (DRI)

reinforcing B that is incompatible with target B, ie. paying attention to a child only when he is interacting in a friendly manner with his little sister

functional communication training

the B of clearly/appropriately communicating one’s desires if differently reinforced, ie. “mom I’m bored can you help me find something to do”

stimulus control

the presence of a discriminative S reliably affects probability of B, ie. a tone signals a lever press will lead to food, or at red lights we stop and green lights we proceed

stimulus generalization

the tendency for an operant R to be emitted in the presence of a S that is similar to an SD. the more similar the S the stronger the R, ie. a rat will display a high rate of lever pressing to 1800 or 2200 Hz tone if trained on a 2000 Hz tone

generalization gradient

a graphic description of the strength of responding in the presence of S similar to the SD that vary along a continuum, flat gradient means more generalization and steep gradient indicated less generalization

stimulus discrimination

the tendency for an operant R to be emitted more in the presence of one S than another, steep gradient=weak generalization=strong discrimination

discrimination training

where rein. of responding in the presence of an SD, an SD for extinction is a S that signals an absence of reinforcementn(S delta), ie. whenever 2000Hz tone sounds=lever press food and 1200Hz tone=lever press no food

peak shift effect

an odd effect of discrimination training particularly on one side and not the other, ie. strongest R shifts 2000Hz tone to 2200Hz tone that lies in opposite direction of Sdelta (1800Hz)

peak shift effect hypotheses

1. the subject learns to respond in terms of relative value of S, ie. higher pitch means no food (not solely 2000Hz)

2. the 1200Hz tone results in some inhibitory properties that impacts S more similar to Sdelta, ie. 2200Hz is more dissimilar to 1200Hz so less inhibition

multiple schedules

complex schedules that consist of 2+ independent schedules presented in sequence, each resulting in rein. and each having distinct SD, ie. FI 30sec associated with red key and VI30sec associated with green key

behavioral contrast

when a change in the rate of rein. on one component of a multiple schedule produces an opposite change in the rate of R on another component

negative contrast effect

an increase in the rate of rein. on one component produces a decrease in the rate of R on another component, ie. a pigeon on a multiple VI 60sec VI 60sec schedule and the VI 60sec component on the red key is changed to VI 30 sec (doubled rate of rein.) and pigeon will therefore decrease rate of R on green key

positive contrast effect

a decrease in the rate of rein. on one component produces an increase in the rate of R on another component, ie. a pigeon on a multiple VI 60sec VI 60sec schedule and the VI 60sec component on the red key is changed to VI 120 sec (halved rate of rein.) and pigeon will therefore increase rate of R on green key

contrast effect and punishment

as the one alternative suddenly becomes punishing, the alternative will become more attractive, ie. when a guy stays in the friend zone

anticipatory contrast

when the rate of R varies inversely with an upcoming, anticipated change in rate of rein., ie. things we are about to lose often seem to increase in value

errorless discrimination training

a procedure that minimizes number of errors and reduces adverse effects:

1. the Sdelta is introduced early in training, soon after the animal has learned to respond correctly to SD or

2. the Sdelta is presented in weak form to start and then gradually increases in intensity (fading) but can lead to less flexible B in the future

memory in animals

act of remembering is S control, humans can use verbal communication

delayed matching-to-sample

at one time the animal is shown a certain S and is then required to identify that S at a later time in order to receive a reinforcer

directed forgetting

occurs when you have been told to forget something, can study in animals, ie. professor teaches wrong and tells you to forget will results in poorer memory for that material

applications for S control

training animals for public performance, used to eliminate certain aversive B, S control used to create effective study environments in specific locations, treatment for sleep onset insomnia

targeting

using the process of shaping to train an animal to approach/touch a particular object, ie. training a lion to stand with a certain SD