exam 2

Aversion Therapy

• a form of behavior therapy that attempts to reduce the attractiveness of a desired event by associating it with an aversive stimuli.

• ex: snapping a rubber band on your wrist when you have the urge to smoke 

Compensatory- response therapy

• model of conditioning in which a conditioned stimulus that has been repeatedly associated with the primary response ( a- process) to a unconditioned stimulus will eventually come to elicit a compensatory response (b-process) 

• ex: someone with memory problems uses a planner to remember what they need to do. 

counterconditioning

• procedure whereby a conditioned stimulu that elicits one type of response is associated with an event that elicits an incompatible response

• ex: training a dog to associate the sound of a car with treats

Flooding therapy

• behavioral treatment for phobias that involves prolonged exposure to a fear stimulus

• sit with fear stimulus until not scared

• opposite of systematic desensitization

incubation

• the strengthening of a conditioned fear response as a result of brief exposure to the aversive conditioned stimulus

• avoiding fear makes it worse 

overexpectation effect

• decrease in the conditioned response that occurs when 2 separately conditioned conditioned stimuli are combined into a compound stimulus for further pairing with the unconditioned stimulus

preparatory response therapy

• a theory of classical conditioning that proposes that the purpose of the conditioned response is to prepare the organism for the presentation of the unconditioned stimulus

• dog salivating to a tone prepares it for food

preparedness 

an innate tendency for an organism to more easily learn certain types of behaviors or associate certain types of events with each other 

reciprocal inhibition

• process whereby the occurrence of a response is inhibited by the occurrence of an incompatible response 

• can’t be done on humans  

rescarla-wagner theory

• theory of classical conditioning that proposes that a given unconditioned stimulus can support only so much conditioning and that this amount of conditioning must be distributed among the various conditioned stimulus 

• only so much associative value available 

selective sensitization 

• an increase in one’s reactivity to a potentially fearful stimulus following exposure to an unrelated stressful event 

• ex: someone becoming more anxious about driving in traffic because they are going through a stressful divorce. 

stimulus- substitution theory 

• a theory of classical conditioning that proposes that the conditioned stimulus acts as a substitute for the unconditioned stimulus 

• ex: sound of a bell is a substitute for food. 

systematic desensitization

• a behavioral treatment for phobias that involves pairing relaxation with a succession of stimuli that elicit increasing levels of fear

• can be done with real stimuli(vivo) or imaginary stimuli  

temperament

• an individuals level of emotional reactivity that, to a large extent, is genetically determined. 

• effects how easily a conditioned stimulus can be acquired 

avoidance behavior

• behavior that occurs before the aversive stimulus us presented and thereby prevents its delivery 

• ex: open umbrella before going out in the rain=prevents you from getting wet 

contrived reinforcers

• reinforcers that have been deliberately arranged to modify a behavior, they are not a typical consequence of the behavior in that setting

• not expected

• most valuable

• ex: teacher giving a student a sticker for good behavior

Discriminative Stimulus (S^D)

• a stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced, that is, a stimulus that signals the availability of reinforcement

• set the occasion for behavior

• do not elicit behavior like a CS or US

Discriminative stimulus for extinction (S^triangle)

a stimulus that signals the absence of reinforcement 

Discriminativee stimulus for punishment (S^DP) 

a stimulus that signals that a response will be punished 

escape behavior

• a behavior that results in the termination of an aversive stimulus 

• ex: person getting rained on opens umbrella to stop getting wet 

extinction

the weakening of a behavior through the nonreinforcement of a previously reinforced behavior

extrinsic reinforcement

• the reinforcement provided by a consequence that is external to the behavior, that is, an extrinsic reinforcer

• outside

generalized reinforcer

• a type of secondary reinforcer that has been associated with several other reinforcers 

• often used in behavior modification programs 

Intrinsic reinforcement

• reinforcement provided by the mere act of performing the behavior, that is, the behavior itself is reinforcing

• inside(thoughts) 

Law of effect

• thorndike 

• behaviors that lead to a saifying state of affairs are strengthened, while behaviors that lead to an unsatisfying state of affairs are weakened 

natural reinforcers

• reinforcers that are naturally provided for a certain behavior, they are a typical consequence of the behavior within the setting 

• expected consequences  

negative punishment 

taking something way to decrease the likelihood of the behavior 

negative reinforcement

taking something away to increase the l

operant behavior 

a class if emitted responses that result in certain consequences, these consequences affect the future probability of those responses

operant conditioning

• a type of learning in which the future probability of a behavior is affected by its consequences 

• 3 components- 1. response that produces a certain consequences. 2. consequences increase or decrease probability of the response that precedes it. 3. consequences signal 

positive punishment

adding something to decrease the likelihood of a behavior

positive reinforcement

adding something to increase the likelihood of a behavior

primary reinforcer

• an event that us innately reinforcing

• things we are born to like rather than learned to like 

• physiological needs 

three term contingency

• the relationship between a discriminative stimulus, an operant behavior, and a consequence 

• notice something- do something- get something 

secondary reinforcer

• event that is reinforcing because it has been associated with some other reinforcer 

• events we have learned 

shaping

the gradual creation of new behavior through reinforcement of successive approximations to that behavior

adjusting schedule

• a schedule in which the response requirement changes as a function of the organism’s performance while responding to the previous reinforcer

• training a dog to sit= at first you praise very time, then you only praise sometimes

behavioral bliss point approach

• the theory that an organism with free access to alternative activities will distribute its behavior in such away as to maximize overall reinforcement

• reward yourself for studying

chain schedule

• schedule of  sequence of 2 or more simple schedules, each with its own S^D and the last of which result in a terminal reinforcer

• person must work through a series of component schedule to obtain the sought after reinforcer 

• 2 components must be completed in a certain order 

• train final link first 

complex schedule

a schedule consisting of a combination of 2 or more simple schedules 

conjunctive schedule 

• type of complex schedule in which the requirements of 2 or more simple schedules must be met before a reinforcer is delivered 

• ex:wages you earn on a job are contingent upon how many hours you work a week 

continuous reinforcement schedule 

• a schedule in which each specified response is reinforced 

• very useful when a behavior is first being shaped 

differential reinforcement of high rates (DRH)

• a schedule in which reinforcement is contingent upon emitting at least a certain number of responses in a certain period of time

• responding at a fast rate 

• one type of response is reinforced while another is not 

differential reinforcement of low rates (DRL)

• schedule in which a minimum amount of time must poss between each response before the reinforcer will be delivered 

• reinforcement is provided for responding at a slow rate 

differential reinforcement of paced responding (DRP)

• schedule in which reinforcement is contingent upon emitting a series of responses at a set rate 

• reinforcement is provided for responding neither too fast nor too slow 

drive reduction theory

• Clark hull

• an event is reinforcing to the extent that it is associated with reduction in some type of physiological

• ex: eating decreases the hunger drive

fixed duration schedule (FD)

• schedule in which reinforcement is contingent upon continuous performance of a behavior for a fixed, predictable period of time

• imprecise

fixed interval schedule (FI)

• schedule in which reinforcement is contingent upon the first response after a fixe, predictable period of time 

• produce a moderate, steady rate of responses with little or not post reinforcement pause 

fixed ratio schedule (FR) 

• schedule in which reinforcement is contingent upon a fixed, predictable number of responses

• “break and run” pattern, a short break followed by a steady run of responses

• ex: after 5 responses=reinforcement

fixed time schedule (FT)

a schedule in which the reinforcer is delivered following a fixed, predictable period or time, regardless of the organisms behavior 

goal gradient effect

• an increase in the strength and/or efficiency of responding as one draws near to the goal 

• ex: you take less breaks when your almost done with a paper  

incentive motivation 

motivations derived from some property of the reinforcer, as opposed to an internal drive state 

intermittent reinforcement schedule

• a schedule in which only some responses are reinforced 

• 4 types 

noncontingent schedule of reinforcement

• schedule in which the reinforcer is delivered independently of any respinse 

• beneficial 

premack principle

• notion that a high probability behavior can be used to reinforce a low probability behavior 

• 1. the behavior that is being reinforced 

• 2. followed by the behavior that is the reinforcer 

ratio strain

• a disruption in responding due to an overly demanding response requirement

• ex:burnout

response deprivation hypothesis

notion that a behavior can serve as a reinforcer when 1. access to the behavior is restricted and 2. its frequency thereby falls below its preferred level of occurence

response rate schedule

schedule in which reinforcement is directly cintinentupon the organism’s rate of response 

schedule of reinforcement

• the response requirement that must be met to obtain reinforcement 

• what exactly has to be done for the reinforcer to be delivered 

variable duration schedule (VD)

• schedule in which reinforcement is contingent upon continuous performance of a behavior for a varying, unpredictable period of time 

• imprecise 

variable interval schedule (VI) 

schedule in which reinforcement is contingent upon the first response after a varying unpredictable period of time 

variable ratio schedule (VR) 

• schedule in which reinforcement is contingent upon a varying, unpredictable number of response 

• random 

• scoring a goal 

variable time schedule (VT) 

• schedule in which the reinforcer is delivered following a varying, unpredictable period of time, regardless of the organisms behavior

• shown in skinners pigeon study

• superstitious behavior 

anticipatory contrast

the process whereby the rate of response varies inversely with an upcoming (anticipated) change in the rate of reinforcement 

behavior contrast

• a change in the rate of reinforcement on one component of a multiple schedule produces an opposite change in the rate of response on another component 

• 2 types= positive and negative 

• contrast indicates that behavior should not be viewed in isolation 

differential reinforcement of other behavior (DRO)

• reinforcement of any behavior other than a target behavior that is being extinguished 

• more effective than simple extinction 

discrimination training 

as applied to operant conditioning, the differential reinforcement of responding in the presence of the one stimulus and not another

errorless discrimination training

• procedure that minimizes the number of errors and reduces many of the adverse effects associated with discrimination training 

extinction burst

a temporary increase in the frequency and intensity of responding when extinction is first implemented 

fading 

the process of gradually altering the intensity of a stimulus 

generalization gradient 

a measure of the strength of responding in the presence of stimuli that are similar to the S^D and vary along a continuum 

multiple schedule 

complex schedule consisting of 2 or more independent schedules presented in sequence, each resulting in reinforcement and each having a distinctive S^D 

negative contrast effect

an INCREASE in the rate of reinforcement on one component of a multiple schedule produces a DECREASE in the rate of response on another component 

partial reinforcement effect

process whereby behavior that has been maintained on an intermittent schedule of reinforcement extinguishes more slowly than behavior that has been maintained on a continous schedule

peak shift effect

following discrimination training the peak of a generalization gradient will shift from the S^D to a stimulus that is further removed from the S^triangle 

positive contrast effect

a DECREASE in rate of reinforcement on one component of a multiple schedule produces an INCREASE in the rate of response on the other component 

resistance to extinction 

the extent to which responding persists after an extinction procedure has been implemented 

resurgence

the reappearance during extinction of other behaviors that had once been effective in obtaining reinforcement

spontaneous recovery

the reappearance of an operant response following a rest period after extinction has occured 

stimulus control

a situation in which the presence of a discriminative stimulus reliably affects the probability of a behavior 

stimulus discrimination

the tendency for an operant response to be emitted more in the presence of one stimulus than another 

stimulus generalization 

tendency for an operant response to be emitted in the presence of a stimulus that is similar to the S^D