Psychology of Learning Exam 3

Shaping is

The reinforcement of successive approximations to a new operant behavior

Behavior that terminates an aversive stimulus is called _______ behavior, whereas behavior that prevents an aversive stimulus from occurring is called ______ behavior.

Escape; avoidance

On a___schedule, reinforcement is contingent upon the first response during a varying period of time.

None of the preceding (so NOT fixed interval, variable time, fixed time, or variable interval schedules)

Extinction is the ____ of a previously ____ response, the result of which is a(n) ___ in the strength of that response.

Nonreinforcement; reinforced; decrease

Typically, one first learns to _______ from an aversive stimulus, and then to ______ it.

Escape; avoid

A positive reinforcer is stimulus ,

The presentation of which follows a response and increases the strength of that response

Jana used the (procedure/process) _____ of extinction when she stopped answering Karla's late-evening calls, while the ____ of extinction is the eventual cessation of such calls.

Procedure; process

On a___schedule (abbreviated____) reinforcement is contingent upon a fixed, predictable number of responses. This produces a___rate of response often accompanied by a____.

Fixed ratio; FR; high; postreinforcement pause

Elicited behaviors are controlled by the events that [x] their occurance while operant behaviors are controlled by the events that [y] their occurence

precede ; follow

On a___schedule, a minimum amount of time must pass between each response before the reinforcer will be delivered. On a___ schedule reinforcement is contingent upon emitting at least a certain number of responses in a certain period of time. On a___schedule reinforcement is contingent on emitting a series of responses at a specific rate.

DRL; DRH; DRP

In carrying out an extinction procedure, an important first step is to ensure that the consequence being withdrawn is in fact the _____ _____.

Effective reinforcer

Julio initially takes vitamin C whenever he has a cold, in the hope that it will shorten the duration of his symptoms. Feeling that this is effective, he begins taking it daily in the hope that it will keep him from getting a cold. Julio initially took the vit C to (avoid/escape) _____ the symptoms of a cold; he later took it to _____ the symptoms of a cold.

Escape; avoid

An easy way to remember the three-term contingency is that you [x] something , [y] something and [z] something.

notice ; do ; get

If Jason is extremely persistent in asking Neem out for a date, she will occasionally accept his invitation. Of the four basic schedules, Jason's behavior of asking Neem for a date is most likely on a ___ ___ schedule of reinforcement

Variable ratio

Krissy's father says no to usual toy. The first thing that might happen is that Krissy will (increase/decrease) _____ the frequency with which she asks for a toy and will ask for a toy with a (outer/softer) ____ voice. This process is known as an ______ ______.

Increase; louder; Extinction burst

In the shuttle avoidance procedure, the rat first learns to _____ from the shock, with the _____ acting as the S^D for the behavior. The rat later learns to _____ the shock, with the _____ acting as the S^D for the behavior.

Escape; shock; avoid; light

It is relatively easy to understand the process underlying (escape/avoidance) ______ conditioning because the organism moves from an _____ situation to a non____ situation. By contrast, it is more difficult to understand _____ conditioning because the organism moves from a(n) _____ situation to another ______ situation.

Escape; aversive; aversive; avoidance; nonaversive; nonaversive

Russ is so impressed with how quickly his betta learned to swim in a circle that he keeps doubling the number of circles it has to perform in order to receive a reinforcer. This is an example of an___schedule of reinforcement (one that is particularly likely to suffer from___ ____)

Adjusting; ration strain

Behaviors are performed for their own sake are said to be [x] motivated; behaviors that are performed to achieve some additional incentive are said to be [y] motivated.

intrinsically ; extrinsically

Krissy is also likely to ask for the toy in many different ways because extinction often results inane increase in the ____ of a behavior.

Variability

Reinforcers and punishers are defined entirely by their [x] on behavior.

effect

On a___schedule, a response must not occur until 20 seconds have elapsed since the last reinforcer.

None of the preceding (So NOT a VI-sec, VT 20-sec, FT 20-sec, or FI 20-sec)

Krissy might also begin showing a lot of ______ behavior, including ______.

Emotional; aggression

According to Mowrer, avoidance is the result of two distinct processes: (1) ______ conditioning of a ______ response, and (2) _____ conditioning in which an avoidance response is ______ _____ by a reduction in ______.

Classical; fear; operant; negatively reinforcement; fear

An event is a punisher if it [x] a behavior and the future probability of that behavior [y].

follows ; decreases

Postreinforcement pauses are most likely to occur on which two types of simple intermittent schedules?

Fixed interval and fixed ratio

When her father still refuses to buy her a toy, Krissy suddenly asks her dad to pick her up and carry her, something she has not asked for since she was much smaller. This could be an example of ___ or what psychoanalysts call ______.

Resurgence; regression

One apparent problem with two-process theory is that, even after hundreds of trials, the avoidance response does not seem to _____.

Extinguish

Money and praise are common examples of [x] reinforcers.

generalized (or generalized secondary)

On____schedules, reinforcement is contingent upon the rate of response.

Response rate (DRL, DRH, DRP)

On the trip home, Krissy who never did get a toy, sat silently and stared out the window. This is not surprising, because extinction is sometimes followed by a temporary period of _____.

Depression

However, according to the ____ ____ hypothesis, avoidance responses usually occur too (quickly/slowly) _____ that exposures to the (CS/US) _____ are too (long/brief) _____ for _____ to take place.

Anxiety conservation; quickly; CS; brief; extinction

A second problem with Mowrer's theory is that after sufficient experience with avoiding the aversive CS, the animals no longer show any _____, yet continue to make the avoidance response. Levis, however, contends that such animals are nevertheless still (slightly/strongly) _____ fearful, otherwise the avoidance response would extinguish.

fear; slightly

If the rat does not press the lever , then it does not receive a shock. As a result , the rat no longer presses the lever. This is best considered as an example of [x]

positive punishment

______ to _____ is the extent to which responding persists after an extinction procedure is implemented.

Resistance; extinction

Shawna often goes for a walk through the woods, but she rarely does yardwork. According to the___, walking through the woods could be used as a___for yardwork

Premack principle; reinforcer

At the zoo one day, you notice a zookeeper leading a rhinoceros into a pen by repeatedly whistling at it. It is probably the case that the whistle has been paired with [x] and is now functioning as a [y]

food ; secondary reinforcer

On a___schedule (abbreviated___) reinforcement is contingent upon the first response AFTER a fixed period of time. This produces a___pattern of responding

Fixed interval; FI; scalloped

According to the ____ ____ effect, responses that have been maintained on an intermittent schedule will show (more/less) _____ resistance to extinction than responses that have been reinforced on a continuous schedule.

Partial reinforcement; more

According to the one-process theory of avoidance, the avoidance response is negatively reinforced by a reduction in overall rate of _____ _____, as apposed to a reduction in _____.

aversive stimulation; fear

Compared to most elicited behaviors, operant behaviors seem [x] automatic and reflexive

less

A___schedule generally produces a high rate of response with a short pause following the attainment of each reinforcer. In general, the higher the requirement, the___the pause

Fixed ratio; longer

Among the four basic intermittent schedules, the _______ schedule is particularly likely to produce strong resistance to extinction.

VR

According to species-specific defense reaction theory, avoidance responses are often (learned/innate) _____ reactions to aversive stimulation that are automatically (emitted/elicited) _____ in dangerous situations.

innate; elicited

In general, a behavior that has been reinforced many times is likely to be (much easier/more difficult) ____ to extinguish.

More difficult

According to Mineka, one limitation in applying experimental models of avoidance to human phobias is that the animals are usually avoiding the aversive (CS/US) ____ whereas human phobics are avoiding the aversive ____.

US; CS

On a(n)___schedule, a response cannot be reinforced until 20 seconds have elapsed since the last reinforcer.

FI 20-sec

The three-term contingency can be thought of as an ABC sequence in which A stands for [x] , B stands for [y] , and C stands for [z].

antecedent ; behavior consequence

The gradual development of new operant behavior through of successive [x] of that behavior is called [y].

approximation ; shaping

Ahmed's daily routine consists of swimming without rest for 30 mins, following which he takes a break. This is most closely resembles a(n) schedule of reinforcement

FD

Resistance to extinction is generally greater when the behavior that is being extinguished has been reinforced with a (high/low) ____-magnitude reinforcer, though the opposite effect has also been found.

High

According to Mineka, a second limitation of applying experimental models of avoidance to phobias is that avoidance behavior in an experiment conditions (more/less) ____readily than does avoidance behavior in a phobia.

less

Operant behaviors are sometimes simply called [x]. These can be constrasted with elicited behaviors, which skinner called [y] behaviors or simply [z].

operants ; respondent ; respondents

If a dog receives a treat each time it begs for one, is begging is being maintained on a(n)____schedule of reinforcement. If it only sometimes receives a treat when it begs for one, its begging is being maintained on a(n)___schedule of reinforcement

Continuous (or FR1 or CRF); intermittent

In general, there is a(n) (direct/inverse) ____ relationship between resistance to extinction and the organism's level of deprivation for the reinforcer.

Direct

Experimental avoidance usually requires (one/a few) ______ conditioning trial(s), while phobic conditioning usually requires _____ conditioning trial(s). Also, (experimental/phobic) ______ conditioning is less than 100% certain.

a few; one; experimental

Each time a student studies at home, she is praised by her parents. As a result, she no longer studies at home. This is an example of [x] [y]

positive ; punishment

Dersu often carried a lucky charm with him when he went out hunting. This is because the appearance of game was often on a____schedule of reinforcement

VT

Previous experience with extinction, as well as a distinctive signal for extinction, tends to produce a(n) (increase/decrease) _____ in resistance to extinction.

decrease

A critical aspect of Stampfl's experimental analogue of phobic conditioning is that the avoidance response can occur (early/late) _____ in the sequence of events leading up to the feared CS, thereby (maximizing/minimizing) _____ the amount of effort involved in making the response.

Early; minimizing

This (early avoidance) results in (little/considerable) _____ exposure to the feared CS, thereby greatly (increasing/reducing) _____ the likelihood that the fear response will _______.

Little; reducing; extinguished

______ _______ is the reappearance of an extinguished response at a later point in time.

Spontaneous recovery

Gina often goes for a walk through the woods, and even more often she does yardwork. According to the___, walking through the woods could still be used as a reinforcer for yardwork given that one restricts the frequency of walking to___its___level

Response deprivation hypothesis; below; baseline

When combined with the words reinforcers or punishment, the word negative indicates that the consequence consists of something being [x] , and the word positive indicates that the consequence consists of something being [y].

removed ; presented

The terms reinforcer or punisher refer to the specific [x] that follows a behavior, whereas the terms reinforcement or punishment refer to the [y] or [z] whereby the probability of a behavior is altered by its consequences

consequence (or event or stimulus) ; process ; procedure

Janice continually worries that her alarm clock might not be set, and that she will wake up late for class. She therefore checks the alarm clock about 20 times each night before finally falling asleep. The persistent thoughts about the alarm clock not being set are classified as a(n) (compulsion/obsession) ______ while the frequent checking of the clock is classified as a(n) _____.

Obsession; Compulsion

On a fixed interval schedule, reinforcement is contingent upon the first response____a fixed period of time

After

In general, each time this occurs, the behavior is (weaker/stronger) ____ than before and extinguishes (more/less) ___ readily.

weaker; more

Hapreet very much enjoys hard work and often volunteers for projects that are quite demanding. It is likely the case that for him the act of expending a lot of effort has often been [x] and now functions as a [y] reinforcer.

positively reinforced ; secondary (or conditioned)

Neem accepts Jason's invitation for a date only when she has "nothing better to do." Of the four basic intermittent schedules, Jason's behavior of asking Neem for a date is best described as being on a___schedule of reinforcement

Variable interval

Skinner believed that this phenomenon is a function of ___ that are uniquely associated with the start of the session.

Discriminative stimuli

In general, (compulsions/obsessions) _____ are associated with an increase in anxiety, whereas ______ are associated with a decrease in anxiety.

Obsessions; compulsions

According to Thorndike's [x] , behaviors that lead to a(n) [y] state of affairs are strengthened , whereas behaviors that [z] state of affairs are weakened.

law of effect ; satisfying ; unsatisfying (or annoying)

When Deanna screams continuously, her mother occasionally pays attention to her. This is most likely an example of a(n)____schedule of reinforcement

VD

The procedure of reinforcing all behaviors except the particular target behavior that you wish to extinguish is known as ______ _____ of _____ behavior (abb ____).

Differential reinforcement; other; DRO

From the perspective of two-process theory, this decrease in anxiety likely functions as a ____ _____ for the compulsive behavior.

Negative reinforcer

Exposure and response prevention (ERP) therapy for OCD involves prolonged exposure to anxiety-arousing events while (engaging/not engaging) _____ in the (obsessive/compulsive) ____ behavior that serves to reduce the anxiety

not engaging; compulsive

Giving a dog a treat whenever it does something other than jump up on visitors as they enter the house is an example of ____ procedure.

DRO

Drinking a soda to quench your thirst is an example of___reduction; drinking a soda because you love its tangy sweetness is an example of____motivation

Drive; incentive

A generalization secondary reinforcer is one that has become a reinforcer because it has been associated with :

several reinforcers (either primary or secondary)

When Beth tried to pull the tail of her dog, he bared his teeth and growled threateningly. Beth quickly pulled her hand back. The dog growled even more threateningly the next time Beth reached for his tail, and she again pulled her hand away. Eventually Beth gave up, and no longer tries to pull the dog's tail. The dog's behavior of baring his teeth and growling served to[x] [y] Beth's behavior of trying to pull his tail. And Beth's behavior of pulling her hand away served to [z] the dog's behavior of growling

positively ; punish ; negatively ; reinforce

On a(n) schedule (abbreviated___), reinforcement is contingent upon a varying, unpredictable number of responses. This generally produces a___rate of response____a postreinforcement pause

Variable ratio; VR; high; without

A DRO procedure is useful in that it tends to reduce many of the side effects of extinction, such as ____ ____ and ___.

Extinction burst; frustration

ERP is similar to systematic desensitization in that exposure to the anxiety-provoking event is usually (gradual/sudden) ______. It is similar to flooding therapy in that exposure to the anxiety-provoking event is (brief/prolonged).

Gradual; prolonged

Achieving a record number of strikeouts in a game would be a [x] reinforcer for pitching well; receiving a bonus for throwing that many strikeouts would be a(n) [y] reinforcer

natural ; contrived

A pigeon pecks a green key on a VI 60-sec schedule, which results in the insertion of a foot-treadle into the chamber. The pigeon then presses the treadle 10 times, following which it receives food. To train this chain of behaviors, one should start with____

Treadle pressing

A behavior is said to be under ____ ____ when it is highly likely to occur in the presence of a certain stimulus.

Stimulus control

People with OCD are usually (able/unable) _____ to recall a particular conditioning event that was the cause of the obsessional anxiety response. The disorder often arises, however, during times of _____. This suggests that a process of ____ ____ may exacerbate normal concerns about cleanliness and safety.

Unable; stress; selective sensitization

In operant conditioning, the term ___ ____ refers to the tendency for a response to be emitted in the presence of stimuli that are similar to the original ______. The opposite process, called ____ ______ refers to the tendency for the response to be emitted more in the presence of one stimulus than another.

Stimulus generalization; S^D; stimulus discrimination

People with OCD fail to realize that intrusive thoughts are (common/uncommon) ____ and that such thoughts are often (controllable/uncontrollable) _____. They also (take/fail to take) _____ responsibility for highly (probably/improbable) _____ events.

Common; uncontrollable; take; improbable

Neem accepts Jason's invitations for a date only when he has just been paid his monthly salary. Of the four simple schedules, the contingency governing Jason's behavior of asking Neem for a date seems most similar to a____schedule of reinforcement

Fixed interval

Operant behaviors are usually defined as [x] of responses, all of which are capable of producing certain [y].

class ; consequence

Some evidence suggests that cognitive interventions for OCD, when combined with ERP, provide (much/little) _____ additional benefit.

Little

A stimulus that signals that a response will be punished is called a [x] for punishment. It is sometimes given the symbol [y].

discriminative stimulus ; SDP

In general, stimuli that are (more/less) __ similar produce stronger generalization.

More

"If I'm not a success in every aspect of my life, my family will reject me." This is a severe example of a____schedule of reinforcement

Conjunctive

Events that are innately reinforcing are called [x] reinforcers; events that become reinforcers through experience are called [y] reinforcers.

primary ( or unconditioned ) ; secondary (or conditioned )

Dagoni works for longer and longer periods of time and takes fewer and fewer breaks as his project near completion. This is an example of the___effect

Goal gradient

A ___ ____ intimates the strength of responding to stimuli that vary along a continuum.

Generalization gradient

When the cat sat at your feet and meowed annoyingly during breakfast one morning, you sprayed it with water. As a result, the cat did not come near the table or meow the next time you sat down for a meal. The consequence for the cat's meowing consisted of the (presentation/removal) _____ of a stimulus, and the cat's behavior subsequently (decreased/increased) _____ in frequency. Therefore, this is an example of _______.

Presentation; decreased; positive punishment