Psych of learning test 1 pt. 2

Edwin Thorndike

first studied operant condition in the 1890s

law of effect

the consequences of a behavior determine whether that behavior will be repeated

operant conditioning

a type of learning in which the future probability of a behavior is affected by its consequences

operant behaviors

behaviors that are influenced by their consequences; a class of emitted responses that result in certain consequences

illusion of voluntariness

operant behavior not necessarily voluntary; behavior comes to be controlled by contingencies of reinforcement and punishment

reinforcers

consequences of behavior that follow a behavior, behavior increases

punishers

consequences of behavior taht follow a behavior, behavior decreases

operant conditioning perspective

behavior, not person/animal has been reinforced or punished

reinforcement and punishment

the process or procedure by which a certain consequence changes strength of a behavior

punishment and withdrawal of reinforcement

means of weakening behaviors

discriminative stimuli

a stimulus in the presence of which responses are either reinforced or punished (speeding ticket)

discriminative stimulus for extinction

the stimulus signals the nonavailability of a previously available reinforcer

negative

behavior has resulted in something being removed or subtracted

positive

behavior has resulted in something being presented or added

reinforcer

behavior has strengthened as a result of the consequences

punisher

behavior has weakened as a result of the consequence

escape behavior

results in termination of an aversive stimulus (opening an umbrella when it rains)

avoidance behavior

occurs before the aversive stimulus is presented and therefore prevents its delivery (staying inside to avoid the rain)

punishment in personal relationships

reduction in one person’s behavior as a result of punishment can negatively reinforce the behavior of the person

five to one

ratio of positive to negative interactions for a good relationship

immediate reinforcement

strongest effect on behavior

primary reinforcer

event that is innately reinforcing (food, water, temperature)

secondary reinfocer

event that is reinforcing because it has been associated with some other reinforcer

genie bachini

grants you three wishes

generalized reinforcer

type of secondary reinforcer that has been associated with several other reinforcers (token economy in classroom)

intrinsic reinforcement

reinforcement provided by the mere act of performing the behavior

extrinsic reinforcement

reinforcement provided by some consequence external to behavior

natural reinforcers

reinforcers naturally provided for a certain behavior (money for selling merchandise), more efficient

contrived reinforcers

reinforcers that have been deliberately arranged to modify a behavior

intrinsic reinforcers

always natural reinforcers

extrinsic reinforcers

can be either natural or contrived

shaping

the gradual creation of new operant behavior through reinforcement of successive approximations to that behavior

schedule of reinforcement

indicates what exactly has to be done for the reinfocer to be delivered

continuous reinforcement schedule (CRF)

each specified response is reinforced; very useful when a behavior is first being shaped or strengthened

intermittent reinforcement schedule

only some responses are reinforced, characterizes everyday life

fixed ratio schedules

reinforcement contingent upon a fixed, predictable number of responses (FR 50= 50 responses before reinforcement)

responses to FR schedules

high rate of response with a short postreinforcement pause

postreinforcement pause

short pause following attainment of each reinforcer; higher ratio requirements=loger pauses

stretching the ratio

moving from a low ratui requirement to a high ratio requirement, done gradually to avoid ratio strain

variable ratio schedules

reinforcement is contingent upon a varying, unpredictable number of responses (VR 5= average of 5)

Fixed Interval Schedules

reinforcement contingent upon first response after a fixed, predicatble period of time

responses to FI schedules

consist of a postreinforcement pause followed by a gradually increasing rate of response as the interval draws to a close (study habits get better towards the end of semester)

Variable Interval Schedules

reinforcement contingent upon first response after a varying, unpredictable period of time (Looking down the street for the bus will be reinforced after a varying, unpredictable period of time)

responses to VI schedules

produce a moderate, steady rate of response with little or no postreinforcement pauses

rate schedules

response contingent; result in high rates of response

fixed schedules

produce postreinforcement pauses, attaining one reinforcer means next reinforcer is some distance away

duration schedules

reinforcement contingent on performing behavior continuously throughout a period of time

Fixed Duration schedule

behavior must be performed continuously for a fixed continuously for a fixed, predictable period of time

variable duration schedule

behavior must be performed continuously for a varying, unpredicatable period of time

response-rate schedules

reinforcement is directly contingent upon the organism’s rateof response, differential reinforcement schedules

differential reinforcement

one type of response reinforced while another is not

differential reinforcement of high rates

reinforcement provided for high rate of response

differential reinforcement of low rates

reinforcement provided for responding at a slow rate (spending time on homework)

Differential reinforcement of paced responding

reinforcement provided for responding neither too fast nor too slow (long distance runners)

noncontingent schedules

reinforcer delivered independently of any response, response not required for reinforcer to be obtained

fixed time schedule

reinforcer delivered following a fixed, predictable period of time, regardless of behavior (Xmas presents)

Variable time schedule

reinforcer delivered following varying, unpredicatble period of time, regardless of organism’s behavior

superstitious behavior

Noncontingent reinforcement may account for some forms of superstitious behavior

conjunctive schedule

type of complex schedule in which requirements of two or more simple schedules must be met before reinforcer delivered

adjusting schedule

response requirement changes as a function of organism’s performance while responding for previous reinforcer (shaping)

chained schedule

sequence of two or more simple schedules (reading textbook, completing course)

goal gradient effect

increase in strength/efficiency of responding as one draws near to the goal

backward chaining

training final link first and initial link last, very long chains of behavior can be established

drive reduction theory

event is reinforcing to the extent that it is associated with a reduction in a physiological drive (LARGELY ABANDONED)

Hull’s view

all reinforcers are directly or indirectly associated with drive reduction

incentive motivation

motivation derived from some property of a reinforcer, as opposed to an internal drive state

Premack Principle

states that high-probability behavior can be used to reinforce a low-probability behavior

response deprivation hypothesis

states that a behavior can serve as a reinforcer when access to behavior is restricted and frequency falls below preferred level of occurrence

contingencies of reinforcement

effective to the extent that they create condition in which organism confronted with the possibility of response falling below baseline

behavior bliss point approach

an organism with free access to alternative activities will distribute its behavior in such a way as to maximize overall reinforcement