Module 27

operant conditioning

a method of learning that uses rewards and punishment to modify behavior

the law of effect

responses that produce a satisfying effect after a particular stimulus are likely to occur again, and responses that produce a discomforting effect after a particular stimulus are less likely to occur again

Edward Thorndike

the first to apply psychological principles to the area of learning. His theory of learning, especially the law of effect, is most often considered to be his greatest achievement

BF Skinner

best known for developing the theory of Operant Conditioning, which uses reinforcers or consequences to change behavior

operant chamber

a chamber used by BF Skinner containing a bar or key that an animal can manipulate to obtain a food or water reinforcer; attached devices record the animal’s rate of the bar pressing or key pecking

reinforcement

any event that strengthens the behavior it follows

punishment

any event that weakens the behavior it follows

positive reinforcement

a behavior is followed by a reward

negative reinforcement

a behavior ends something undesirable

positive punishment

a behavior followed by an undesirable event

negative punishment

a behavior ends something desirable

immediate reinforcement

a reinforcer that occurs instantly after a behavior (more effective than delayed)

delayed reinforcement

a reinforcer that is delayed in time for a certain behavior (achieves desired behavior rather than getting an instantaneous result)

primary reinforcement

something naturally rewarding (warmth, food, water)

secondary reinforcement

something you have learned is rewarding because it is paired with primary reinforcement (money, grades)

shaping

a way to establish a behavior by reinforcing behaviors that are increasingly similar to the one you want to occur

discriminative stimulus

a stimulus that elicits a response after association with reinforcement (pigeon pecks image of human face but not other images)

extinction

loss of learned response when reinforcement no longer follows it (helpful in changing ineffective behaviors)

problems with punishment

doesn’t end desire to do behavior, can cause anxiety/avoidance, and can result in aggression being modeled

continuous reinforcement

a reward after every correct response/behavior

partial reinforcement

reward after some correct responses/behaviors

fixed ratio

reward after a specific amount of correct responses

variable ratio

rewards an unpredictable number of correct responses (HIGHEST RESISTANCE TO EXTINCTION)

fixed interval

reward only after a correct response in a defined time period

variable interval

rewards the first correct response after an unpredictable time period