Module 27 - Operant Learning

operant conditioning

a type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher

law of effect

Thorndike's principle that behaviors followed by favorable consequences become more likely, and that behaviors followed by unfavorable consequences become less likely

operant chamber

A chamber also known as a Skinner box, containing a bar or key that an animal can manipulate to obtain a food or water reinforcer, with attached devices to record the animal's rate of bar pressing or key pecking.

reinforcement

any event that strengthens the behavior it follows

shaping

an operant conditioning procedure in which reinforcers guide behavior toward closer and closer approximations of the desired behavior

discriminative stimulus

in operant conditioning, a stimulus that elicits a response after association with reinforcement (in contrast to related stimuli not associated with reinforcement)

positive reinforcement

strengthens a response by presenting a typically pleasurable stimulus after a response

negative reinforcement

strengthens a response by reducing or removing something negative (not a punishment)

primary reinforcer

an innately reinforcing stimulus, such as one that satisfies a biological need

conditioned reinforcer

a stimulus that gains its reinforcing power through its association with a primary reinforcer

reinforcement schedule

a pattern that defines how often a desired response will be reinforced

continuous reinforcement schedule

reinforcing the desired response every time it occurs, where learning and extinction take place rapidly

partial (intermittent) reinforcement schedule

reinforcing a response only part of the time; results in slower learning of a response but much greater resistance to extinction

fixed-ratio schedule

in operant conditioning, a reinforcement schedule that reinforces a response only after a specified number of responses

variable-ratio schedule

in operant conditioning, a reinforcement schedule that reinforces a response after an unpredictable number of responses

fixed-interval schedule

in operant conditioning, a reinforcement schedule that reinforces a response only after a specified time has elapsed

variable-interval schedule

in operant conditioning, a reinforcement schedule that reinforces a response at unpredictable time intervals

punishment

an event that decreases the behavior that it follows

positive punishment

adding an undesirable stimulus to stop or decrease a behavior

negative punishment

taking away a pleasant stimulus to decrease or stop a behavior

BF Skinner

Behaviorist that developed the theory of operant conditioning by training pigeons and rats

Edward Thorndike

behaviorism; Law of Effect-relationship between behavior and consequence