3.8: Operant Conditioning

Operant Conditioning

a type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher

law of effect

Thorndike's principle that behaviors followed by favorable consequences become more likely, and that behaviors followed by unfavorable consequences become less likely

Operant Chamber

in operant conditioning research, a chamber (also known as a Skinner box) containing a bar or key that an animal can manipulate to obtain a food or water reinforcer; attached devices record the animal's rate of bar pressing or key pecking.

Reinforcement

any event that strengthens the behavior it follows

Shaping

an operant conditioning procedure in which reinforcers guide behavior toward closer and closer approximations of the desired behavior

Discriminative Stimulus

in operant conditioning, a stimulus that elicits a response after association with reinforcement (in contrast to related stimuli not associated with reinforcement)

positive reinforcement

the reinforcement of a response by the addition or experiencing of a pleasurable stimulus

negative reinforcement

Increasing behaviors by stopping or reducing negative stimuli, such as shock.

primary reinforcer

an innately reinforcing stimulus, such as one that satisfies a biological need

conditioned reinforcer

a stimulus that gains its reinforcing power through its association with a primary reinforcer; also known as a secondary reinforcer

Reinforcement Schedule

a pattern that defines how often a desired response will be reinforced

continuous reinforcement schedule

reinforcing the desired response every time it occurs

partial (intermittent) reinforcement schedule

reinforcing a response only part of the time; results in slower acquisition of a response but much greater resistance to extinction than does continuous reinforcement

fixed-ratio schedule

in operant conditioning, a reinforcement schedule that reinforces a response only after a specified number of responses

variable-ratio schedule

in operant conditioning, a reinforcement schedule that reinforces a response after an unpredictable number of responses

fixed-interval schedule

in operant conditioning, a reinforcement schedule that reinforces a response only after a specified time has elapsed

variable-interval schedule

in operant conditioning, a reinforcement schedule that reinforces a response at unpredictable time intervals

punishment

an event that decreases the behavior that it follows

Instinctive Drift

the tendency of learned behavior to gradually revert to biologically predisposed patterns