Module 21: Operant Conditioning
Principles of Operant Conditioning
Definition of Operant Conditioning: This is a specific type of learning where behavior is either strengthened when followed by a reinforcer or diminished when followed by a punisher.
The Law of Effect: A fundamental principle stating that behaviors followed by favorable consequences become more likely to occur, while behaviors followed by unfavorable consequences become less likely to occur.
Skinner’s Experiments and the Skinner Box
B.F Skinner's Methodology: Skinner expanded on the law of effect through experimental research.
Operant Chamber (Skinner Box): * An experimental chamber designed for animals to manipulate a bar or a key to obtain a reinforcer (typically food or water). * The chamber is attached to specialized devices that record the rate of bar pressing or key pecking to quantify behavioral changes.
Reinforcement Definition: Within the context of operant conditioning, reinforcement refers to any event or stimulus that strengthens the behavior it follows.
Shaping Behavior through Successive Approximations
Shaping: An operant conditioning procedure where reinforcers are used to guide behavior toward closer and closer approximations of a desired, complex behavior. The process involves identifying a target outcome and incrementally reinforcing actions that mirror it.
Successive Approximations: This involves the practice of rewarding responses that are increasingly similar to the final desired behavior.
Discriminative Stimulus: This is a specific stimulus that elicits a response only after it has been associated with reinforcement. It acts as a signal that a particular response will be reinforced.
Taxonomic Classification of Reinforcers
Positive Reinforcement: * Strengthens a response by presenting positive reinforcers. * A positive reinforcer is defined as any stimulus that, when presented after a response, increases the frequency of that behavior.
Negative Reinforcement: * Strengthens a response by reducing or removing a negative (aversive) stimulus. * A negative reinforcer is any stimulus that, when removed after a response, increases the behavior's future frequency.
Primary Reinforcers: These are innately reinforcing stimuli that satisfy basic biological needs. * Example: A "Hershey Kiss" (food) is an innate, unconditioned primary reinforcer.
Conditioned (Secondary) Reinforcers: These are stimuli that gain reinforcing power through their association with a primary reinforcer. * Example: Money is a secondary reinforcer because it is learned and not intrinsically innate.
Mechanics of Punishment
Core Function: Unlike reinforcement, which strengthens behavior, punishment is intended to weaken behavior by decreasing the probability of its recurrence.
Positive Punishment: Occurs when an aversive stimulus is added following a behavior to decrease the chance of that behavior reoccurring.
Negative Punishment: Occurs when a desirable stimulus is removed following a behavior to decrease the chance of that behavior reoccurring.
Variability: The effectiveness and perception of stimuli as desirable or undesirable can vary significantly from person to person.
Reinforcement Schedules
Definition: A pattern that defines how often a desired response will be reinforced.
Continuous Reinforcement: Reinforcing the desired response every single time it occurs.
Partial (Intermittent) Reinforcement: * Reinforcing a response only part of the time. * This results in a slower acquisition phase but provides much greater resistance to extinction compared to continuous reinforcement.
Fixed-Ratio Schedules: A schedule that reinforces a response only after a specified, set number of responses has occurred.
Variable-Ratio Schedules: A schedule that reinforces a response after an unpredictable number of responses.
Fixed-Interval Schedules: A schedule that reinforces a response only after a specific, predetermined amount of time has elapsed.
Variable-Interval Schedules: A schedule that reinforces a response at unpredictable time intervals.
Determinants of Effective Punishment and Skinner’s Warnings
Four Major Drawbacks of Punishment according to Skinner: 1. Suppression: Punished behavior is merely suppressed, not forgotten; the behavior may reappear when the threat of punishment is absent. 2. Discrimination: Punishment teaches the organism to discriminate among situations (e.g., the behavior is avoided only when the punisher is present). 3. Fear: Punishment can teach fear, which may generalize to the person administering the punishment or the environment where it occurs. 4. Modeling Aggression: Physical punishment may increase aggression by modeling it as a viable way to cope with problems.
Rule of Thumb: Punishment tells the subject what not to do, whereas reinforcement tells the subject what to do.
Criteria for Effective Punishment: * Punishment should happen rarely. * Immediacy: It must be administered immediately. If time passes between the behavior and the punishment, environmental factors will interfere, rendering the punishment ineffective. * Severity Issues: Incredibly harsh punishment is often not an effective deterrent. * Example: Jail is cited as an example of a punishment that is often not effective.
Specialized Behavioral Concepts
Superstitious Behavior: This occurs when a behavior is accidentally reinforced. * Example: A bird might be fluttering its wings when a pedal is pressed; if food is delivered, the bird may associate the fluttering with the food, even if the fluttering did not cause the delivery. * Example: "Lucky Socks" are a human version of superstitious behavior where a specific item is associated with a winning outcome despite no causal link.
Association and Timing: The link between behavior and outcome is driven by the association with the stimulus. In shaping, the stimulus is used incrementally to achieve the desired behavioral outcome.