Operant Conditioning, Cognitive Learning, and Observational Modeling
Schedules of Reinforcement
- Operant conditioning schedules dictate whether reinforcement is based on the number of behavioral responses (ratio) or elapsed time (interval), delivered either predictably (fixed) or unpredictably (variable).
- Variable schedules yield stronger, more persistent learning than fixed schedules because unpredictable patterns prevent subjects from anticipating rewards.
- Fixed Ratio (FR): Reinforcement is provided after a set number of target behaviors (e.g., earning 5 for every 3 parts completed on an assembly line).
- Variable Ratio (VR): Reinforcement occurs after an unpredictable, varying number of responses (e.g., slot machines at casinos); creates high persistence and resistance to extinction.
- Fixed Interval (FI): Reinforcement is delivered for the first response after an invariant period of time has elapsed (e.g., hospital pain pumps dispensing medication only once every 6 hours, regardless of button presses).
- Variable Interval (VI): Reinforcement is delivered after varying, unpredictable time intervals (e.g., receiving text messages across random intervals of time).
Operant Conditioning: Reinforcement and Punishment
- Operant conditioning forms associations between behaviors and their consequences to alter behavioral frequency.
- Reinforcement increases the probability of a target behavior and is substantially more effective for learning than punishment.
- Positive Reinforcement: Adding a desirable stimulus to increase a behavior (e.g., providing a Fruit Loop to a rat for a lever press).
- Negative Reinforcement: Removing an aversive stimulus to increase a behavior (e.g., vehicle seatbelt chimes that cease only when the seatbelt is fastened).
- Punishment decreases the probability of a target behavior:
- Positive Punishment: Adding an aversive stimulus to decrease an unwanted behavior (e.g., washing a child's mouth with soap for offensive language).
- Negative Punishment: Removing a pleasant stimulus or privilege to decrease an unwanted behavior (e.g., grounding, revoking driving privileges, sitting in a corner, or sitting on the naughty step).
Shaping and Behavior Acquisition
- Shaping: The operant conditioning technique of reinforcing successive approximations of a desired behavior until the full, non-hardwired behavior is acquired.
- In a Skinner box, training a rat to press a lever proceeds sequentially: reinforcing movement toward the front, sniffing the lever, rearing up on hind legs, touching the lever, and finally depressing the lever.
- Commercial application: Procter and Gamble's Pampers utilized shaping via a "potty chart" to reward successive stages of child potty training.
Extinction and Motivation
- Extinction represents the active inhibition of learned responses rather than an absolute reversal or unlearning.
- Spontaneous Recovery: The sudden reappearance of an extinguished response following a rest interval, which re-extinguishes quickly if reinforcement is withheld.
- Reinforcer Types:
- External Reinforcers: Tangible rewards (e.g., paying 100 for an A grade); highly vulnerable to rapid extinction once rewards stop.
- Internal Reinforcers: Intrinsic motivation and positive self-evaluation; highly resistant to extinction over long durations.
Cognitive Perspectives: Latent and Insight Learning
- Early behaviorists treated internal mental states as an unobservable "black box," rejecting Wundt's introspection methods due to poor validity.
- Latent Learning (Tolman): Learning that takes place in the absence of reinforcement or observable behavioral change.
- T-Maze Experiment: Rats freely explored a T maze without food rewards. When subsequently trained to find food at arm B from start arm A (requiring a right turn), rats placed at arm D traveled straight to arm B rather than turning right.
- Demonstrated that animals form an internal cognitive map representing the spatial layout of an environment.
- Insight Learning: The sudden realization or arrival of a solution ("aha moment") occurring beneath conscious awareness without prior conditioning.
- Demonstrated by Joseph Cole at the Max Planck Institute for Evolutionary Anthropology in Leipzig, Germany, where an untrained chimpanzee independently figured out how to spit water into a clear tube to retrieve a floating peanut.
Observational and Vicarious Learning
- Vicarious Learning: Acquiring behaviors by observing the reinforcement or punishment delivered to others.
- Observational Learning (Bandurian): Challenged J. B. Watson's strict conditioning paradigm by showing that behavior can be acquired strictly by observing a model.
- Bobo Doll Experiment:
- Children observed an adult model pummeling an inflatable Bobo doll.
- Children exposed to the aggressive model reproduced the aggressive acts and innovated new aggressive behaviors (such as using novel hostile language and utilizing toy guns, despite guns never appearing in the modeled demonstrations).
- Refuted Sigmund Freud's theory of catharsis, demonstrating that viewing aggression does not deplete aggressive drive but actively fosters aggressive behavior.
Questions & Discussion
- Discussion on Punishment: In response to a query from the audience requesting clarification on punishment, the presenter deferred briefly to conclude the segment on negative reinforcement before addressing punishment mechanisms.
- Audience Polling on Disciplinary History: Audience members were polled by a show of hands regarding whether they had experienced negative punishment (such as being grounded, sitting in a corner, or sitting on the naughty step); the response confirmed universal exposure, which was contrasted against empirical findings on the relative inefficacy of punishment compared to reinforcement.