Operant Conditioning Study Notes
Operant Conditioning
Definition and Overview
- Operant Conditioning: A type of learning where behavior is modified by its consequences, specifically by reinforcers and punishers.
- Operant Behavior: Active behaviors that operate on the environment to produce consequences.
- Operant conditioning differs from classical conditioning:
- Classical Conditioning: Involves involuntary, automatic (respondent) behaviors that are associated with stimuli.
Key Concepts
- Law of Effect: Proposed by Edward Thorndike; states that:
- Behaviors followed by favorable outcomes (or reinforcements) are more likely to recur.
- Behaviors followed by unfavorable outcomes (or punishments) are less likely to recur.
Operant Chamber (Skinner Box)
- An experimental setup for studying operant conditioning, equipped with a bar or key that an animal can manipulate to receive food or water as a reinforcer.
- Allows researchers to measure the frequency of behaviors such as bar pressing or key pecking.
Reinforcement
- Reinforcement: Any event that strengthens the behavior it follows. It can be classified as follows:
- Positive Reinforcement: Increases behavior by presenting a pleasurable stimulus following the behavior.
- Example: Giving a child a treat for completing homework.
- Negative Reinforcement: Increases behavior by removing or reducing an aversive stimulus.
- Example: Taking painkillers to relieve headache pain. Note: This is NOT punishment, as it also strengthens the response.
- Primary Reinforcer: An innately reinforcing stimulus that satisfies a biological need (e.g., food, water).
- Conditioned Reinforcer (or Secondary Reinforcer): Gains its reinforcing power through association with a primary reinforcer (e.g., money, praise).
- Both positive and negative reinforcers can increase desired behaviors.
Shaping
- A procedure in operant conditioning involving the reinforcement of successive approximations toward a desired behavior.
- This involves gradually increasing the criteria for reinforcement, helping to guide the learner from simple to more complex responses.
- Ensures the learner remains engaged and progressively builds towards the ultimate goal.
Discriminative Stimulus
- Discriminative Stimulus: A stimulus that signals the availability of reinforcement or punishment.
- Example: Traffic lights—green light signifies "go" (reinforcement), while red indicates "stop" (punishment).
B.F. Skinner
- B.F. Skinner: An influential and controversial figure in behaviorism who built upon Thorndike's work to develop a comprehensive theory of operant conditioning.
- Known for conducting experiments with pigeons and rats using operant chambers.
- Demonstrated how reinforcement could be utilized to shape behavior systematically.
- Involved the use of animals in controlled settings to show the strength of operant behaviors and the mechanics of learning through reinforcement.
Applications of Reinforcement
- Both types of reinforcement (positive and negative) can work together to increase desired behavior.
- Example: Studying for an exam can lead to better grades (positive reinforcement) and reduce anxiety (negative reinforcement).
- Delayed reinforcement: Humans can learn to wait for a larger reward, like a paycheck at the end of the week or a trophy after a season, adding value to their efforts.
- Notable example: Walter Mischel’s marshmallow study demonstrating the benefits of delayed gratification.