Operant Conditioning Study Notes

Operant Conditioning

Definition and Overview

  • Operant Conditioning: A type of learning where behavior is modified by its consequences, specifically by reinforcers and punishers.
    • Operant Behavior: Active behaviors that operate on the environment to produce consequences.
  • Operant conditioning differs from classical conditioning:
    • Classical Conditioning: Involves involuntary, automatic (respondent) behaviors that are associated with stimuli.

Key Concepts

  • Law of Effect: Proposed by Edward Thorndike; states that:
    • Behaviors followed by favorable outcomes (or reinforcements) are more likely to recur.
    • Behaviors followed by unfavorable outcomes (or punishments) are less likely to recur.

Operant Chamber (Skinner Box)

  • An experimental setup for studying operant conditioning, equipped with a bar or key that an animal can manipulate to receive food or water as a reinforcer.
  • Allows researchers to measure the frequency of behaviors such as bar pressing or key pecking.

Reinforcement

  • Reinforcement: Any event that strengthens the behavior it follows. It can be classified as follows:
    • Positive Reinforcement: Increases behavior by presenting a pleasurable stimulus following the behavior.
    • Example: Giving a child a treat for completing homework.
    • Negative Reinforcement: Increases behavior by removing or reducing an aversive stimulus.
    • Example: Taking painkillers to relieve headache pain. Note: This is NOT punishment, as it also strengthens the response.
  • Primary Reinforcer: An innately reinforcing stimulus that satisfies a biological need (e.g., food, water).
  • Conditioned Reinforcer (or Secondary Reinforcer): Gains its reinforcing power through association with a primary reinforcer (e.g., money, praise).
    • Both positive and negative reinforcers can increase desired behaviors.

Shaping

  • A procedure in operant conditioning involving the reinforcement of successive approximations toward a desired behavior.
    • This involves gradually increasing the criteria for reinforcement, helping to guide the learner from simple to more complex responses.
    • Ensures the learner remains engaged and progressively builds towards the ultimate goal.

Discriminative Stimulus

  • Discriminative Stimulus: A stimulus that signals the availability of reinforcement or punishment.
    • Example: Traffic lights—green light signifies "go" (reinforcement), while red indicates "stop" (punishment).

B.F. Skinner

  • B.F. Skinner: An influential and controversial figure in behaviorism who built upon Thorndike's work to develop a comprehensive theory of operant conditioning.
    • Known for conducting experiments with pigeons and rats using operant chambers.
    • Demonstrated how reinforcement could be utilized to shape behavior systematically.
    • Involved the use of animals in controlled settings to show the strength of operant behaviors and the mechanics of learning through reinforcement.

Applications of Reinforcement

  • Both types of reinforcement (positive and negative) can work together to increase desired behavior.
    • Example: Studying for an exam can lead to better grades (positive reinforcement) and reduce anxiety (negative reinforcement).
  • Delayed reinforcement: Humans can learn to wait for a larger reward, like a paycheck at the end of the week or a trophy after a season, adding value to their efforts.
    • Notable example: Walter Mischel’s marshmallow study demonstrating the benefits of delayed gratification.