Operant Conditioning

Operant Conditioning

Definition

  • Operant Conditioning: A learning process in which behavior is modified by its consequences. The likelihood of behavior repeating is influenced by the outcomes following the behavior.

    • Reinforcements: Increase the likelihood of a behavior recurring.

    • Punishments: Decrease the likelihood of a behavior recurring.

Historical Background

Edward Thorndike

  • Research Methods:

    • Conducted experiments using devices known as puzzle boxes.

    • Procedure:

    • A hungry cat was placed inside a puzzle box with food placed outside.

    • The cat had to push a lever to escape and reach the food.

    • Initially, the behavior of pushing the lever was accidental.

    • Over time, the cat learned to perform the action deliberately, resulting in faster escape times.

  • Law of Effect:

    • Developed by Thorndike.

    • States that rewarded behaviors are likely to recur, while punished behaviors are less likely to recur.

Time Required to Escape (in Seconds)

  • The graph indicated trials showing numbers:

    • 240 seconds

    • 180 seconds

    • 120 seconds

    • 60 seconds

    • 0 seconds

  • This illustrates the decreasing time taken by the cat to escape over successive trials in the puzzle box.

B.F. Skinner

  • Contributions:

    • Expanded on Thorndike’s research and coined the term “operant conditioning.”

    • Focused on how behaviors are affected by manipulating reinforcers and their consequences.

    • Utilized an operant chamber, commonly known as the Skinner Box, to conduct his experiments.

Components of Operant Conditioning

Reinforcers

  • Definition: Stimuli that increase the likelihood of a behavior occurring again.

Types of Reinforcers:

  1. Positive Reinforcement:

    • Increases behavior by presenting a desirable stimulus.

    • Example: Giving a treat to a dog that sits on command.

  2. Negative Reinforcement:

    • Increases behavior by removing an undesirable stimulus.

    • Example: Taking painkillers to relieve pain.

Punishments

  • Definition: Stimuli that decrease the likelihood of a behavior reoccurring.

Types of Punishments:

  1. Positive Punishment:

    • Decreases behavior by introducing an undesirable stimulus.

    • Example: Spraying water on a barking dog.

  2. Negative Punishment:

    • Decreases behavior by removing a desirable stimulus.

    • Example: Taking away a teen's driving privileges for misbehavior.

Reinforcer Categories

  1. Primary Reinforcers:

    • Have intrinsic value and do not need to be learned (e.g., food, water).

  2. Secondary (Conditioned) Reinforcers:

    • Have value through learned associations (e.g., money, praise).

Discriminative Stimulus

  • Definition: A cue that signals that reinforcement is available if a particular behavior is performed.

  • Develops an association between the stimulus and reinforcement.

Shaping

  • Definition: A procedure wherein reinforcers are used to guide behavior toward closer approximations of a desired behavior.

  • Importance: Helps in teaching complex behaviors by reinforcing successive approximations.

Extinction

  • Definition: Gradual weakening and disappearance of a conditioned response when reinforcements are no longer presented.

Schedules of Reinforcement

Definitions

  • Continuous Reinforcement Schedule: Reinforcement is provided every time a desired response occurs.

  • Partial Reinforcement Schedule: Reinforcement is given only part of the time after a desired response occurs.

    • Can be based on time or the actual desired response.

Variations of Partial Reinforcement Schedules

  1. Fixed Ratio (FR) Schedule:

    • Reinforces a response only after a specified number of responses.

    • Example: Buy 10 coffees, get 1 free.

  2. Variable Ratio (VR) Schedule:

    • Reinforces responses after an unpredictable number of responses.

    • Example: Slot machines in a casino; the player may win after one spin or many.

  3. Fixed Interval (FI) Schedule:

    • Reinforces a response only after a specified time period has elapsed.

    • Example: Employee gets paid every two weeks.

  4. Variable Interval (VI) Schedule:

    • Reinforces a response at unpredictable time intervals.

    • Example: Checking social media for updates.

Table 27.2: Schedules of Reinforcement

  • Ratio

    • Fixed: After every nth behavior (e.g., after 10 purchases).

    • Variable: After an unpredictable number of behaviors (e.g., random wins in a slot machine).

  • Interval

    • Fixed: After a fixed time (e.g., weekly pay).

    • Variable: After random time intervals (e.g., checking for updates on a website).

Types of Learning Related to Operant Conditioning

Escape Learning

  • Definition: Learning how to “escape” from an undesired stimulus.

  • Example: A rat learns to pull a lever to avoid an electric shock.

Avoidance Learning

  • Definition: Learning to perform a response to avoid an undesired stimulus altogether.

  • Example: A student studies to avoid poor grades.

Applications of Operant Conditioning

  • Practical Applications in Various Settings:

    • Behavior Modification: Used to change undesirable behaviors into more acceptable ones.

    • Applied Behavior Analysis (ABA): Techniques used primarily in therapeutic settings, especially for autism spectrum disorders.

    • Token Economies: Reinforcement systems used in schools, sports, workplaces, and homes.

    • Superstitions: Illustrates the arbitrary connection between behavior and consequences.

Ways to Decrease Behavior

Table 27.3: Methods of Decreasing Behavior

  • Type of Punisher:

    • Positive Punishment: Administer an aversive stimulus.

    • Examples:

      • Give a traffic ticket for speeding.

      • Spray water on a barking dog.

    • Negative Punishment: Withdraw a rewarding stimulus.

    • Examples:

      • Take away a teen's driving privileges.

      • Revoke a library card for nonpayment of fines.

Ways to Increase Behavior

Table 27.1: Methods for Increasing Behavior

  • Positive Reinforcement: Add a desirable stimulus.

    • Examples:

    • Pet a dog that comes when called.

    • Pay a person for painting your house.

  • Negative Reinforcement: Remove an aversive stimulus.

    • Examples:

    • Take painkillers to relieve pain.

    • Fasten a seatbelt to eliminate loud beeping.