Week 10 Lecture 2 Video 1 Operant Conditioning

Lecture begins with a thank you to participants and an overview of the session's focus on learning and conditioning.
Mention of an online module on learning and conditioning previously posted.

Discussion on understanding what learning is and comparing different forms of learning:
- Pavlovian Conditioning: Form of associative learning where a neutral stimulus is paired with an unconditioned stimulus to elicit a conditioned response.
- Example: When a bell rings (neutral stimulus) and is paired repeatedly with food (unconditioned stimulus), the sound of the bell eventually elicits salivation (conditioned response).
- Operant Conditioning: Focus on the consequences of behavior rather than the associations of stimuli.
- Definition: Learning where behaviors are influenced by the outcomes that follow them, shaping future behavior based on reinforcement or punishment.

Definition by B.F. Skinner in the 1930s, emphasizing the active role of organisms in modifying their environment.
Example of operant conditioning:
- Studying hard for a test leading to good grades reinforces future studying behavior.
Differences from Pavlovian conditioning:
- In operant conditioning, behaviors are emitted voluntarily rather than reflexively motivated by stimuli.

Discussed as an early researcher in operant conditioning.
Puzzle Box Experiment:
- Development of a puzzle box where cats were placed and had to find ways to escape by manipulating levers to gain food after various trials.
- Observed decrease in response latency (time taken to escape) over several trials, indicating learning through experience.
Thorndike's Law of Effect:
- States that responses in the presence of a stimulus that lead to satisfying consequences will strengthen the association between the stimulus and the response, promoting repeated behavior in the same context.
Modern adaptation: Reinforcement replaces the term satisfying effects in contemporary discussions of operant conditioning.

Skinner's pivotal research established a foundation for operant conditioning, exploring the influence of reinforcement on behavior.
Skinner's apparatus evolution from Thorndike’s method:
- Criticism of the inefficiency of Thorndike’s puzzle box led to the Operant Chamber (Skinner Box) which maximized data collection efficiency.
- Features included food dispensers, levers, lights, and tone signals for conditioning animals like rats and pigeons.

Antecedent (A): Discriminative stimulus that indicates when a behavior will be reinforced.
Behavior (B): The action taken by the organism.
Consequence (C): The outcome that follows the behavior, strengthening or weakening future behaviors.
Example: Phone ringing (A) leads to answering the phone (B) and having a conversation (C).

Stimulus Control: Relationship between antecedent stimuli and behavior; determines context for appropriate behavior.
Schedule Control: Relationship between behavior and consequence, including the nature of reinforcement or punishment.

Reinforcer: A consequence that increases the likelihood of a behavior being repeated.
- Divided into:
- Positive Reinforcement: Addition of a desirable stimulus following a behavior.
  - Example: Rat receiving food for pressing a lever.
- Negative Reinforcement: Removal of an aversive stimulus following a behavior, increasing the likelihood of that behavior.
  - Example: Taking pain relievers to eliminate headache pain encourages future use of pain relievers.

Positive Punishment: Application of an aversive stimulus to decrease a behavior's occurrence.
- Example: Child being reprimanded for hitting a sibling leading to reduced likelihood of that behavior.
Negative Punishment: Removal of a desirable stimulus to reduce a behavior's occurrence.
- Example: Time-out techniques where children lose privileges as a result of undesirable behavior.

Extinction involves stopping reinforcement to reduce or eliminate a behavior.
Discusses the concept through illustrative examples, such as ignoring a dog's jumping behavior until calm.
- Demonstrates how extinction will be more effective if the reinforced behavior was consistently rewarded beforehand.

Primary Reinforcers/Punishers: Directly satisfy a survival need (food is a primary reinforcer; pain is a primary punisher).
Conditioned Reinforcers/Punishers: Gains significance through association with primary reinforcers/punishers.
Premack Principle: A behavior can serve as a reinforcer for another behavior, demonstrating that preferred activities can encourage completion of less preferred activities.

The terms used like reinforcer and punisher have precise meanings in the context of operant conditioning.
The effectiveness of reinforcement and punishment can be influenced by:
- Immediate vs. delayed consequences of behavior.
- Magnitude of the reinforcer or punisher.
- Deprivation of the reinforcer for a greater impact.

Summary tables provided for differences between Pavlovian and operant conditioning, classification of reinforcers and punishers, and relevant examples discussed throughout the lecture to aid in revision and understanding of key principles.