6.6 Operant Conditioning Overview

Operant conditioning is the method by which processes of reward and punishment influence the frequency of our behaviors.
Distinction from classical conditioning:
- Classical conditioning involves automatic responses (e.g., physiology, reflexes, emotions).
- Operant conditioning involves voluntary behaviors, where choices are made and feedback is received in the form of reinforcement or punishment.

Developed the Law of Effect through research with animals, particularly cats.
Conducted experiments where cats were placed in "escape rooms" to discover mechanisms for escape.
Observations:
- Cats learned to escape more quickly over repeated trials. This was shown in a graph with trials on the x-axis and time to escape on the y-axis.
- The Law of Effect:
- States that behaviors followed by satisfying outcomes are more likely to recur.
- Conversely, behaviors not followed by satisfaction tend to diminish.

Expanded on Thorndike's foundational work and is renowned for the concept of operant conditioning.
Utilized operant conditioning chambers, commonly known as Skinner boxes, to observe response patterns in animals.
Basic principles of study include:
- Reinforcement and punishment are critical to altering behavior.
Experimental illustrations:
- A rat learns to press a lever when a green light indicates food is available and to avoid pressing it when a red light is present.
- Modern adaptations include touchscreen technology for studies on the cognitive abilities of birds (e.g., Clark's Nutcrackers).

Reinforcement: Increases the likelihood of a behavior being repeated.
- Example: Visiting a restaurant with excellent food, atmosphere, and service increases future visits.
Punishment: Decreases the likelihood of a behavior being repeated.
- Example: Listening to an unfavorable radio station leads to a decreased likelihood of tuning in again.

Primary Reinforcers:
- These satisfy basic biological needs and have inherent value.
- Examples include food and social validation.
Secondary Reinforcers:
- These gain their reinforcing value through learned associations.
- Examples include money and conditioned stimuli such as a clicker in dog training.
- Money alone has no inherent value; it is valuable because society agrees on its worth.

Reinforcement activates regions in the brain, particularly the nucleus accumbens.
- This part of the basal ganglia is rich in dopamine-releasing cells.
- Dopamine underlies the rewarding experience, linking behaviors and rewarding stimuli together.

Skinner's research was not limited to lab animals but extended to learning concepts applicable across species, including humans.
Concepts from operant conditioning have been used in behavioral therapies, education, animal training, and various settings that require behavioral modifications.