Comprehensive Study Guide: Operant Conditioning Processes, Shaping, and Reinforcement Schedules
The Process of Operant Conditioning and the Concept of Shaping
Skinner's Approach to Behavior Modification: B. F. Skinner focused on the processes of operant conditioning, primarily utilizing positive and negative reinforcements. He was notably less interested in the use of punishment to alter the behavior of his subjects, which typically included pigeons and rats.
The Concept of Shaping: Shaping is defined as a training procedure used to create complex behaviors that do not occur naturally all at once. This is achieved through small, successive steps where behaviors are reinforced as they become closer and closer approximations of the desired final response.
Example: Teaching a Dog to Fetch a Newspaper: * Goal: Using positive reinforcement to teach a dog to retrieve a newspaper from the front lawn. * Step 1: Reinforce the dog with a treat simply for going to the front lawn when the paperboy arrives (a process that may take several days). * Step 2: Reinforce the dog again specifically when it picks up the newspaper. * Step 3: Provide another reinforcement (treat) once the dog successfully brings the paper back to the owner's feet. * Principle: Reinforcing small, incremental actions is more effective than attempting to train the entire complex process as a single unit.
Shaping vs. Chaining: * Shaping: Refers to each individual successive action being reinforced to mold the behavior. * Chaining: Refers to the specific process of linking these reinforced actions together in a particular sequence or order. * Analogous Example: Teaching a child the multi-step process of tying their shoelaces.
Technical Aids in Training: Tools such as clickers are often utilized during the shaping process to provide an immediate signal to the subject that a correct behavior has occurred. This complex shaping process is specifically effective when paired with positive reinforcement.
The Accidental Discovery of Extinction
The Satiation Experiment Incident: Skinner discovered the phenomenon of extinction by accident due to a mechanical failure in his laboratory equipment.
The Event: While observing a rat pressing a lever in an experiment regarding satiation, the pellet dispenser jammed. Skinner was not present at the time, but upon his return, he discovered what he described as a "beautiful curve" in the data.
Observation: Despite receiving no pellets (reinforcement), the rat continued to press the lever for a time before the behavior eventually declined. Skinner noted that this change was more orderly than the extinction of the salivary reflex observed in Pavlovian (classical) conditioning.
Skinner’s Personal Reaction: Skinner was so excited by this discovery on a Friday afternoon that he became intensely anxious about his own safety over the weekend. He famously stated that he "crossed the streets with particular care and avoided all unnecessary risks" to ensure he lived long enough to share the discovery with his colleagues on Monday.
Mechanism of Extinction: In operant conditioning, if the reinforcer is permanently removed, the tendency to produce the response will weaken and eventually vanish. This commencement of extinction typically features a gradual decline until the response rate reaches zero.
Schedules of Reinforcement: Continuous vs. Partial
Continuous Reinforcement: This involves reinforcing a behavior every single time it occurs (e.g., a rat receives a food pellet for every lever press). While this method is highly effective for training a brand-new behavior, it is less durable over time.
The Discovery of Partial Reinforcement: Skinner discovered the effects of partial reinforcement when he realized one weekend that he was running low on food pellets. To conserve his supply, he began reinforcing only every second response instead of every single one.
Resistance to Extinction: Skinner found that behaviors reinforced on a partial (or intermittent) schedule are significantly more resistant to extinction than those on a continuous schedule. The conditioned behavior persists for a longer duration when reinforcement is not obtained on every response.
The Four Types of Intermittent Reinforcement Schedules
1. Fixed Interval (FI) Schedule
Definition: Behavior is rewarded after a specific, set amount of time has passed.
Real-World Example: Hourly employment. A worker is paid the same amount for the hour regardless of the specific quantity of work accomplished within that timeframe.
Response Pattern: Produces a "scallop-shaped" pattern. There is a significant pause in responding immediately after reinforcement, with response rates increasing as the time for the next reward approaches.
Outcome: Better suited for maintaining a higher quality of output rather than quantity.
2. Variable Interval (VI) Schedule
Definition: Reinforcement is provided after an unpredictable and varying amount of time has elapsed, based on an average.
Real-World Example: Fishing. A fisherman may know that, on average, they catch a certain number of fish in a day, but the exact timing of each catch is unpredictable.
Response Pattern: Produces a moderate and steady response rate because the subject never knows exactly when the reinforcement will occur.
3. Fixed Ratio (FR) Schedule
Definition: Reinforcement is delivered after a set, fixed number of responses.
Real-World Examples: * Fruit Picking: Workers paid based on the amount of fruit picked, encouraging them to work faster to increase earnings. * Coffee Cards: A "buy 10, get 1 free" loyalty card where the 10th behavior (purchase) is always the one reinforced. * Sales Commission: An eyeglasses salesperson earning a commission for every pair sold; the quality of the sale is secondary to the quantity sold.
Response Pattern: Predictable and yields a high response rate, with only a very short pause after reinforcement.
Outcome: Optimized for the quantity of output.
4. Variable Ratio (VR) Schedule
Definition: The number of responses required for a reward varies around an average number.
Power and Potency: This is considered the most powerful type of intermittent reinforcement schedule.
Real-World Example: Slot machines or gambling. The odds might be set to pay out on an average of in turns, but the actual payout occurs at unpredictable intervals.
Behavioral Impact: This schedule is highly addictive. Subjects will continue to respond long after a "losing streak" because they believe the next response could be the one that is reinforced.
Response Pattern: Yields high and steady response rates with little to no pause after reinforcement.
Adaptation, Discrimination, and Generalization
Adaptive Responding: Because environments are dynamic and constantly changing, organisms must adapt their responses. This involves knowing when to emit specific behaviors based on environmental cues.
Discriminative Stimuli: Organisms learn to produce certain actions only in the presence of specific stimuli that signal reinforcement is available.
Generalization: The tendency to perform a reinforced behavior in the presence of stimuli that are similar to the original discriminative stimulus.
Discrimination: The ability to distinguish between similar stimuli and withhold the behavior if the stimulus is not the one associated with reinforcement.
Applications of Operant Conditioning in the Real World
Behavioral Therapies: Techniques used to eliminate undesirable habits or behaviors in various populations: * Teaching children to stop thumb-sucking. * Reducing temper tantrums in children. * Assisting adults with smoking cessation.
Token Economies: A system where subjects are rewarded for good behaviors with tokens (like stickers on a chart for children) that can later be traded or exchanged for desirable items or privileges. This is frequently used in remedial education settings.
Applied Behavior Analysis (ABA): A specific therapeutic application of operant conditioning principles frequently used in the treatment and support of individuals with autism.