Psychology: Learning (OpenStax)
Fundamentals of Behavior: Unlearned vs. Learned Behaviors
Innate Behaviors:
Organisms are born with innate behaviors that help them adapt to and survive within their environments.
These behaviors occur naturally without prior experience or training.
Innate behaviors fall into two primary categories: reflexes and instincts.
Reflexes:
Definition: Motor or neural reactions to a specific environmental stimulus.
Complexity: Structurally simpler than instincts.
Physical Scope: Involve the activity of specific body parts or localized muscle groups.
Neural Pathways: Governed by primitive, lower centers of the Central Nervous System (), such as the spinal cord and the medulla.
Example: Human infants are born with an unlearned sucking reflex, allowing immediate feeding upon contact.
Instincts:
Definition: Complex, innate behaviors triggered by a broader range of events or internal/environmental shifts.
Triggers: Environmental transitions such as aging, maturation, or the change of seasons.
Physical Scope: Involve coordinated movements of the organism as a whole rather than isolated body parts.
Neural Pathways: Involve higher brain centers and coordinated neurological processing.
Examples: Migration patterns across seasonal shifts, sexual and reproductive activities.
Contrasting Innate and Learned Behaviors:
Loggerhead sea turtle hatchlings possess the innate instinct to locate the ocean and swim immediately upon hatching.
In contrast, humans are not born knowing how to swim or surf; these proficiencies require learning through direct experience and instruction.
Defining Learning:
Definition: A relatively permanent change in behavior or knowledge resulting directly from experience.
Processes: Involves both conscious and unconscious psychological mechanisms.
Adaptation: Like instincts and reflexes, learned behaviors allow organisms to adapt to their environments, but learning specifically demands personal experience, interaction, and modification of prior knowledge.
Associative Learning:
Occurs when an organism makes mental connections between stimuli or events that occur together in the environment.
Forms the backbone of fundamental behaviorist learning theories:
Classical conditioning
Operant conditioning
Observational learning
Classical Conditioning Principles and Mechanisms
Overview and Discovery:
Definition: A form of associative learning where an organism learns to connect stimuli and consequently anticipate environmental events.
Ivan Pavlov: Discovered classical conditioning serendipitously during his physiological research on the digestive system of dogs.
Initial Observation: Pavlov noticed that laboratory dogs salivated not only when meat powder was placed in their mouths, but also at non-food cues, such as the sight of empty food bowls or the approaching footsteps of the laboratory assistants.
Classification of Responses: Pavlov determined that organisms exhibit two fundamental types of responses to their surroundings: unconditioned (unlearned/innate) responses and conditioned (learned) responses.
Core Components of Classical Conditioning:
Unconditioned Stimulus (): A stimulus that reliably and automatically elicits a natural, reflexive response without any prior history of learning (e.g., food presented to a hungry dog).
Unconditioned Response (): A natural, unlearned, reflexive physiological reaction to an unconditioned stimulus (e.g., salivation elicited directly by food).
Neutral Stimulus (): A stimulus that does not naturally elicit the target reflexive response prior to conditioning (e.g., ringing a bell or tone before any conditioning trials).
Conditioned Stimulus (): A previously neutral stimulus that, through repeated pairing with an unconditioned stimulus, comes to elicit a learned response (e.g., the bell sound after conditioning).
Conditioned Response (): The learned behavior elicited by the conditioned stimulus after associative learning has taken place (e.g., salivation occurring solely upon hearing the bell).
The Three Stages of Classical Conditioning:
Before Conditioning:
During Conditioning (Acquisition Phase):
The neutral stimulus is presented immediately prior to the unconditioned stimulus and paired repeatedly.
After Conditioning:
The neutral stimulus has successfully transformed into a conditioned stimulus capable of producing salivation independently.
Higher-Order Conditioning (Second-Order Conditioning):
Definition: A procedure in which an established conditioned stimulus () is paired with a brand-new neutral stimulus (termed the second-order stimulus).
Mechanism: Over repeated pairings, the new neutral stimulus begins to elicit the conditioned response on its own, without requiring the presentation of the original unconditioned stimulus ().
Step-by-Step Feline Example:
First-Order Conditioning: An electric can opener () is paired with canned cat food (), until the sound of the can opener alone causes salivation ().
Second-Order Pairing: The sound of a squeaky cabinet door opening (second-order stimulus / new ) is paired with the operation of the electric can opener ().
Second-Order Outcome: The squeaky cabinet door transforms into an effective conditioned stimulus, producing feline salivation () even when the electric can opener is not used.
Processes and Phenomena in Classical Conditioning
Acquisition:
Definition: The initial period of learning during which an organism forms an associative link between a neutral stimulus and an unconditioned stimulus.
Timing Requirements: Typically requires a very brief temporal interval (often fractions of a second to a few seconds) between the and the , as well as multiple pairing trials.
Biological Exceptions (Taste Aversion): Classical conditioning can occur with intervals lasting up to several hours between the ingestion of food and the onset of illness, and conditioning can solidify after only a single pairing trial.
Extinction:
Definition: The gradual weakening and eventual disappearance of the conditioned response when the unconditioned stimulus is consistently withheld from the conditioned stimulus.
Operational Dynamic: If a bell () is rung repeatedly without being accompanied by food (), the animal gradually decreases its salivation response until the conditioned response extinguishes entirely.
Spontaneous Recovery:
Definition: The reappearance of an extinguished conditioned response following a period of rest or delay without any renewed conditioning trials.
Characteristics: The recovered response typically exhibits lower strength than during the peak of acquisition and will extinguish quickly if the unconditioned stimulus remains absent.
Stimulus Discrimination vs. Stimulus Generalization:
Stimulus Discrimination:
The ability of an organism to differentiate between various stimuli that share similar physical properties and respond selectively only to the specific conditioned stimulus.
Example: A dog learns to salivate exclusively to the precise pitch of a specific bell signaling food, while remaining unresponsive to alternative tones or bells that signal no reward.
Stimulus Generalization:
The automatic tendency of an organism to exhibit the conditioned response to novel stimuli that resemble the original conditioned stimulus.
Example: A person who acquires a conditioned fear or aversion to a specific spider species will frequently generalize that aversion to all types of spiders.
Habituation:
Definition: A non-associative learning process characterized by a decreased behavioral response to a stimulus after repeated, continuous presentations without any accompanying changes or consequences.
Attention Shift: As the repeated stimulus ceases to convey novel information or threat, cognitive and sensory systems cease allocating attention to it.
Behaviorism and Human Emotional Conditioning
Watson's Behaviorist Framework:
John B. Watson argued that psychology must focus strictly on observable behavior rather than internal mental states.
Watson believed that all behavior could be understood as learned stimulus-response () reactions.
He posited that core human emotions—such as fear, love, and rage—could be artificially conditioned through classical conditioning principles.
The "Little Albert" Study (Watson and Rayner):
Target Subject: An infant known as "Little Albert."
Baseline Assessment: Albert was initially presented with various neutral stimuli, including a white rat, a rabbit, a dog, cotton wool, and masks; he demonstrated curiosity and showed zero baseline fear toward any of them.
Conditioning Procedure:
Watson and Rayner presented the white rat () to Albert.
Every time Albert reached out and touched the rat, the researchers struck a suspended steel bar with a hammer immediately behind Albert's head, generating a sudden, loud noise ().
The loud noise naturally caused an unconditioned fear response (), including crying and distress.
Conditioned Outcome: After repeated pairings of the white rat () and the striking noise (), Albert began exhibiting intense fear, crying, and crawling away () upon the mere visual presentation of the white rat alone.
Stimulus Generalization in Little Albert:
Following conditioning, Albert generalized his learned fear to a wide array of similar furry objects that had never been directly paired with the loud sound.
Generalized stimuli included a rabbit, a dog, a sealskin coat, loose cotton wool, and Watson wearing a Santa Claus beard mask.
Durability Note: Because Albert was discharged from the hospital setting soon after the experiments concluded, there exists no empirical evidence demonstrating whether his conditioned phobias were permanent or naturally extinguished over time.
Operant Conditioning: Foundations and Principles
Theoretical Basis and B.F. Skinner:
Proposed and developed extensively by B.F. Skinner.
Definition: A learning paradigm in which organisms learn to form associations between an emitted behavior and the resulting consequences (reinforcements or punishments).
The Law of Effect (Edward Thorndike):
Behaviors followed by pleasant consequences or desired outcomes are strengthened and become significantly more likely to recur.
Behaviors followed by unpleasant consequences or undesired outcomes are weakened and become less likely to recur.
Real-World Application: Employees report to work (behavior) because they receive financial compensation (pleasant consequence), which reliably maintains workplace attendance.
Contrasting Classical and Operant Conditioning:
Conditioning Approach:
Classical Conditioning: An unconditioned stimulus is systematically paired with a neutral stimulus. The neutral stimulus becomes a conditioned stimulus eliciting an involuntary, reflexive conditioned response.
Operant Conditioning: A voluntary target behavior emitted by the subject is immediately followed by a reinforcer or punisher to alter the future probability of that behavior.
Stimulus Timing:
Classical Conditioning: The conditioning stimulus appears immediately before the elicited biological response.
Operant Conditioning: The consequence (reinforcement or punishment) occurs soon after the voluntary target response is performed.
The Operant Conditioning Chamber (Skinner Box):
A specialized laboratory enclosure designed by Skinner to objectively monitor animal behavior (primarily utilizing rats and pigeons).
Apparatus Features:
A mechanical lever (for rats) or pecking disc (for pigeons).
An automated food dispenser that delivers measured food pellets as rewards.
Auditory speakers and colored cue lights capable of presenting discriminative stimuli.
An electrified grid floor capable of delivering mild shock stimuli to evaluate aversive conditioning.
Experimental Function: Provides an environment isolated from outside variables where precise response rates and schedules of reinforcement can be mathematically recorded.
Fundamental Operant Terminology:
Positive (): The introduction or presentation of a stimulus immediately following a behavior.
Negative (): The termination, subtraction, or removal of a stimulus immediately following a behavior.
Reinforcement: Any consequence that increases or maintains the frequency, intensity, or likelihood of a behavior.
Punishment: Any consequence that decreases or eliminates the frequency, intensity, or likelihood of a behavior.
Reinforcement, Punishment, and Behavioral Modification
The Four Operant Conditioning Contingencies:
Positive Reinforcement:
Process: An appetitive or desirable stimulus is added following a behavior, increasing the future probability of that behavior.
Examples: Receiving praise, high academic grades, financial compensation, or bonus pay.
Sticker Charts: Common behavior modification tools where children receive physical stickers for desirable actions; accumulating a designated threshold of stickers yields a secondary reward, such as an outing to an ice cream parlor.
Negative Reinforcement:
Process: An aversive or unpleasant stimulus is removed or avoided following a behavior, increasing the future probability of that behavior.
Everyday Example: Fastening a car seatbelt eliminates the persistent, irritating seatbelt chime; the cessation of the sound reinforces seatbelt usage.
Positive Punishment:
Process: An aversive stimulus is added or applied following an undesired behavior, decreasing the future probability of that behavior.
Everyday Example: A teacher publicly scolding a student for texting during an academic lecture.
Negative Punishment:
Process: A desirable stimulus is removed or revoked following an undesired behavior, decreasing the future probability of that behavior.
Everyday Example: Confiscating a child's favorite toy or grounding an adolescent when household rules are violated.
Shaping (Method of Successive Approximations):
Definition: An operant conditioning technique where reinforcement is systematically delivered for successive approximations toward a final, complex target behavior rather than waiting for the entire target behavior to occur spontaneously.
Utility: Highly effective for teaching complex chains of novel behavior that animals or humans would not perform naturally.
Step-by-Step Shaping Sequence:
Initial Response: Reinforce any spontaneous behavior that remotely resembles or moves toward the ultimate desired behavior.
Closer Approximation: Cease reinforcing the original preliminary behavior and reinforce only actions that more closely resemble the desired behavior.
Refined Approximation: Reinforce only responses that match the target behavior with even greater accuracy and precision.
Final Mastery: Continuously tighten the reinforcement criteria until solely the finalized target behavior produces the reinforcer.
Primary vs. Secondary Reinforcers:
Primary Reinforcers:
Stimuli possessing biological, innate reinforcing qualities.
Do not require any prior conditioning or learning to acquire value.
Examples: Food, water, sleep, sexual interaction, and tactile pleasure.
Secondary Reinforcers (Conditioned Reinforcers):
Neutral stimuli that have no intrinsic biological value on their own.
Value is acquired exclusively by being repeatedly paired with primary reinforcers or other established secondary reinforcers.
Praise: Secondary reinforcer derived from its association with parental warmth and physical affection (primary reinforcers).
Money: Has zero nutritional or physical utility until exchanged for primary reinforcers (e.g., food, shelter) or other secondary reinforcers.
Token Economies:
Structured behavioral modification systems wherein individuals earn non-monetary physical tokens (chips, points, tickets) for emitting targeted prosocial behaviors.
Accumulated tokens can later be exchanged for diverse back-up privileges, treats, or rewards.
Broadly implemented across institutional environments, including schools, prisons, and psychiatric facilities.
Schedules of Reinforcement
Continuous vs. Partial Reinforcement:
Continuous Reinforcement:
Delivering a reinforcer every single time the target behavior is exhibited.
Represents the fastest method for initially establishing and teaching a novel behavior.
Example: Rewarding a dog with an edible treat each time it executes the "sit" command.
Vulnerability: Highly susceptible to rapid extinction; if the trainer abruptly discontinues delivering treats, the animal will swiftly discontinue displaying the behavior.
Partial (Intermittent) Reinforcement:
Delivering reinforcement on an intermittent schedule where the target behavior is not reinforced on every trial.
Crucial for maintaining behaviors long-term and generating substantial resistance to extinction.
Dimensions of Partial Reinforcement Schedules:
Fixed vs. Variable:
Fixed: The number of required responses or the duration of elapsed time between reinforcements is predetermined, static, and constant.
Variable: The number of required responses or the duration of elapsed time fluctuates around an unpredictable mathematical average.
Interval vs. Ratio:
Interval: The delivery of reinforcement depends on the passage of time before an emitted response is rewarded.
Ratio: The delivery of reinforcement depends on the exact quantity of behavioral responses executed.
The Four Partial Reinforcement Schedules:
Fixed Interval ():
Reinforcement is provided for the first response made after a predictable, set period of time has elapsed.
Response Pattern: Produces a characteristic "scallop-shaped" response curve; the organism pauses immediately following reinforcement, followed by an accelerating burst of responding as the reinforcement window approaches.
Example: A patient recovering from surgery who is administered intravenous pain relief medication on a locked timer schedule (e.g., once every hour).
Variable Interval ():
Reinforcement is provided for the first response made after unpredictable, varying periods of time have elapsed.
Response Pattern: Produces a moderate, highly steady response rate without significant post-reinforcement pauses.
Examples: A restaurant manager conducting unannounced quality inspections at random intervals throughout a month; periodically checking a social media feed for unpredictable incoming messages.
Fixed Ratio ():
Reinforcement is delivered strictly after a predetermined, predictable number of discrete responses have been completed.
Response Pattern: Produces a high, rapid rate of responding punctuated by a brief pause immediately following the receipt of reinforcement.
Examples: Piecework compensation where factory workers receive payment for every units of products manufactured; an eyeglass saleswoman who earns a commission payment for every set quota of glasses sold.
Variable Ratio ():
Reinforcement is delivered after an unpredictable, varying number of behavioral responses (fluctuating around a mean ratio).
Response Pattern: Produces extremely high, remarkably steady response rates with virtually no pause after reinforcement.
Extinction Resistance: Demonstrates the highest resistance to behavioral extinction among all basic reinforcement schedules.
Examples: Gambling activities, including lottery tickets, roulette, and slot machines.
Gambling and Neurochemistry:
The structural mechanics of variable ratio schedules produce powerful behavioral persistence.
Neurological studies indicate that pathological gamblers may engage in compulsive gambling to biologically compensate for abnormally low basal levels of norepinephrine.
Norepinephrine is directly linked to stress reactivity, autonomic arousal, and thrill-seeking, and is released during states of intense excitement and anticipation.
Cognitive Aspects of Learning and Latent Learning
Edward C. Tolman and the Cognitive Revolution in Learning:
Classic behaviorism asserted that learning could occur only when direct, observable reinforcement was applied to strengthen a behavioral link.
Psychologist Edward C. Tolman demonstrated empirically that organisms can acquire complex knowledge and learn without immediate external reinforcement, introducing essential cognitive paradigms to learning theory.
Tolman's Latent Learning Experiments:
Tolman placed hungry rats into complex spatial mazes divided into distinct experimental groups.
Procedure:
Control rats were given immediate food reinforcement at the maze exit and steadily learned the path.
Experimental rats were permitted to wander through the maze for consecutive daily sessions without any food reinforcement present at the exit.
On the session, a food reward was introduced into the goal box at the exit of the maze for the previously unreinforced group.
Experimental Outcome:
Once food was placed at the exit, the previously unreinforced rats navigated through the maze just as swiftly and with as few errors as the control group that had been reinforced throughout all prior sessions.
The rats had internal knowledge of the maze layout that was not translated into overt performance until an incentive was introduced.
Cognitive Maps:
Definition: A mental representation or internalized spatial picture of the physical layout of an environment.
Maze and Modern Analogies:
Tolman's rats utilized cognitive maps to choose optimal navigational turns.
Video game players rely on internal cognitive maps to master complex spatial levels, remembering where to turn left, ascend, or navigate around hazards.
Latent Learning Principles:
Definition: Learning that occurs in the absence of reinforcement and remains hidden or unobservable in behavior until the organism is provided with an incentive or reason to actively demonstrate it.
Everyday Examples:
A child rides in the passenger seat while a parent drives the route to school daily; the child does not exhibit this acquired knowledge until forced to bike or walk to school independently.
Children passively absorb and internalize interpersonal behaviors from parents, executing those exact behavioral patterns years later in adulthood.
Observational Learning and Social Learning Theory
Albert Bandura and Social Learning Theory:
Albert Bandura posited that pure behaviorism (relying solely on direct conditioning via external reinforcement) is insufficient to explain human learning.
Bandura proposed Social Learning Theory, emphasizing that learning occurs through observing the actions of others.
Observational learning entails sophisticated cognitive processing rather than simple, reflexive imitation.
Terminology:
Observational Learning: The process of acquiring knowledge and behavioral patterns by observing models and subsequently reproducing those actions.
Model: The individual who demonstrates or performs the target behavior being witnessed.
Live Model: An actual, physically present person demonstrating a behavior in real-time (e.g., an in-person yoga instructor modeling bodily stances and movements).
Symbolic Model: Fictional or real individuals demonstrating behavior through media, including television programs, video games, internet videos, or books.
The Four Stages of the Modeling Process:
1. Attention: The observer must actively focus their cognitive resources and senses on the model's behavior.
2. Retention: The observer must mentally encode, organize, and retain the witnessed sequence of actions in memory for future retrieval.
3. Reproduction: The observer must possess the physical and psychological capability to translate the stored mental representation into motor performance.
4. Motivation: The observer must possess the desire or drive to perform the demonstrated behavior; motivation is heavily dictated by the perceived consequences of the model's actions.
Vicarious Consequences:
Vicarious Reinforcement: When an observer sees a model rewarded for displaying a behavior, the observer becomes significantly more likely to imitate that behavior.
Vicarious Punishment: When an observer sees a model reprimanded, penalized, or punished for a behavior, the observer becomes far less likely to replicate that action.
The Bobo Doll Experiment:
Experimental Setup: Young children observed an adult model interact with an inflatable, tall weighted "Bobo doll."
Model Variations:
The adult aggressively assaulted the Bobo doll (punching it, kicking it, hitting it with a mallet, and tossing it into the air while shouting aggressive phrases).
Following the aggression, the adult model was either rewarded/praised, punished by an experimenter, or met with no consequence (ignored).
Behavioral Findings:
Children placed into a playroom with the Bobo doll directly imitated the exact aggressive verbal and motor patterns modeled by the adult.
Children who witnessed the adult being punished exhibited significantly less aggressive imitation toward the doll.
Children who observed the adult being praised or receiving no consequence displayed high rates of aggressive modeling.
Prosocial vs. Antisocial Effects of Modeling:
Prosocial Modeling: Observing cooperative, empathetic, and constructive actions encourages helpful, rule-abiding behaviors in children and communities.
Antisocial Modeling: Observing abuse, aggression, or unpunished misconduct promotes aggressive behavior.
Media Violence: Psychological research indicates a correlation between exposure to violent media (such as violent video games and television programming) and heightened levels of aggressive ideation and behavior in children.