Chapter 5: Learning Vocabulary

Foundations of Learning and Conditioning

• Definition of Learning:

  • Learning refers to a relatively enduring change in behavior or knowledge as a result of experience.

  • Learning occurs continuously across every stage of life and within all settings, extending far beyond formal educational environments.

  • Learning is vital for biological survival because it allows humans and animals to adapt their behaviors to the demands of specific environments.

• Definition of Conditioning:

  • Conditioning is the process of learning associations between environmental events and behavioral responses.

  • It serves as a primary mechanism through which organisms construct predictive models of their environment.

• Illustrative Learning Scenarios:

  • Observational Learning / Vicarious Punishment: David observes his sister getting grounded for staying out past curfew; consequently, David avoids staying out late to avoid the same consequence.

  • Operant Conditioning / Positive Reinforcement: Mars the cat receives a food treat every time he sits up on command; as a result, Mars sits up whenever his owner gives the command.

  • Conditioned Taste Aversion: Josh develops severe gastrointestinal illness immediately after eating chicken; consequently, he avoids eating chicken permanently.

Neural Mechanisms of Learning

• Long-Term Potentiation (LTP):

  • Long-term potentiation refers to the persistent strengthening of synaptic connections between neurons based on recent patterns of activity.

  • It provides the primary neurobiological evidence showing that physical biological changes occur in brain circuitry during learning and memory formation.

  • LTP plays a foundational role in structural neural plasticity, allowing the brain to store experiential data efficiently.

Non-Associative Learning Mechanisms

• Definition of Non-Associative Learning:

  • Non-associative learning occurs when an individual learns information about a single external stimulus without connecting or associating it with another stimulus or event.

  • Examples of single stimuli include distinct sights, smells, or sounds.

• Habituation:

  • Definition: A decrease in behavioral responsiveness following lengthy or repeated exposure to a non-threatening stimulus.

  • Function: Grants organisms the cognitive capacity to filter out and ignore irrelevant, repetitive background stimuli.

  • Concrete Examples:

  • Gradually sleeping through the sound of a recurring morning alarm clock.

  • Ceasing to consciously notice a strong perfume scent after wearing or smelling it continuously over time.

• Sensitization:

  • Definition: An increase in behavioral responsiveness or emotional sensitivity as a result of repeated exposure to a stimulus or exposure to an intense, aversive stimulus.

  • Triggering Conditions and Examples:

  • Repeated Application: A child who experiences repeated bullying at school becomes hyper-sensitive and over-reactive to social cues or school settings.

  • Aversive Stimuli: Detecting the smell of smoke or something burning triggers an immediate state of heightened fear and alertness.

Associative Learning: Classical Conditioning

• Definition of Associative Learning:

  • Associative learning is a cognitive process involving the comprehension of how two or more pieces of information or environmental events are interconnected.

  • Includes understanding that two distinct stimuli occur together, or that a specific active behavior leads to a predictable outcome.

• Foundations of Classical Conditioning:

  • Discovered by Russian physiologist Ivan Pavlov (1849–1936) during his research on digestive reflexes, stimuli, and autonomic responses in dogs.

  • Classical conditioning is a basic learning process that involves repeatedly pairing a neutral stimulus with a response-producing stimulus until the neutral stimulus elicits the same response.

  • Mechanism: Classical conditioning does not create new behaviors; rather, it causes an existing reflexive or involuntary behavior to be triggered by a newly learned stimulus association.

• Key Components and Terminology:

  • Unconditioned Stimulus ($UCS$ or $US$): A stimulus that naturally and automatically elicits an innate, reflexive response without any prior learning or experience (e.g., food placed directly into a dog's mouth).

  • Unconditioned Response ($UCR$ or $UR$): An unlearned, natural response triggered automatically by an unconditioned stimulus, such as a reflex (e.g., salivation in response to food).

  • Conditioned Stimulus ($CS$): An initially neutral stimulus that, after being repeatedly paired with an unconditioned stimulus, comes to trigger a learned response (e.g., the sound of a ticking metronome or ringing bell).

  • Conditioned Response ($CR$): The learned, acquired response to a previously neutral conditioned stimulus that occurs only after conditioning has taken place (e.g., salivation elicited solely by a ticking metronome).

• The Classical Conditioning Process (Pavlovian Paradigm):

  • Step 1: Before Conditioning

  • Neutral Stimulus (ticking metronome): The dog notices the sound but does not salivate (no salivation response).

  • Unconditioned Stimulus ($UCS$ - food in mouth): Naturally elicits the Unconditioned Response ($UCR$ - salivation).

  • Step 2: During Conditioning (Acquisition Phase)

  • The Neutral Stimulus (ticking metronome) is repeatedly sounded immediately before presenting the Unconditioned Stimulus ($UCS$ - food in mouth).

  • This combined presentation produces the natural Unconditioned Response ($UCR$ - salivation).

  • Step 3: After Conditioning

  • The ticking metronome is no longer neutral; it is now a Conditioned Stimulus ($CS$).

  • When the metronome ticks, the dog reacts with a Conditioned Response ($CR$ - salivation), salivating even when no food is present.

Factors Affecting Classical Conditioning

• Timing (Temporal Contiguity):

  • Conditioning is most effective when the conditioned stimulus ($CS$) is presented immediately before the unconditioned stimulus ($UCS$).

  • Example: Presenting the sound of a metronome or bell moments prior to feeding the dog establishes a strong predictive relationship.

• Stimulus Generalization:

  • Definition: The occurrence of a learned response not only to the original conditioned stimulus, but also to other novel stimuli that are similar to the original stimulus.

  • Example: A dog conditioned to salivate to a metronome ticking at a specific speed salivates when hearing metronomes or bells with slightly different tempos or tones.

• Stimulus Discrimination:

  • Definition: The occurrence of a learned response to a specific stimulus, but not to other similar stimuli.

  • Example: A dog learns to salivate exclusively to one specific bell frequency because only that tone is paired with food, while other tones are presented without food.

Extinction and Recovery Mechanisms

• Extinction:

  • Definition: The process in which a conditioned response ($CR$) is weakened and eventually disappears when the conditioned stimulus ($CS$) is repeatedly presented without the unconditioned stimulus ($UCS$).

  • Example: Sounding the metronome repeatedly without presenting food causes the dog's salivation response to gradually decrease until it stops entirely.

• Spontaneous Recovery:

  • Definition: The process in which a previously extinguished conditioned response ($CR$) suddenly reemerges after a rest period when the conditioned stimulus ($CS$) is presented again.

  • Significance: Demonstrates that extinction inhibits the conditioned response rather than unlearning or erasing the original memory association.

Conditioned Emotional Responses and Behavioral Applications

• Conditioned Emotional Response ($CER$):

  • Definition: An emotional reaction (such as fear or a phobia) that becomes classically conditioned to occur in response to previously neutral stimuli.

• The Little Albert Experiment (John B. Watson & Rosalie Rayner):

  • Subject: An 11-month-old infant named Little Albert.

  • Pre-Conditioning State: A white rat was presented as a neutral stimulus; Albert showed interest and no fear.

  • Unconditioned Stimulus ($UCS$): Striking a steel bar with a hammer directly behind Albert's head produced a loud clang, serving as the $UCS$.

  • Unconditioned Response ($UCR$): The loud noise naturally caused fear, crying, and emotional distress ($UCR$).

  • Conditioning Phase: The white rat (Neutral Stimulus) was repeatedly presented right as the steel bar was struck ($UCS$).

  • Post-Conditioning Outcome: The white rat became a Conditioned Stimulus ($CS$) that elicited a Conditioned Response ($CR$) of intense fear and crying, even without the loud noise.

  • Stimulus Generalization: Albert's conditioned fear generalized to other furry white items, including rabbits, dogs, fur coats, and Santa Claus masks.

• Behavioral Therapies:

  • Counterconditioning: A behavioral technique focused on altering previously conditioned undesirable responses by pairing the feared stimulus with an enjoyable, positive stimulus.

  • Systematic Desensitization: A specialized form of counterconditioning that involves combining gradual exposure to a feared stimulus with deep relaxation exercises.

Other Classical Conditioning Phenomena

• Conditioned Taste Aversion (Garcia Effect):

  • Definition: The development of nausea or an aversive reaction to a specific taste because that taste was followed by a gastrointestinal illness.

  • Unique Features:

  • Occurs after only a single pairing (one-trial learning).

  • Can develop even if several hours elapse between ingesting the food and experiencing nausea.

  • Possesses evolutionary survival significance by helping organisms avoid toxic or poisonous foods.

Associative Learning: Operant Conditioning

• Definition of Operant Conditioning:

  • Operant conditioning is a learning process investigated extensively by B. F. Skinner, in which the consequences of an active behavior determine the likelihood that the behavior will be repeated in the future.

  • Operant behavior refers to voluntary, nonreflexive behavior emitted by an organism to operate on its environment.

• Thorndike's Law of Effect:

  • Formulated by Edward L. Thorndike based on studies of animal problem-solving in puzzle boxes.

  • Principle: Behaviors followed by favorable or satisfying consequences become more likely to recur, whereas behaviors followed by unfavorable or unpleasant consequences become less likely to recur.

• Experimental Setup (The Skinner Box / Operant Chamber):

  • An enclosure containing a lever or key that an animal (e.g., a rat) can press, cue lights, a speaker, and an automated dispenser that delivers food rewards upon lever presses.

Reinforcement and Punishment Contingencies

• Defining Features:

  • Positive: Presenting or adding a stimulus.

  • Negative: Removing, withholding, or taking away a stimulus.

  • Reinforcement: Increases the frequency of a desirable target behavior.

  • Punishment: Decreases the frequency of an undesirable target behavior.

• Positive Reinforcement:

  • Definition: The addition of a pleasurable stimulus following a response, increasing the probability that the behavior will be repeated.

  • Examples:

  • A rat receives a food pellet after pressing a lever in an operant chamber.

  • Studying hard to win an academic award.

  • Children screaming at Dairy Queen until their father stops the car to get them ice cream.

• Negative Reinforcement:

  • Definition: The removal, escape, or avoidance of an unpleasant or aversive stimulus following a response, increasing the probability that the behavior will be repeated.

  • Examples:

  • Taking an analgesic pill to eliminate a headache.

  • Studying diligently to avoid losing an academic scholarship.

  • Wearing a warm but unstylish flannel shirt to avoid feeling cold and uncomfortable all day.

• Positive Punishment:

  • Definition: The addition of an unpleasant or aversive stimulus following a response, decreasing the probability that the behavior will recur.

  • Examples:

  • Receiving a verbal reprimand or yelling for misbehavior.

  • Receiving a speeding ticket for driving too fast.

  • Government regulatory bodies (EPA and US Justice Department) issuing the largest-ever financial fine to an oil company for illegal polluting practices.

  • Receiving a hurtful comment from a peer ("Nice shirt. Whose couch did you steal to get the fabric?") after wearing an unstylish flannel shirt, leading to a decrease in wearing that shirt.

• Negative Punishment:

  • Definition: The removal or loss of a pleasurable stimulus following a response, decreasing the probability that the behavior will recur.

  • Examples:

  • Taking away a child's mobile phone or electronic devices as punishment.

  • Revoking driving privileges or grounding a teenager for breaking curfew.

Behavioral Shaping

• Definition of Shaping:

  • Shaping is an operant conditioning technique used to establish complex novel behaviors by systematically reinforcing successive approximations toward a desired target behavior.

• Step-by-Step Shaping Procedure:

  • Break down the target behavior into small, manageable component steps.

  • Provide immediate and effective reinforcement for early, rough approximations of the behavior.

  • Maintain heavy reinforcement during the initial learning stages.

  • Reinforce responses less frequently as learning progresses, requiring closer approximations before delivering reinforcement.

  • Incorporate progressively harder steps until only the final target behavior is reinforced.

Observational Learning and Social Learning Theory

• Core Principles of Observational Learning:

  • Advanced by Albert Bandura (b. 1925), who argued that much of human behavior is acquired by watching others.

  • Learning occurs after observing another person engage in a behavior, showing that direct personal reinforcement is not always required.

  • Expectation of reinforcement (watching someone else receive a reward) acts to reinforce the observer's behavior.

• Key Observational Concepts:

  • Modeling: The direct imitation of behaviors observed in others.

  • Vicarious Conditioning: Learning to perform or avoid a behavior after observing others being rewarded or punished for performing that same action.

• Bandura's Bobo Doll Experiments (Early 1960s):

  • Procedure: Young children watched adult models act aggressively toward an inflatable Bobo doll (punching, kicking, hitting with a mallet, and shouting). Control children saw non-aggressive models.

  • Results: Children who observed aggressive models spontaneously reproduced the exact aggressive actions and phrases toward the Bobo doll.

• Ten Factors That Increase the Likelihood of Imitation:

  • 1. Observing people who are rewarded for their behavior.

  • 2. Observing warm, nurturing individuals.

  • 3. Observing people who hold authority, power, or control over the observer's life.

  • 4. Observing models who are similar to the observer in age, sex, and interests.

  • 5. Observing people perceived as having high social status or prestige.

  • 6. When the target task is at an intermediate difficulty level (not extremely easy or extremely difficult).

  • 7. When the observer lacks confidence in their own abilities in that situation.

  • 8. When the observer is in an unfamiliar or ambiguous setting.

  • 9. When the observer has been rewarded for imitating that behavior in the past.

Comprehensive Comparative Frameworks

• Systemic Comparison Between Classical and Operant Conditioning:

• Comparison Dimensions:

  • Type of Behavior:

  • Classical Conditioning: Reflexive, involuntary behaviors.

  • Operant Conditioning: Nonreflexive, voluntary behaviors.

  • Source of Behavior:

  • Classical Conditioning: Elicited passively by environmental stimuli.

  • Operant Conditioning: Emitted actively by the organism.

  • Basis of Learning:

  • Classical Conditioning: Associating two stimuli ($CS + UCS$).

  • Operant Conditioning: Associating an active response with its subsequent consequence.

  • Responses Conditioned:

  • Classical Conditioning: Involuntary physiological and emotional responses.

  • Operant Conditioning: Active behaviors that operate on the environment.

  • Extinction Process:

  • Classical Conditioning: Conditioned response decreases when the conditioned stimulus is repeatedly presented alone.

  • Operant Conditioning: Responding decreases when reinforcing consequences are eliminated.

  • Cognitive Aspects:

  • Classical Conditioning: Expectation that the $CS$ reliably predicts the $UCS$.

  • Operant Conditioning: Performance of behavior is influenced by the expectation of reinforcement or punishment.

  • Evolutionary Influences:

  • Classical Conditioning: Innate biological predispositions govern how easily an association forms between a particular stimulus and response.

  • Operant Conditioning: Behaviors similar to natural or instinctive behaviors are conditioned more readily.