Comprehensive Lecture Notes on Classical and Operant Conditioning, Cognitive Learning, and Memory Systems
Course Project Guidelines and Administrative Policies
- New Experience Project Activity Submission Rules:
- Proposed activities submitted for the project are interchangeable.
- Activity choices may be changed after initial submission if a more interesting topic is identified.
- Changes must not be made too close to the paper's final due date (e.g., switching one week prior to the deadline creates an unmanageably tight timeline).
- If the submission portal does not permit a second attempt, students must notify the instructor via email.
- Resubmission emails must contain the newly selected activity detailed to the same depth and standard as the original submission.
Foundations of Learning and Associative Processes
Definition of Learning:
- A systematic process through which an organism takes in environmental information to alter or influence behavior, occurring entirely through experience.
- Dynamic adaptation: Behavior shifts in response to social context (e.g., an instructor circulating across a room to engage a full classroom versus speaking statically to a single attendee).
Core Paradigms of Learning:
- Behaviorism: A foundational theory of learning restricted strictly to observable behaviors in organisms, deliberately excluding unobservable internal mental states or thoughts.
- Associative Learning: Learning that occurs when an organism forms a mental connection or association between two distinct events occurring in temporal sequence (if event occurs and is immediately followed by event , an association forms regardless of logical reasoning).
- Observational Learning: The acquisition of behaviors, actions, or knowledge acquired by actively watching others in the environment.
- Cognitive Factors: Internal, unobservable mechanisms and mental processing involved in learning.
- Biological, Cultural, and Psychological Influences: Underlying neurological, environmental, and socio-cultural factors that shape learning trajectories.
Classical Conditioning Principles and Mechanisms
Nature of Classical Conditioning:
- A passive, involuntary, and subconscious learning process through which an initially neutral stimulus becomes associated with an innately meaningful stimulus, acquiring the capacity to elicit a similar physiological or emotional response.
- Historical discovery: First systematically demonstrated in animal research conducted by Pavlov.
Core Components of Classical Conditioning:
- Unconditioned Stimulus (): A stimulus that naturally and automatically triggers a physiological or behavioral response without any prior learning or experience (e.g., food presented to a hungry animal; touching a hot stove surface).
- Unconditioned Response (): An unlearned, involuntary, and automatic physiological reaction elicited by the unconditioned stimulus (e.g., salivation upon encountering food; pulling one's hand back immediately from a hot stove).
- Neutral Stimulus (): An environmental stimulus that, prior to conditioning, evokes no natural or relevant behavioral response (e.g., ringing a bell or sounding a neutral tone).
- Conditioned Stimulus (): A previously neutral stimulus that, after repeated pairing with an unconditioned stimulus, acquires the capacity to elicit a learned response (e.g., the sound of a bell after conditioning).
- Conditioned Response (): The learned physiological or emotional response to the conditioned stimulus that mirrors the unconditioned response (e.g., salivation triggered solely by the sound of the bell).
Three-Stage Progression of Classical Conditioning:
- Pre-Conditioning Phase:
- (Bell) No relevant behavioral response.
- (Food) (Salivation).
- Conditioning Phase (Acquisition):
- (Bell) is repeatedly presented alongside (Food) (Salivation).
- Post-Conditioning Phase:
- (Bell) (Salivation).
Critical Conditions for Acquisition:
- Contiguity: The unconditioned stimulus and neutral stimulus must occur very close together in time.
- Contingency: The conditioned stimulus must serve as a reliable, consistent predictive indicator that the unconditioned stimulus is about to follow.
Operational Dynamics of Classical Conditioning:
- Generalization: The tendency of a novel stimulus that is perceptually similar to the original conditioned stimulus to elicit a similar conditioned response (e.g., a dog salivating to a tone or ringtone similar to the conditioned bell tone).
- Discrimination: The capacity of an organism to differentiate between the conditioned stimulus and other distinct stimuli, responding exclusively to the trained stimulus (e.g., identifying and ignoring an automobile horn while attending to a specific alert tone).
- Extinction: The progressive weakening and eventual disappearance of the conditioned response when the conditioned stimulus is repeatedly presented in the complete absence of the unconditioned stimulus.
- Spontaneous Recovery: The sudden reappearance of an extinguished conditioned response after a period of rest or delay without any renewed conditioning trials.
Classical Conditioning Applications, Phenomena, and Research
Human Emotional and Fear Conditioning:
- Historic infant conditioning: Classical conditioning was demonstrated in an 11-month-old infant conditioned to fear a white laboratory rat by pairing the animal with a startling, loud noise.
- Stimulus generalization occurred when the infant subsequently displayed acute fear and anxiety toward other small, white, furry stimuli, such as a rabbit.
- Counter-Conditioning: A therapeutic or behavioral procedure designed to reverse or weaken an established conditioned response by systematically associating the conditioned stimulus with an incompatible, positive, or opposite response.
- Aversive Conditioning: Associating a target stimulus with an unpleasant, noxious, or bitter stimulus to establish avoidance behavior (e.g., pairing a bell with a bitter treat for a dog; cats fleeing at the visual sight of topical flea medication).
The Placebo Effect and Psychoneuroimmunology:
- Pharmacological conditioning mechanism:
- The physical syringe, inert pill, or clinical environment functions as the Conditioned Stimulus ().
- The active pharmacological chemical serves as the Unconditioned Stimulus ().
- Physiological symptom relief or biochemical shifts represent the Conditioned Response ().
- Scientific study on migraine headaches:
- Compared three distinct groups: (1) active prescription medication, (2) an overt placebo explicitly labeled as an inert sugar pill, and (3) no treatment.
- Patients receiving the overt placebo reported pain reduction that was as effective as the active pharmacological drug, demonstrating powerful psychological and associative conditioning.
- Immunosuppression and Enhancement: Classical conditioning can systematically alter biological functioning, producing conditioned decreases (immunosuppression) or increases in antibody production.
Taste Aversion:
- A specialized form of classical conditioning characterized by a rapid, often single-trial association between the ingestion of a specific food or flavor and subsequent nausea, gastrointestinal sickness, or vomiting.
- Survives cognitive awareness: Even if an individual knows rationally that an illness was caused by a viral influenza infection rather than an ingested cheeseburger, a strong, persistent visceral aversion toward cheeseburgers is established.
Habituation and Drug Tolerance:
- Habituation Definition: A physiological and behavioral reduction in responsiveness to a stimulus following repeated presentations over time.
- Sensory Habituation: The auditory system gradually diminishes perceived loudness when listening to a high-volume car stereo over prolonged periods.
- Pharmacological Tolerance and Overdose Dynamics:
- Frequent substance consumption in a recurring environment conditions the body to initiate anticipatory, homeostatic physiological counter-responses upon entering that setting.
- In novel environments (e.g., celebrity overdose cases involving Jim Belushi and Chris Farley in hotel rooms), the absence of familiar conditioned environmental cues prevents anticipatory physiological compensation.
- An identical chemical dosage taken in an unfamiliar location results in an unmitigated drug impact, frequently triggering physiological failure, overdose, and death.
Operant Conditioning and the Law of Effect
Definition of Operant (Instrumental) Conditioning:
- A form of associative learning in which the consequences of a voluntary, active behavior determine the probability of that behavior occurring in the future.
- Contrast with Classical Conditioning: Classical conditioning involves passive, involuntary, reflexive associations; operant conditioning involves active, goal-directed, voluntary behaviors aimed at securing outcomes.
Yale Thorndike's Law of Effect:
- Formulated by Yale Thorndike using puzzle box experiments with cats.
- Principles:
- Behaviors followed by positive, satisfying outcomes are strengthened and become more likely to recur.
- Behaviors followed by negative, adverse outcomes are weakened and become less likely to recur.
- Puzzle Box Mechanics: A hungry cat placed inside a box engages in exploratory trial-and-error behavior; accidentally depressing an internal lever opens the door to access food. Over repeated trials, the time (-axis latency) required to escape drops precipitously until the escape response becomes immediate upon confinement.
B.F. Skinner and the Operant Chamber (Skinner Box):
- Apparatus featuring automated lever-press or disc-peck mechanisms, environmental cues (e.g., green indicator lights), and controlled food-pellet delivery systems.
- Demonstrates consequence contingency: Reinforcing food pellets are delivered strictly contingent upon specific, desired behavioral outputs.
Shaping:
- The operational method of training complex target behaviors by systematically rewarding successive approximations of the desired behavioral goal until the full, complex chain of actions is mastered.
Reinforcement, Punishment, and Behavioral Modification
Reinforcement Mechanisms:
- Reinforcement Definition: Any stimulus or event following a behavior that increases the probability and frequency of that behavior occurring again.
- Positive Reinforcement: The presentation (addition) of a rewarding or desirable stimulus following a behavior, increasing future behavioral frequency.
- Example: An instructor providing verbal praise for an on-time quiz submission, leading to continued punctuality.
- Example: Applying wax to snow skis, which increases downhill glide speed, reinforcing future ski waxing.
- Example: Pressing an unfamiliar car dashboard button that plays enjoyable music, prompting the driver to press it again.
- Negative Reinforcement: The removal, reduction, or termination of an unpleasant, aversive, or annoying stimulus following a behavior, increasing future behavioral frequency.
- Example: Fastening a car seatbelt to terminate a persistent, loud warning chime.
- Example: A teacher ceasing verbal criticism once a student submits homework on time.
- Example: Waxing skis so that other skiers cease zooming past on the ski slopes.
Avoidance Learning and Learned Helplessness:
- Avoidance Learning: An organism acquires specific responses that successfully prevent or terminate exposure to an anticipated aversive stimulus.
- Learned Helplessness: An organism exposed to persistent, unavoidable, and uncontrollable negative stimuli ceases all avoidance or escape attempts, acquiring passive resignation even when escape opportunities become available (e.g., a subordinate domestic dog subjected to persistent bullying by another animal develops passive submission).
Classification of Reinforcers:
- Primary Reinforcers: Stimuli that are innately, biologically satisfying and require no prior learning to possess reinforcing power (e.g., food/sugar, water to relieve thirst, atmospheric air).
- Secondary Reinforcers: Stimuli that acquire reinforcing value strictly through learned associations with primary reinforcers (e.g., money, which possesses no intrinsic biological utility but provides access to primary goods and services).
Operant Generalization, Discrimination, and Extinction:
- Generalization: Executing an operantly conditioned, goal-directed behavior across multiple new environments or contextual settings (e.g., trained service dogs executing complex assistance protocols across diverse public locations).
- Discrimination: Responding selectively to environmental stimuli that reliably signal whether a specific behavior will or will not yield reinforcement (e.g., displaying a student identification card exclusively at retail venues exhibiting signs offering a to student discount).
- Extinction: The gradual cessation of an operant behavior following the complete removal of reinforcement (e.g., inserting currency into a broken vending machine twice without receiving goods causes an individual to terminate attempts until confirmed repaired).
Memory Systems: Encoding Processes and Attention
The Nature of Memory:
- The cognitive retention of information, skills, and experiences over time, relying upon three interrelated processes: encoding, storage, and retrieval.
- Theoretical computer analogy: Sensory intake functions like a data download (encoding), followed by retention in neural architecture (storage), and subsequent information access (retrieval).
Attentional Mechanisms in Encoding:
- Selective Attention: Focusing cognitive resources on a narrow, selected aspect of environmental stimuli while disregarding irrelevant inputs.
- Divided Attention: Concentrating concurrently on more than one distinct task or stimulus, which degrades encoding efficacy.
- Sustained Attention: Maintaining prolonged, uninterrupted cognitive focus on an identified target stimulus over an extended period.
- Executive Attention: High-level cognitive control involving strategic action planning, goal allocation, error detection, progress tracking, and managing novel or demanding conditions (impaired in conditions like ADHD).
Levels of Processing Framework:
- Shallow Processing: Minimal cognitive analysis focusing solely on physical, visual, or structural traits (e.g., basic lines, shapes, and color configurations).
- Intermediate Processing: Identifying, recognizing, and verbally labeling a stimulus (e.g., categorizing an observed object as a car).
- Deep Processing: Engaging in rich, meaningful, semantic analysis, attributing context, specifications, and related concepts to the stimulus (e.g., assessing an automobile's make, model year, mechanical features, and engine horsepower).
Encoding Optimization Strategies:
- Elaboration: Generating meaningful links and cognitive pathways connecting newly introduced data to existing knowledge networks.
- Self-Reference Effect: Enhancing memory retention by actively relating novel concepts directly to personal life experiences (e.g., relating academic content to familiar urban neighborhoods in Atlanta rather than abstract accounts of goat herding in the Himalayas).
- Dual Code Theory (Paivio): Information presented pictorially or linked to visual mental imagery is retained significantly better than abstract text because images are encoded simultaneously through two separate pathways: a visual image code and a verbal linguistic code.
Neurological and Hormonal Modulation of Encoding:
- Acute stress responses and elevated glucocorticoid hormones (cortisol) heighten evolutionary survival encoding to ensure threatening circumstances are remembered and avoided.
- Yale Neuroimaging Study on Cortisol:
- Utilized fMRI scanning on human subjects administered visually identical capsules containing either an inert placebo or active cortisol.
- Following a 1-hour absorption latency, participants evaluated neutral imagery (e.g., vacuum cleaners) paired with scenes.
- Elevating cortisol pharmacologically amplified neural encoding capacity, producing robust memory consolidation even for emotionally neutral stimuli.
Memory Storage Architecture: Sensory, Short-Term, and Working Memory
Three-Tiered Memory Storage System:
- Sensory Memory: Holds fleeting sensory impressions for fractions of a second.
- Short-Term Memory (): Retains accessible data for durations up to .
- Long-Term Memory (): Stores vast information networks extending from to an entire lifetime.
Sensory Memory Modalities:
- Iconic Memory: Fleeting visual sensory register retaining visual traces for approximately one-quarter of a second ().
- Echoic Memory: Auditory sensory register retaining precise acoustic sound traces for several seconds (e.g., retaining the fleeting song of a woodland bird after the visual sight has vanished).
- Fearling's Visual Memory Experiment: Evaluated the physiological threshold of iconic capacity by displaying 9-letter grids via tachistoscopic flashes at increasing presentation speeds to determine the exact boundaries of visual sensory retention.
Short-Term Memory () Dynamics:
- Capacity Limit (George Miller): Memory span without external assistance is limited to discrete items ( to units).
- Structural design of modern telephone numbers ( digits excluding area codes) directly aligns with this empirical capacity threshold.
- Rehearsal: Conscious verbal repetition that prevents short-term memory decay and facilitates transfer to long-term memory (mirrored by television advertising scripts repeating phone numbers continuously).
- Chunking: Reorganizing individual data units into higher-order, meaningful collections (e.g., formatting 7-digit phone numbers with hyphens or partitioning 9-digit Social Security numbers).
Baddeley's Working Memory Model:
- An active, multi-component mental workbench combining short-term storage with active attention to assemble, manipulate, and transform mental representations during problem solving (e.g., coordinating college course registration around work commitments, class meeting days, and travel times).
- Phonological Loop: Specializes in storing and processing speech-based, acoustic, and verbal inputs while utilizing echoic retention properties.
- Visuospatial Sketchpad: Stores and manipulates visual and spatial layouts completely independently from acoustic pathways.
- Central Executive: Governed by the prefrontal cortex; coordinates attention, integrates information from sensory registers and long-term stores, detects errors, and determines which data warrant long-term consolidation.
Long-Term Memory Structures and Categorization
- Taxonomy of Long-Term Memory:
- Explicit Memory (Declarative): Conscious, intentional recollection of specific factual information, autobiographical experiences, and events.
- Episodic Memory: Autobiographical records detailing personal experiences tied to specific spatial and temporal coordinates (the "when, where, and what" of personal history).
- Semantic Memory: Generalized world knowledge, factual data, and trivia devoid of personal context (e.g., knowing an elephant weighs a few tons or the architectural height of the Empire State Building).
- Implicit Memory (Nondeclarative): Unconscious behavioral execution and procedural performance influenced by prior experience without active conscious awareness.
- Procedural Memory: Motor skills, physical coordination, and automated habits (e.g., riding a bicycle), primarily orchestrated and stored within the cerebellum.
- Priming: The unconscious activation of specific associations in memory caused by recent environmental exposure, which can subsequently elicit conscious explicit episodic recalls (e.g., childhood flashbacks, laboratory fear conditioning protocols).
- Conditioned Associations: Learned classical conditioning pathways operating below conscious reflection.
Cognitive Frameworks: Schemas, Scripts, and Connectionism
Schemas:
- Preexisting mental frameworks or cognitive concepts that structure, categorize, organize, and interpret incoming information.
- Built through accumulated life experiences to facilitate inferences and rapid problem-solving (e.g., developing an optimal study schema that spaces preparation across a week rather than cramming two hours the night prior; categorical schemas identifying four-legged resting platforms as chairs; role schemas for police officers or firefighters).
Scripts:
- A specialized schema subclass dedicated to standard behavioral routines, typical sequences, physical features, and expected occurrences at specific events.
- Example: A script for a Halloween party automatically specifies expectations for costumes, festive decorations, confectionery treats, food, and social beverages.
Connectionism and Parallel Distributed Processing ():
- A neurocognitive model asserting that memories are not stored as localized, isolated units, but are distributed across interconnected neural networks operating simultaneously in parallel.
- Facilitates simultaneous cognitive processing, enabling the brain to analyze complex problems in the background while focusing conscious attention on distinct ongoing tasks.
Questions and Class Discussion
Inquiry Regarding Project Topic Modifications:
- Student Query: "Can we change the one we submitted?"
- Response: Topics are fully interchangeable. Changing activities is permitted provided it is not attempted too close to the paper's final due date (such as one week prior). If the online system does not allow a second submission, an email detailing the replacement activity at an equivalent level of detail is acceptable.
Dialogue on the Etiology of Dental Phobia:
- Instructor Prompt: "Some people don't like to go to the dentist. Why do you think they don't like to go to the dentist? Because the dentist is mean? Probably not. What do you think?"
- Student Response: "A previous experience."
- Instructor Prompt: "What does everybody generally experience in some degree at the dentist?"
- Student Response: "Pain."
- Contextual Wrap-up: Pain acts as an aversive, unconditioned stimulus that produces an involuntary avoidance response through classical associative conditioning.
Dialogue on Conditioned Environmental Triggers:
- Instructor Prompt: "You hear your doorbell go off. What do you do?"
- Student Response: "It…"
- Instructor Prompt: "What is generally the purpose of the doorbell?"
- Student Response: "To alert you."
- Instructor Prompt: "So what do you do when you hear the doorbell?"
- Student Response: "You go check who it is."
- Contextual Wrap-up: The doorbell tone has no intrinsic emotional meaning, but functions as a conditioned stimulus triggering an automated behavioral response.
Dialogue Explaining the Placebo Phenomenon:
- Instructor Prompt: "Does anybody agree with the placebo effect? Do you wanna take a hack at it or describe it?"
- Student Response: "It's like when you take a pill that just has sugar in it, and you're told that it has a different kind of medication or chemical in it. And so it still affects you as if it did have that because your brain tricks your body thinking that it's taking them."
- Contextual Wrap-up: The cognitive expectation of relief acts through associative conditioning, triggering authentic physiological symptom alleviation.
Dialogue Distinguishing Negative Reinforcement from Punishment:
- Instructor Prompt: "What would be an example of negative reinforcement?"
- Student Proposal: "If you were to take away, like, a dog's toy or treat from them… Or to take away their phone or cell phone or car."
- Clarification: Confiscating a desirable object (phone, car, toy) constitutes punishment rather than negative reinforcement. Negative reinforcement specifically requires removing an unpleasant or aversive stimulus (such as an obnoxious seatbelt warning chime) to increase the likelihood of a desired target behavior.
Dialogue Classifying Primary and Secondary Reinforcers:
- Instructor Prompt: "What would be a primary reinforcer? Something that's innately satisfying and does not take any learning on your part to make it pleasurable?"
- Student Proposals: "Sugar." (Validated as a primary nutritional reinforcer). "Water bottle / thirst." (Validated as a biological primary reinforcer). "Air." (Validated as an essential primary reinforcer). "Reading." (Evaluated as a complex learned activity, though subjectively pleasurable).
- Instructor Follow-up: "Who likes making money? Is that a primary reinforcer or a secondary reinforcer?"
- Student Response: "Secondary."
- Clarification: Currency has no intrinsic biological value; its reinforcing strength is derived entirely from its learned association with the purchasing of primary reinforcers.
Dialogue on the Purpose of Stress in Memory Formation:
- Instructor Prompt: "Why do you think stress would help you remember better?"
- Student Response: "So you don't stress yourself out again. Like… So you don't do it again."
- Contextual Wrap-up: Stress hormones tag experiences as vital, survival-linked events, ensuring negative or dangerous outcomes are vividly recalled and avoided in the future.
Dialogue on World Facts and Semantic Retrieval:
- Instructor Prompt: "How much does an elephant weigh? Does anybody know?"
- Student Estimate: "Heard about one or two tons."
- Clarification: An elephant weighs over a ton, typically a few tons. Such factual trivia illustrates explicit semantic memory stored independently of personal autobiographical experience.