Module 20-22: Basic Learning Concepts, Operant Conditioning, and Biology/Cognition of Learning

MODULE 20 | BASIC LEARNING CONCEPTS AND CLASSICAL CONDITIONING

  • Learning: relatively enduring change in information or behavior resulting from experience. Forms include classical conditioning, operant conditioning, and cognitive learning (learning by observing or through language).

  • Key terms

    • Stimulus: event that evokes a response.
    • Respondent behavior: automatic response to a stimulus.
    • Classical conditioning: learning that associates two stimuli (or events). NS becomes CS after pairing with US; CS elicits CR.
    • Operant conditioning: learning that associates a behavior with its consequence; behavior (operant) operates on the environment to produce consequences.
    • Neutral Stimulus (NS): stimulus that elicits no response before conditioning.
    • Unconditioned Stimulus (US): naturally triggers a response.
    • Unconditioned Response (UR): unlearned response to US.
    • Conditioned Stimulus (CS): originally neutral stimulus that triggers a response after conditioning.
    • Conditioned Response (CR): learned response to CS.
    • Acquisition, extinction, spontaneous recovery, generalization, discrimination: key conditioning processes.
    • Higher-order conditioning (second-order conditioning): a CS is paired with a new NS, creating a weaker new CS.

  • Classical conditioning (CC)

    • Basic idea: learn to associate two stimuli and anticipate events.
    • Pavlov’s classic setup: US = food; UR = salivation; NS = tone; after pairing, CS = tone; CR = salivation to tone.
    • Processes:
    • Acquisition: NS precedes US by a short interval (often ~0.5 s); learning strengthens with repeated pairings.
    • Extinction: CS alone repeatedly without US weakens CR.
    • Spontaneous recovery: after a rest, the extinguished CR can reappear.
    • Generalization: similar stimuli evoke similar CRs.
    • Discrimination: learning to distinguish between a CS and similar stimuli that do not signal US.
    • Biological preparedness: conditioning is constrained by biology; some associations are learned more readily (e.g., taste aversion).
    • Taste aversion (Garcia & Koelling, 1966): organisms readily learn taste–illness associations, but not sight/sound–illness; can occur with long delays between CS and US; supports preparedness and biological constraints.
    • Cognitive influence: predictions and expectations can influence conditioning; Rescorla–Wagner framework emphasizes stimulus predictability.

  • Examples and extensions

    • Higher-order conditioning: a CS (tone) predicts US (food) and a new CS (light) paired with the tone can come to elicit the CR.
    • Observational learning and cognitive aspects: CC is foundational, but cognition and observation also shape learning.
    • Habits and learning by association: forming beneficial habits typically requires repeated associations; approx. 66 days for a behavior to become habitual (average), with ~84 days studied in some experiments.

  • Learning by observation and cognition

    • Observational learning: learning by watching others; modeling; Bandura’s Bobo doll experiments show imitation of observed aggression.
    • Mirror neurons: proposed neural basis for imitation and empathy; observed actions can activate similar brain areas as performing the action.
    • Observational learning supports prosocial vs antisocial effects depending on models and context.

  • Why CC matters

    • CC is a basic form of learning found across species; enables organisms to anticipate biological events and adapt to environments.
    • Pavlov’s work provided objective methods to study learning and laid groundwork for experimental psychology.

  • Thinking critically and applications

    • Applications span health (food/drug cravings, immune responses), therapy (conditioning-based treatments), and media influences (learning from media violence).
    • Conditioning concepts help explain everyday behaviors and inform strategies for education, therapy, and rehabilitation.

  • Quick recall anchors (LaTeX notes)

    • Core CC schema: NS + US → CS → CR, where US evokes UR and CS evokes CR. US=extUnconditionedStimulus, UR=extUnconditionedResponse, CS=extConditionedStimulus, CR=extConditionedResponseUS= ext{Unconditioned Stimulus},\, UR= ext{Unconditioned Response},\ CS= ext{Conditioned Stimulus},\ CR= ext{Conditioned Response}
    • Acquisition timing rule: NS precedes US by about 0.5 s0.5\text{ s} for robust conditioning.
    • Extinction: CS alone → CR diminishes. Spontaneous recovery: after a pause, CR may reappear.
    • Generalization vs Discrimination: similarity-based responding vs ability to distinguish CS from non-signals.
    • Taste aversion: a form of CC shaped by biological preparedness; can occur with long CS–US delays.

MODULE 21 | OPERANT CONDITIONING

  • Core idea

    • Classical conditioning learns associations between events we do not control; operant conditioning learns associations between our behavior and its consequences.
    • CC involves respondent (involuntary) behavior; OC involves operant (voluntary) behavior that operates on the environment.

  • Key figures and concepts

    • Edward L. Thorndike: Law of Effect – rewarded behavior tends to recur; punished behavior is less likely to recur.
    • B. F. Skinner: developed operant conditioning and the Skinner box (operant chamber) to study reinforcement and shaping.
    • Reinforcement vs Punishment:
    • Reinforcement: increases the likelihood of a behavior.
    • Punishment: decreases the likelihood of a behavior.

  • Types of reinforcement and reinforcers

    • Positive reinforcement: add a desirable stimulus after a response.
    • Negative reinforcement: remove an aversive stimulus after a response.
    • Primary reinforcers: biologically based (e.g., food, warmth).
    • Conditioned (secondary) reinforcers: gain value through association (e.g., money, good grades).
    • Shaping: gradually reinforcing closer and closer approximations to the desired behavior.

  • Schedule of reinforcement

    • Continuous reinforcement: reinforce every correct response; quick learning but rapid extinction when stopped.
    • Partial (intermittent) reinforcement: reinforce only some times; slower acquisition but greater resistance to extinction.
    • Fixed-ratio (FR): reinforcement after a set number of responses (e.g., buy 10 coffees, get 1 free).
    • Variable-ratio (VR): reinforcement after an unpredictable number of responses (high and steady response rate; e.g., gambling).
    • Fixed-interval (FI): reinforcement after a fixed time once a response occurs (increasing response as time nears).
    • Variable-interval (VI): reinforcement after varying time intervals (slow, steady responses).
    • Key takeaway: ratio schedules produce higher response rates than interval schedules; variable schedules yield more consistent responding.

  • Immediate vs delayed reinforcement

    • Immediate reinforcement strengthens behavior quickly; delayed reinforcement can hinder learning in animals but humans often respond to delays (e.g., paychecks, grades).
    • Delayed gratification is a marker of maturation and self-control (marshmallow test-like findings).

  • Reinforcement and punishment in everyday life

    • Positive reinforcement: reward desired behaviors (e.g., praise, attention, paychecks).
    • Negative reinforcement: remove aversive stimuli to strengthen behavior (e.g., taking aspirin to relieve headache).
    • Punishment drawbacks: can induce fear, discrimination, and aggression; may not erase the behavior but suppress it; can undermine long-term learning.
    • Practical parenting/education tips: reward specific, achievable behaviors; avoid harsh punishment; reinforce desired behaviors consistently.

  • Skinner’s broader implications

    • Operant conditioning can be applied across domains: education, sports, work, parenting, self-improvement.
    • Reinforcement should be timely and contingent on the target behavior; modeling and shaping support gradual mastery.

  • Quick recall anchors (LaTeX notes)

    • Reinforcement vs Punishment: Reinforcement increases behavior; Punishment decreases behavior. ext{Reinforcement}
      ightarrow ext{increase}, ext{Punishment}
      ightarrow ext{decrease}
    • Schedules: FR, VR, FI, VI with their characteristic response patterns.
    • Immediate vs Delayed reinforcement: timing influences learning efficacy.

MODULE 22 | BIOLOGY, COGNITION, AND LEARNING

  • Integrated view of learning

    • Learning results from interactions among biology, cognition, and sociocultural factors (biopsychosocial model).
    • Biological influences constrain conditioning; cognitive processes influence expectancy and planning; social/cultural context shapes learning and motivation.

  • Biological constraints on conditioning

    • Preparedness: species are predisposed to learn certain associations that aid survival (e.g., taste aversion for toxins in food).
    • Instinctive drift: animals revert to natural behaviors, even after shaping; conditioning is limited by biology.
    • Taste aversion (Garcia & Koelling): rats developed aversions to tastes paired with illness but not to sights/sounds; can occur with long CS–US delays; supports adaptive value of certain CC links.

  • Cognitive influences on conditioning

    • Rescorla–Wagner/Rescorla model: learning depends on the predictability of the US; organisms form expectations about whether CS signals US.
    • Latent learning and cognitive maps: animals can learn without reinforcement and reveal knowledge when incentive arises (Tolman & Honzik, 1930).
    • Observational learning and cognition: expectation, beliefs, and awareness influence learning; probability and prediction affect learning strength.
    • Intrinsic vs extrinsic motivation: overjustification can reduce intrinsic motivation when rewards are used inappropriately; rewards can enhance or undermine motivation depending on how they are used.

  • Observational learning and modeling

    • Observational learning: learning by watching others and imitating; Bandura’s Bobo doll experiments show imitation of observed aggression.
    • Modeling and prosocial/antisocial effects: prosocial modeling can promote helping behaviors; antisocial modeling can promote aggression and negative behaviors.
    • Mirror neurons: neural basis for imitation and empathy; brain activity mirrors observed actions, supporting imitation and social learning.

  • Applications and ongoing debates

    • Violence viewing effects: correlational and experimental evidence show viewing violence can influence aggression and attitudes; causation is complex and moderated by context.
    • Observational learning in real-world settings: parents, teachers, media, and peers serve as models shaping behavior, attitudes, and norms.
    • Cognitive perspective: emphasize that cognition (expectancies, interpretations) interacts with conditioning; effective therapies and education consider cognitive factors.

  • Quick recall anchors (LaTeX notes)

    • Latent learning: learning that is not immediately expressed but evidenced later when incentive is provided.
    • Cognitive map: mental representation of an environment (e.g., a maze) guiding later navigation.
    • Observational learning: learning via modeling; vicarious reinforcement/punishment influences expectations about consequences.
    • Mirror neurons: neurons that fire both when performing an action and when observing another perform it; support imitation and empathy.

  • Violence viewing and media

    • Prolonged exposure to media violence can increase aggression or desensitize viewers; effects are strongest under certain conditions (attractive aggressor, justification, realism, lack of pain shown).

  • Review prompts (for quick self-test)

    • Distinguish classical and operant conditioning in terms of what is learned and the role of the learner.
    • Define acquisition, extinction, spontaneous recovery, generalization, and discrimination in CC; relate to OC schedules.
    • Explain preparedness and instinctive drift with examples.
    • Describe Bandura’s observational learning and the role of modeling and mirror neurons.
    • Discuss intrinsic vs extrinsic motivation and potential effects of rewards on intrinsic motivation.