Module 3 – Learning & Social-Cognitive (Behaviorist) Perspective: B. F. Skinner

Skinner: Historical Context and Biography

  • Burrhus Frederic Skinner ( 1904{-}1990 ) grew up in Susquehanna, Pennsylvania in a warm, orderly home.

  • Initially studied English at Hamilton College; after an unproductive attempt at becoming a novelist, shifted to psychology at Harvard.

  • Academic Posts: University of Minnesota, Indiana University (as chair), and permanent return to Harvard.

  • Key Publications: The Behavior of Organisms ( 1938 ), Walden Two ( 1948 ), Science and Human Behavior ( 1953 ), Beyond Freedom and Dignity ( 1971 ).

  • Remained productive until his death, finishing his last paper one day before he passed away.

Learning and the Behaviorist Perspective

  • Learning = “relatively permanent change in behavior produced by systematic interaction with environment.”

  • Behaviorism restricts analysis to observable, measurable responses; internal mental states are excluded as scientific causes.

Scientific Analysis of Behavior

  • Science seeks lawful relations among facts, not opinion.

  • Complete behavioral analysis specifies:

    1. Antecedents (environmental events preceding behavior)

    2. Behavior (observable act)

    3. Consequences (events produced by the act)

    4. Genetic endowment & behavioral history are also noted.

  • Research strategy: isolate components of complex acts, test them in controlled experiments, replicate independently.

  • Contrast with Freud: Skinner rejects unconscious motives; only external contingencies count.

Skinner’s Conception of “Personality”

  • No hidden inner self – only a repertoire of response patterns.

  • Situational specificity: different environments evoke different learned patterns.

  • Rejection of “mentalistic” states; these merely name, not explain, behavior.

  • Buddhist parallel: impermanent, non-essential self; yet causes differ (Buddhism = karma/awareness; Skinner = reinforcement histories).

Explanatory Fictions (EF)

Skinner’s label for internal, unmeasurable “causes” that block real analysis.

EF

Essence

Why It Misleads

Emblematic Example

Freedom

Belief in uncaused choice

Masks covert control

“Voter freely chooses candidate” while propaganda shapes preference

Autonomous Man

Inner agent initiating acts

Denies conditioning & genetics

Claim that success arose solely from personal will

Dignity

Credit / praise for acts

Omits unknown contingencies

Praising charity before discovering tax motive

Creativity

Mysterious source of novelty

Hides complex reinforcement history

Poet “inspired” out of nothing

Will

Inner faculty powering action

Treats cause as supernatural

“She had will-power to diet”

Self

Stable internal core

Reifies summary label

“That’s just who he is”

Detailed illustrations:

  • Milton Erickson ( 1939 ) – subjects obeyed post-hypnotic cue yet insisted they were free.

  • Cross-species studies ( 1956 ) showed rats, pigeons, monkeys, and children learn identically → autonomy disproved.

  • Butler quip: “A poet writes a poem as a hen lays an egg.”

  • Later data (Lefcourt; Davison & Valins) demonstrate that belief in control can sustain motivation even if philosophically illusory.

Types of Conditioning & Reinforcement

Respondent (Classical) Conditioning

  • Reflexive responses elicited by antecedent stimuli.

  • Pavlov’s dogs: bell + food → bell elicits salivation.

  • Modern uses: advertising pairs attractive images with products.

Operant Conditioning

  • Voluntary actions shaped by their consequences.

  • Skinner’s staged swimming example: successive candy rewards for wetting face → dipping head → blowing bubbles.

  • Operant ≠ respondent: controlled by consequences, not antecedents.

Skinner Box Paradigm
  • Lever press by hungry rat → food pellet (positive reinforcement) → response frequency rises.

  • Withholding pellets → extinction.

  • Demonstrates prediction & control via contingent reinforcement.

Key Empirical Findings

  1. Conditioning without awareness (Ames room illusion, 1951 ): perception shaped culturally; non-Western observers did not see illusion.

  2. Persistence despite awareness (Lindley & Moyer, 1961 ): subjects still lifted finger to tone formerly paired with shock even after told shock disabled.

  3. Resistance impairs learning (Hilts, 1973 ): alcoholics counter-conditioned to vomit overcame aversion through peer support.

Nature of Reinforcers

  • Positive: add pleasant stimulus (praise, candy).

  • Negative: remove aversive stimulus (pain, noise).

  • Primary: innate (food, water, air).

  • Secondary: learned via association (money, grades, tokens).

    • Example: chimps exchange brass tokens for bananas.

Schedules of Reinforcement

Schedule

Rule

Typical Performance

Everyday Analogy

Fixed Interval (FI)

Reinforce first response after set time

Scalloped pause–run

Cramming before exams

Variable Interval (VI)

Time interval varies unpredictably

Moderate steady rate

Checking email/social media

Fixed Ratio (FR)

Reinforce after fixed # responses

High burst then pause

Collect 5 tokens to open a door in game

Variable Ratio (VR)

After unpredictable # responses

Very high, steady

Slot machine gambling

  • Ferster & Skinner ( 1957 ): partial schedules produce more persistent behavior than continuous reinforcement.

Behavioral Control & Cultural Engineering

  • Goal: design environments so that desirable behavior is reinforced and sustained.

  • Quote ( 1955 ): “Are we to be controlled by accident, by tyrants, or by ourselves…?”

  • Extinction = removal of reinforcer → decline of behavior (rat stops lever-pressing when pellets stop).

Conditions That Foster or Impede Personal Growth

  1. Growth = maximizing beneficial environmental control, minimizing harmful consequences.

  2. Barrier: Ignorance of true contingencies (e.g., pigeon turning experiment; students invoked “hope” & “feel” explanations).

  3. Functional Analysis: describe search for glasses via overt acts, not “states of mind.”

  4. Ineffectiveness of Punishment:

    • Suppresses rather than teaches.

    • Produces fear, avoidance, aggression.

    • Example: marking only errors on exams teaches nothing.

  5. Punishment Reinforces the Punisher: parent’s nagging stops when child cleans – nagging strengthened.

  6. Preferred method: positive reinforcement of alternative behavior; punish only to prevent severe harm.

Successive Approximation (Shaping)

  • Reinforce incremental steps toward remote, low-probability act.

  • Pigeon trained to peck dot in < 3 minutes: turn → step → head thrust → peck.

  • Language acquisition: babble → word fragments → full words, reinforced by parental attention.

Superstitious Behavior & Self-Control

  • Superstition = accidental pairing of response with reward (player sleeps near bathroom → wins once → repeats ritual; 74\% of MLB players report such habits).

  • Cultural difference: U.S. pros more superstitious than Japanese.

Techniques of Self-Management

  1. Stimulus Avoidance – study in quiet library.

  2. Self-Satiation – chain-smoke until disgust.

  3. Aversive Stimulation – public commitment to weight loss.

  4. Self-Reinforcement – buy new clothes after meeting study quota.

Applied Operant Programs

Token Economies

  • Ayllon & Azrin ( 1968 ): psychotic female patients earned tokens for hygiene, work, dress → exchanged for candy, cigarettes, privileges. Outcomes: cleaner, sociable, responsible; effects faded without external contingencies post-discharge.

  • Dallery et al. ( 2007 ): smokers uploaded CO readings; vouchers online – significant smoking reduction.

Behavior Modification in Industry & Schools

  • Targets absenteeism, safety, productivity.

  • Reinforcers: bonuses, promotions, reserved parking, public praise.

  • Example: factory bonus for perfect attendance raised output & reduced sick days.

Punishment vs Reinforcement

  • Punishment yields escape, aggression, learned helplessness; thrives in prisons & schools but escalates problems.

  • Negative reinforcement (e.g., partner stops nagging when one refrains from smoking) can work but is less reliable and may entail harmful aversives.

Assessment Methods in Skinnerian Tradition

  1. Functional Analysis – document frequency, antecedents, consequences (smoker logs cigarettes, contexts, rewards).

  2. Direct Observation – multiple observers chart child behaviors; identify inadvertent parental reinforcement; treatment: ignore kicking, praise compliance.

  3. Self-Report – interviews & questionnaires for covert acts (e.g., phobia ratings).

  4. Physiological Measures – heart rate, EMG, EEG to uncover concealed reactions (rise during elevator questions despite verbal denial).

Evaluation of the Theory

Aspect

Strengths

Criticisms

Illustrative Data

Animal Research Base

Clear, replicable lab laws; cross-species parallels

Human complexity underplayed

Rat & pigeon findings applied to classrooms

Environmental Focus

Objective, observable methods

Neglects feelings, thoughts, free will

ADHD children improve with immediate reinforcement (Luman et al., 2005 )

View of Personality

Avoids vague constructs

Skims over individual differences, emotional depth

No projective tests; relies on overt counts

Creativity & Complexity

Shows incremental shaping of novel acts

Critics doubt full capture of artistry

Reinforcement schedules raised creativity (Eisenberger, 1998 ; Epstein, 1991 )

Practical Impact

Highly effective in education, therapy, organizations

Effects may extinguish outside controlled settings

Token economies, CBT, animal training

Scientific Influence

Ranked #1 psychologist of 20^{th} century; founded behavior modification

Viewed as reductionist, mechanistic

Entire issue of Behavioral & Brain Sciences ( 1984 ) debating Skinner

Consolidated Strengths vs Limitations

Scientific Rigor: objective measurement, replicability ⟶ yet over-relies on non-human data, ignores cognition.
Real-World Application: wide success in clinics, schools, prisons ⟶ behaviors revert without ongoing reinforcement; generalization issues.
Predictability: lawful reinforcement schedules ⟶ underestimates agency, intrinsic motivation, uniqueness.
Legacy: foundation of CBT, educational technology, animal training ⟶ deemed determinist by humanistic & psychodynamic camps.