Conditioned & Generalized Reinforcers, Token Systems, and the Premack Principle

Review of Conditioned Reinforcers

  • Recap from previous lecture
    • Money was introduced as a conditioned reinforcer (CR) that rarely receives direct pairing with every primary reinforcer it can purchase.
    • Verbal behavior allows humans to learn that money will exchange for other reinforcers even when direct pairing is absent.
  • Currency-specific extinction example
    • Serbian dinars at a U.S. coffee shop lose reinforcing power → no coffee (primary reinforcer) → extinction of the dinar–coffee relation.
    • Demonstrates that conditioned reinforcement is context- and community-specific.

Ethical Reflection on Historical Token Economies

  • Textbook case: in-patient facility where residents paid tokens for access to:
    • Quality sleeping quarters
    • Privacy / safe storage for belongings
  • Instructor’s critique
    • Withholding basic needs (secure sleep, safety) is aversive and ethically questionable.
    • Distinction proposed: some resources should be contingent on tokens (e.g., extra privileges); some should never be (basic human rights).
  • Rationale for textbook choice
    • Older edition chosen for affordability, not full endorsement of its practices or author.

Learned (Conditioned) Reinforcers

  • Definition: A neutral stimulus becomes a reinforcer after pairing with an established reinforcer.
  • Illustrative chain (heating-pad example)
    • Neutral stimulus: heating pad → paired with relief from pain (unlearned negative reinforcer).
    • Heating pad becomes a CR; may be used even on pain-free days (positive reinforcement via warmth).
    • Additional pairing: significant other brings tea whenever pad is present.
    • Tea itself may be neutral → now paired with relief + warmth + attention → tea becomes another CR.
    • Network metaphor: relations spread like a spider web, not a simple linear chain.

Generalized Conditioned Reinforcers (GCRs)

  • Definition: Conditioned reinforcers paired with multiple backup reinforcers over time.
  • Classic example: money → exchanges for food, shelter, clothing, leisure, etc.
  • Skinner’s 5 GCR classes
    1. Attention
    2. Affection
    3. Submission/Compliance of others
    4. Approval
    5. Tokens (incl. money)
  • Conceptual point: items/experiences hold power because of the many reinforcers they predict or permit access to.

Token Systems in Daily Life

  • Schools: sticker charts, point boards, prize boxes.
  • Workplace/Insurance: wellness points → premium discounts.
  • Economy-wide: national currency (federally guaranteed token system).
  • Book’s clinical example revisited: tokens traded for secure storage, private space, social interaction.

Attention as a GCR

  • Common developmental history: caregiver attention delivered while obtaining
    • Food
    • Physical comfort/contact
    • Safety
    • Conversation & social interaction
  • Result: human attention acquires high reinforcing value across contexts.

Premack Principle (“Grandma’s Law”)

  • Formal statement: If activity A occurs more frequently (is more preferred) than activity B, then making access to A contingent on completing B will increase the occurrence of B.
  • Equation form: B \rightarrow A (First B, then A) → ↑B frequency.
  • Everyday analogies
    • "Eat your vegetables before dessert".
    • Pink Floyd lyric: "If you don’t eat your meat, you can’t have any pudding."
  • Implementation tips
    • State contingency before behavior begins ("first-then" wording).
    • Use to prevent rather than respond to challenging behavior.
    • Examples in education:
    • “First complete the hallway walk, then you can talk with the teacher.”
    • Non-preferred worksheet followed by computer time.

Connections & Broader Implications

  • Links to previous topics
    • Echoes earlier discussion on pairing & extinction; Premack complements conditioned reinforcement by using activities instead of stimuli.
  • Real-world relevance
    • Money’s failure abroad shows importance of community agreement in maintaining reinforcing value.
    • Token misuse (clinical facility) raises ethical guidelines for behavior analysts: do not commodify basic human rights.
  • Philosophical note
    • Labeling attention/affection as "reinforcers" does not devalue them; rather, it highlights their motivational role in human behavior experiments.

Quick Reference Formulas & Numbers

  • 5 generalized conditioned reinforcers (Skinner).
  • Premack contingency symbolized: B \rightarrow A (low-probability → high-probability).

Study Prompts

  • Can you trace multiple reinforcing paths (spider-web style) from a single neutral stimulus you encountered this week?
  • Identify one ethical line you would never cross when designing a token economy.
  • Draft a “first-then” statement using Premack for a classroom or workplace scenario.