Reinforcement & Motivation – Week 11 (Video 1)

Course & Lecture Context

  • Week 11 of Intro to Behavior Analysis
  • Focus of this video (first of the week):
    • Re-examine reinforcement–related concepts
    • Introduce the role of “motivation” prior to formal treatment of Motivating Operations (covered in next lecture)
    • Prepare groundwork for Jack Michael’s work on MOs

Historical Foundations: Skinner’s Concept of “Drives”

  • Skinner used the term drive to account for an organism’s inclination to obtain a particular stimulus
    • Examples: hunger → drive for food, thirst → drive for water, sleep deprivation → drive for rest
  • Key quotation (paraphrased): drive has "neither the status nor the place the reinforcing stimulus has; it is not in and of itself either eliciting, reinforcing, or discriminative" (Skinner, "Cumulative Record")
  • Drive viewed as an umbrella for:
    • Deprivation
    • Satiation
    • Aversive stimulation
  • Modern term that evolved from drive: Motivating Operation (MO) (to be detailed next lecture)

Key Vocabulary Introduced

  • Reinforcer: stimulus that increases the future frequency of a behavior when presented contingently
  • Discriminative Stimulus (SD): stimulus correlated with availability of reinforcement
  • Deprivation: lack or unavailability of a reinforcer over time
  • Satiation: recent or continuous access to a reinforcer that reduces its current value
  • Unconditioned (primary) reinforcer: biologically based (food, water, sleep, oxygen, etc.)
  • Conditioned (secondary) reinforcer: acquires value through pairing with other reinforcers (e.g., tokens, money, praise)
  • Generalized Conditioned Reinforcer: conditioned reinforcer paired with many other reinforcers (e.g., money)
  • Premack Principle (teaser for later): opportunity to engage in a high-probability behavior can function as reinforcement for a low-probability behavior

Deprivation

  • Definition: state produced when access to a reinforcer is either withheld or simply unavailable
    • Important nuance: may be accidental/environmental, not always deliberate
  • Effects:
    • Causes a transient (momentary) increase in the value of the reinforcer
    • Leads to:
    • Faster acquisition of responses historically associated with that reinforcer
    • Increased response frequency and vigor
  • Especially potent for unconditioned reinforcers critical for survival
  • Example scenarios:
    • No food available for several hours → greater motivation to seek food
    • Child who has not used an iPad all day works harder when iPad is offered as reinforcement

Satiation

  • Definition: state produced when an organism has just had or continuously has access to a reinforcer
  • Effects:
    • Produces a transient decrease in reinforcer value
    • Results in:
    • Lower response rates for behaviors previously reinforced by that stimulus
    • Possible temporary "extinction-like" drop in performance
  • Example scenarios:
    • After Thanksgiving dinner, motivation to obtain more food (e.g., an 18-pack of tacos) drastically falls
    • Child with unrestricted iPad access all day shows little interest in completing tasks for iPad time

Practical & Ethical Considerations

  • Behavior analysts do not withhold items necessary for basic welfare (e.g., food necessary for health, water, restroom access) — doing so is unethical
  • Acceptable to withhold or restrict optional or "luxury" reinforcers (e.g., Xbox, M&M’s) as part of programmed interventions

Role of Deprivation vs. Satiation in Behavior Change

  • Both are temporary motivational states; value shifts are reversible with time and altered access
  • Effective programming often cycles between:
    • Providing controlled access (to avoid satiation)
    • Minimizing uncontrolled access (to maintain mild deprivation without compromising ethics)

Preview of Upcoming Topics

  • Deep dive into learned vs. unlearned reinforcers
  • Generalized conditioned reinforcers and why they maintain value across settings
  • Detailed treatment of Premack Principle
  • Full discussion of Motivating Operations (Jack Michael) in next video

These notes cover every concept, definition, example, and ethical remark presented in the video, setting you up for the more advanced MO content that follows.