Comprehensive Study Guide: Principles of Reinforcement and Schedules

Fundamentals of Reinforcement and the Three-Term Contingency

• Definition of Reinforcement:

  • Reinforcement is a fundamental behavioral process in which a behavior is immediately followed by a specific consequence.
  • As a direct result of this consequence, the future frequency of that behavior is strengthened, making it more likely to occur again under similar conditions.
  • Reinforcement consists of two essential components:
  1. It is an ongoing behavioral process.
  2. It produces a specific strengthening effect on behavior over time.
  • Example: A teenager completes household chores, and his parents give him an allowance for completion. If the behavior of completing chores continues or increases in the future, reinforcement has occurred.

• The Three-Term Contingency Framework:

  • Operant behavior is governed by antecedents and consequences. Consequences specifically act to either strengthen or weaken behavior.
  • The three-term contingency formula is represented as:     $A \rightarrow B \rightarrow C$
  • Components of the contingency:
  • $A$ (Antecedent): An environmental event, stimulus, or condition that occurs immediately before a response or behavior.
  • $B$ (Behavior / Response): The observable and measurable action performed by the individual.
  • $C$ (Consequence): The stimulus change or event that immediately follows the behavior.
  • In the process of reinforcement, the focus is primarily on the relationship between the behavior ($B$) and the consequence ($C$).

• Illustrative Examples of Reinforcement:

  • Dog Whining: A dog whines ($B$), and its owner fills its bowl with food ($C$). If the consequence causes the future frequency of whining or barking to increase, reinforcement has taken place.
  • Guitar Playing: Bill plays his guitar ($B$), and the audience claps and cheers ($C$). If Bill plays his guitar again in the future, guitar playing has been strengthened through reinforcement.
  • Child Crying: A child cries ($B$), and her father hands her a doll ($C$). If crying increases in future instances, the process of reinforcement has occurred.

Primary Classifications: Positive and Negative Reinforcement

• Core Mechanics:

  • Both positive and negative reinforcement always result in the strengthening of behavior.
  • The distinction between positive and negative reinforcement relies strictly on whether a stimulus is added or removed following the behavior.

• Positive Reinforcement:

  • Definition: A process where a behavior is immediately followed by the addition or presentation of a stimulus, resulting in the strengthening of that behavior in the future.
  • Mechanism: Addition of a pleasant or appetizing stimulus.
  • Example 1 (Child and Doll): A child cries ($B$) and her father presents a doll ($C$). The addition of the doll strengthens future crying behavior.
  • Example 2 (Teacher Praise): A student completes her worksheet quickly ($B$). The teacher provides verbal praise ($C$): "Nice job working so quickly." If the student works quickly in the future, positive reinforcement has occurred.

• Negative Reinforcement:

  • Definition: A process where a behavior is immediately followed by the removal, termination, reduction, or postponement of a stimulus, resulting in the strengthening of that behavior in the future.
  • Mechanism: Removal or avoidance of an unpleasant or aversive stimulus.
  • Critical Distinction: Negative reinforcement is not punishment.
  • Negative reinforcement strengthens behavior through stimulus removal.
  • Punishment weakens behavior.
  • Example 1 (Car Radio Volume): A person starts a car and the radio volume is startlingly loud. The person turns the volume knob ($B$), causing the loud music to stop ($C$). The removal of the loud noise strengthens future knob-turning behavior when loud music plays.
  • Example 2 (Cold Air and Window): Cold air blows through an open window, causing a person to shiver. The person shuts the window ($B$), stopping the cold air and shivering ($C$). The removal of the unpleasant cold air strengthens future window-closing behavior.

• Comparison Summary:

  • Positive Reinforcement = Addition ($+\text{stimulus}$) of a pleasant stimulus $\rightarrow$ Behavior Strengthened.
  • Negative Reinforcement = Removal ($-\text{stimulus}$) of an unpleasant stimulus $\rightarrow$ Behavior Strengthened.
  • The definitive test to distinguish positive vs. negative reinforcement is empirical observation of the specific effect on future behavior.

Extinction and the Extinction Burst

• Definition and Mechanics of Extinction:

  • Extinction is a procedure in which a reinforcer is no longer provided contingent upon a specific response.
  • Responses that were previously reinforced no longer produce reinforcement, causing the response frequency to diminish or decrease over time.
  • Contrast with Reinforcement: Reinforcement increases specific responses; extinction decreases responses over time.

• Application Examples:

  • Skill Maintenance Example: A child receives a piece of candy every time he greets his teacher. When candy is permanently withheld for greetings, the greeting response decreases over time and eventually ceases.
  • Challenging Behavior Example: A father picks up his child every time the child pulls his own hair. If being picked up functions as a reinforcer, hair pulling persists. If the father completely stops picking up the child contingent on hair pulling, hair pulling will decrease over time due to extinction.

• The Extinction Burst:

  • When reinforcement is withheld, behavior often temporarily increases in frequency, duration, or intensity before it begins to decline. This phenomenon is termed an extinction burst.
  • Example: When the father stops picking up the child for pulling hair, the child may temporarily increase the frequency of hair pulling in an effort to obtain the reinforcer before the behavior ultimately extinguishes.

Classifications of Reinforcers and Token Systems

• Unconditioned (Primary) Reinforcers:

  • Defined by Cooper, Heron, and Heward as stimuli that function as reinforcers without any prior learning history or conditioning.
  • These stimuli are biologically significant and necessary for survival or physiological functioning.
  • Examples: Food, water, warmth, and sexual stimulation.

• Conditioned (Secondary) Reinforcers:

  • Defined by Cooper, Heron, and Heward as neutral stimuli that acquire reinforcing properties by being paired with primary reinforcers or other secondary reinforcers.
  • Categories and Examples:
  • Tangibles: Toys and physical items.
  • Activity-Oriented Events: Playing a board game or participating in a recreation activity.
  • Social Reinforcers: Verbal praise, social interaction, and talking with peers.
  • Generalized Reinforcers: Money or tokens that can be exchanged for multiple types of reinforcers.

• Token Reinforcement Systems and Backup Reinforcers:

  • Token Economy Definition: A system using symbolic tokens or markers that are earned for demonstrating target behaviors and can later be exchanged for backup reinforcers.
  • Backup Reinforcer: A primary or secondary reinforcer selected by the client that gives value to the token.
  • Token Characteristics: Tokens have no intrinsic value to the client; they function as positive reinforcers because they represent progress toward obtaining the backup reinforcer.
  • Benefits of Token Systems:
  1. Delays reinforcement by increasing the time window between target behavior occurrence and backup reinforcer delivery.
  2. Allows delivery of reinforcement without interrupting instructional flow.
  3. Reduces susceptibility to satiation.
  • Token Boards: Visual boards where tokens are placed as target behaviors are completed. Once full, the specified backup reinforcer is awarded.

• Instructional Exchange Example: Token Economy Delivery:

  • Instructor: "Make a choice. Say juice."
  • Client: "Juice."
  • Instructor: "Good. You got your first token. Stand up."
  • Client: (Stands up)
  • Instructor: "Good job, Stan. You get another token. Show me jumping."
  • Client: (Jumps)
  • Instructor: "Good job. You jumped, and you got another token. Sit down. Nice job. You get all your tokens, and you get your shoes."

Seven Critical Factors Influencing Reinforcement Effectiveness

• 1. Immediacy:

  • Refers to the temporal proximity between the occurrence of the behavior and the delivery of the consequence.
  • Long Delay: Significantly lowers the probability that the target behavior will be strengthened.
  • Example: A dolphin trainer attempts to teach ring retrieval using hand signals but waits $30\text{ minutes}$ after retrieval to deliver fish. Ring retrieval will not be strengthened.
  • Short Delay (Immediate): High probability of strengthening the behavior.
  • Example: Trainer delivers fish immediately after ring retrieval. Ring retrieval is strengthened.

• 2. Contingency:

  • Refers to a consistent rule regarding when a behavior will and will not produce reinforcement ($C$ occurs only when $B$ occurs, and never in the absence of $B$).
  • Rule: Reinforce only desirable target behaviors; do not reinforce undesirable or incorrect responses.
  • Example: Parents praising a child every time plates are brought to the sink, but withholding praise when plates are left on the dinner table.

• 3. Quality:

  • Refers to the individual's relative preference for a given reinforcing stimulus.
  • Example: A child likes ice cream generally, but prefers chocolate over vanilla. The child is far more likely to finish eating dinner vegetables for chocolate ice cream than for vanilla ice cream.

• 4. Magnitude:

  • Refers to the absolute size, amount, or duration of the reinforcer provided.
  • Example: A child is less inclined to finish vegetables for $5\text{ minutes}$ of television access, but finishes them readily for $15\text{ minutes}$ of television access.

• 5. Response Effort:

  • Refers to the physical or cognitive exertion required to engage in the target response to gain reinforcement.
  • If response effort is set too high, the client may fail to engage in the behavior.
  • Personal Example: An exhausted person after work chooses a restaurant $5\text{ minutes}$ walk away over one requiring a $20\text{ minute}$ subway ride plus a $10\text{ minute}$ walk due to lower effort requirements.
  • Clinical Example: Expecting a child with social delays to perform $5$ social responses before getting $2\text{ minutes}$ of iPad access may be too effortful, leading him to play alone. Reducing the requirement to $1$ simple social response allows successful performance and reinforcement access.

• 6. History of Reinforcement:

  • Individualized preferences based on past learning history dictate what functions as an effective reinforcer for a given person.
  • Examples: Salty snacks or social interactions function as reinforcers for some individuals, but may be neutral or aversive to others.

• 7. Motivating Operations (MO):

  • Environmental events or conditions that temporarily alter the effectiveness of a reinforcer and the frequency of behavior that produces it.
  • Satiation: Occurs when an individual has had recent or repeated access to a reinforcer, temporarily diminishing its value and effectiveness.
  • Example: Having just eaten a large meal reduces the reinforcing value of food, making food-seeking behaviors like grocery shopping unlikely.
  • Deprivation: Occurs when an individual has not experienced or accessed a reinforcer for a prolonged period, temporarily increasing its value and effectiveness.
  • Example: Going without food all day increases the value of food, driving behavior like grocery shopping.

Schedules of Reinforcement: Continuum and Intermittent Types

• Definition of Reinforcement Schedules:

  • A rule specifying which exact occurrences of a given behavior, if any, will produce reinforcement.

• The Reinforcement Continuum:

  • Extinction ($0\%$ Reinforcement): No occurrences of the behavior are reinforced.
  • Intermittent / Partial Reinforcement: Some, but not all, occurrences of the behavior are reinforced.
  • Continuous Reinforcement (CRF / $100\%$ Reinforcement): Every single occurrence of the behavior is reinforced. Used primarily when acquisition-stage teaching of new skills occurs.

• Instructional Exchange Example: Skill Acquisition (CRF):

  • Instructor: "What's this?"
  • Learner: "Circum."
  • Instructor: "Circum. Yay. For you, smarty."
  • Instructor: "What's this?"
  • Learner: "Sackle."
  • Instructor: "Sackle. Oh, yay for you. Excellent."

• Instructional Exchange Example: Schedule Thinning (Intermittent):

  • Instructor: "This?"
  • Learner: "Shop card."
  • Instructor: "You're right. What's this?"
  • Learner: "So we'll be smart."
  • Instructor: "What's this?"
  • Learner: "Suckle."
  • Instructor: "Suckle. Yay for you. Excellent. Cool."

• Ratio Schedules (Response-Based):

  • Reinforcement is dependent upon the completion of a specific number of responses.
  • Fixed Ratio (FR): Reinforcement occurs after a constant, fixed number of responses.
  • Notation: $FR\,X$ where $X$ is the required response count.
  • Example: Tom translates documents and earns $120\text{ dollars}$ for every $6\text{ pages}$ typed ($FR\,6$ schedule).
  • Variable Ratio (VR): Reinforcement occurs after an average, unpredictable number of responses.
  • Notation: $VR\,X$ where $X$ is the average response count.
  • Example: Jane turns a car key in a worn ignition. The car starts after $5\text{ turns}$, $2\text{ turns}$, or $1\text{ turn}$, averaging $3\text{ turns}$ ($VR\,3$ schedule).

• Interval Schedules (Time-Based):

  • Reinforcement requires the passage of a specified time interval before a response can be reinforced.
  • Crucial Rule: Reinforcement is never automatically delivered simply because the interval ends; it is delivered for the first response that occurs immediately following interval expiration.
  • Fixed Interval (FI): Reinforcement is delivered for the first response following a fixed, constant duration of time.
  • Notation: $FI\,X$ where $X$ is the fixed time duration.
  • Example: Stringing beads program with a $20\text{-second}$ interval. The first bead strung after $20\text{ seconds}$ elapse earns a token on a token board ($FI\,20\text{-second}$ schedule).
  • Variable Interval (VI): Reinforcement is delivered for the first response following a variable duration of time that averages out to a set target.
  • Notation: $VI\,X$ where $X$ is the average time duration.
  • Example: Mary completes math problems while a teacher walks around giving reward stickers. The teacher arrives at Mary's desk at varying times (sometimes $>4\text{ minutes}$, sometimes $<4\text{ minutes}$), averaging $4\text{ minutes}$ ($VI\,4\text{-minute}$ schedule).

Schedule Thinning Procedures and Clinical Applications

• Rationale for Schedule Thinning:

  1. Natural environment contingencies rarely reinforce behaviors on continuous schedules.
  2. Intermittent schedules establish behaviors that are significantly more resistant to extinction.

• Thinning Ratio Schedules:

  • Gradually increase the required response count in small increments.
  • Example: Transitioning a client learning to say "hi" from reinforcing every response ($FR\,1$) to reinforcing approximately every 3 responses ($VR\,3$).
  • Warning: Increasing response requirements too rapidly causes ratio strain or learner fatigue, causing the learner to stop responding.

• Thinning Interval Schedules:

  • Gradually lengthen the required time interval before reinforcement becomes available in small increments.
  • Example: Transitioning a client in sustained toy play from reinforcement every minute ($FI\,1\text{-minute}$) to reinforcement approximately every 2 minutes ($VI\,2\text{-minute}$).
  • Warning: Lengthening intervals too rapidly leads to abrupt drop-off in response maintenance.