Behavioral Principles, Operant Conditioning, and Stimulus Control: Comprehensive Study Guide

System for Analyzing Behavioral Consequences

To accurately classify behavioral procedures and processes, follow a systematic 5-step decision framework based on observed behavioral changes and environmental manipulations.

Behavioral Consequence Analysis Flowchart

Step 1: Identify the Behavior
Determine the precise target operant behavior being evaluated.
Step 2: Identify the Consequence
Determine what environmental event immediately follows the target behavior.
Step 3: Evaluate Future Probability/Frequency of Behavior
- If the future probability or rate of the behavior increases, the process is Reinforcement.
- If the future probability or rate of the behavior decreases, proceed to Step 4.
Step 4: Assess Reinforcer Discontinuation
Was the consequence a discontinuation of a previous reinforcer that maintained the behavior?
- If Yes, the principle is Extinction.
- If No, proceed to Step 5.
Step 5: Determine Stimulus Manipulation Type
Was the consequence an addition or removal of a stimulus?
- If Addition (presentation of a stimulus), the principle is Positive Punishment.
- If Removal (withdrawal of a stimulus), the principle is Negative Punishment.
Critical Evaluation Rule: Never categorize a consequence based on whether it sounds subjective, pleasant, or unpleasant. Categorization depends strictly on two objective factors:
1. What structural change occurred in the environment (stimulus addition, stimulus removal, or withholding of a maintaining reinforcer).
2. The resulting change in the future frequency or probability of the behavior.

Reinforcement and Factors Affecting Reinforcer Effectiveness

Reinforcement Definition: A process in which a consequence immediately following a behavior increases or maintains the future frequency, rate, or probability of that behavior.
Five Factors Influencing Reinforcer Effectiveness:
1. Immediacy: The time elapsed between the occurrence of the behavior and the delivery of the consequence. Immediate consequences exert stronger control over behavior than delayed consequences.
2. Contingency: The consistency with which the reinforcer is delivered relative to the target behavior (i.e., the degree to which the reinforcer occurs if and only if the behavior occurs).
3. Magnitude / Size: The quantity or intensity of the reinforcing stimulus delivered relative to the effort required for the behavior.
4. Individual Differences / Preference: Biological and experiential differences that cause specific stimuli to function as effective reinforcers for one individual but not for another.
5. Motivating Operations (MOs): Environmental conditions that alter the momentary value of a reinforcer.
Motivating Operations (MOs): Environmental variables that alter the effectiveness of a reinforcing stimulus and alter the momentary frequency of behaviors that have previously produced that stimulus.
- Establishing Operation (EO): An MO that increases the current effectiveness of a reinforcer. For example, deprivation of food functions as an EO that increases the value of food as a reinforcer.
- Abolishing Operation (AO): An MO that decreases the current effectiveness of a reinforcer. For example, satiation on food functions as an AO that decreases the value of food as a reinforcer.

Schedules of Reinforcement

Schedules of reinforcement dictate the precise rules for delivering reinforcement based on response count or time intervals.

Fixed Ratio (FR):
- Definition: Reinforcement is delivered after a specified, non-varying number of correct responses.
- Distinction: Ratio schedule (based on count of responses) with a fixed criterion.
Variable Ratio (VR):
- Definition: Reinforcement is delivered after a variable number of correct responses, fluctuating around a specified average.
- Distinction: Ratio schedule (based on count of responses) with a variable criterion.
Fixed Interval (FI):
- Definition: Reinforcement is delivered for the first correct response that occurs after a fixed, predetermined amount of time has elapsed.
- Distinction: Interval schedule (based on passage of time prior to a response) with a fixed criterion.
Variable Interval (VI):
- Definition: Reinforcement is delivered for the first correct response that occurs after a variable amount of time has elapsed, fluctuating around a specified average.
- Distinction: Interval schedule (based on passage of time prior to a response) with a variable criterion.
Key Classification Axis:
- Ratio vs. Interval: Ratio schedules require a specific number of responses to produce reinforcement; interval schedules require the elapse of a specific time duration followed by a response.
- Fixed vs. Variable: Fixed criteria remain constant across trials; variable criteria change unpredictably across trials around an average.

Extinction Principles and Characteristics

Extinction Definition: A behavioral procedure in which a consequence that previously maintained a behavior is no longer delivered, resulting in a gradual reduction in the future frequency, probability, or rate of that behavior.
Implementation by Reinforcement Type:
- Positive Reinforcement Extinction: The positive reinforcer that previously followed the target behavior is withheld every time the behavior occurs.
- Negative Reinforcement Extinction (Escape Extinction): The escape or avoidance of an aversive stimulus is no longer permitted following the target behavior; the individual is required to remain in or complete the task.
Four Characteristics and Effects of Extinction:
1. Extinction Burst: A temporary, immediate increase in the frequency, duration, or intensity of the target behavior upon initial implementation of extinction.
2. Extinction-Induced Aggression / Emotional Responding: Aggressive actions, destructive behaviors, or emotional reactions directed toward nearby individuals or objects during the extinction process.
3. Extinction-Induced Variability in Responding: Unplanned variations in the topography, form, or novel variations of behavior emitted as the individual attempts to access the previously delivered reinforcer.
4. Spontaneous Recovery: The re-emergence of a previously extinguished behavior after a temporal delay or period during which the behavior was not emitted, without any additional reinforcement.
Influence of Reinforcement History on Resistance to Extinction:
- Continuous Reinforcement (CRF) History: Behaviors previously maintained on a continuous schedule (reinforcement after every response) show low resistance to extinction and cease rapidly when reinforcement stops.
- Intermittent Reinforcement History: Behaviors previously maintained on an intermittent schedule (reinforcement delivered after only some responses) show high resistance to extinction, persisting for extended periods despite the complete absence of reinforcement.

Punishment Concepts and Procedures

Punishment Definition: A environmental consequence contingency in which a response is immediately followed by a stimulus change that decreases the future probability or frequency of that behavior.
Positive Punishment: A procedure where a stimulus is added or presented contingent on a behavior, resulting in a decrease in the future frequency of that behavior.
Negative Punishment: A procedure where a stimulus is removed or withdrawn contingent on a behavior, resulting in a decrease in the future frequency of that behavior.
Comparative Analysis:
- Similarity: Both positive and negative punishment decrease the future rate of behavior.
- Difference: Positive punishment involves stimulus presentation; negative punishment involves stimulus removal.
Four Critical Issues and Considerations When Using Punishment:
1. Elicitation of Negative Emotional Reactions and Aggression: Punishment can induce aggressive or disruptive emotional responses aimed at the source of punishment.
2. Development of Escape and Avoidance Behaviors: Individuals may learn behaviors to escape or avoid the environment or person administering the punishment rather than reducing the target behavior.
3. Modeling Undesirable Behaviors: The agent delivering punishment inadvertently models punitive or aggressive behavior for the individual.
4. Overuse Driven by Negative Reinforcement: Delivering punishment typically results in the immediate cessation of the targeted unwanted behavior, which negatively reinforces the punisher's behavior, leading to potential overuse.

Timeout and Response Cost

Both timeout and response cost are classified as forms of negative punishment.

Timeout:
- Definition: The temporary removal of access to positive reinforcers, or the temporary removal of the individual from a reinforcing environment, for a specified period contingent on a target behavior.
Response Cost:
- Definition: The permanent removal or loss of a specific quantity of a previously earned positive reinforcer (e.g., points, tokens, money) contingent on a target behavior.
Comparison:
- Similarities: Both rely on the removal of desirable stimuli to produce a future decrease in target behavior.
- Differences: Timeout involves losing access to reinforcement options for a given period; response cost involves losing a specific, quantified amount of a accumulated reinforcer without necessarily altering the physical location or access time.

Unconditioned vs. Conditioned Punishers and Effectiveness Factors

Unconditioned Punishers (Primary): Stimuli whose punishing capabilities are unlearned and biologically determined (e.g., physical pain, extreme cold/heat, intense loud noises).
Conditioned Punishers (Secondary): Stimuli that function as punishers only after acquiring punishing properties through pairing history with other established punishers (e.g., reprimands, threats, social disapproval, point deductions).
Functional Definition Rule: A stimulus cannot be classified as a punisher simply because society or individuals consider it unpleasant. It functions as a punisher only if empirical data confirm a reduction in the future frequency of the target behavior.
Five Factors Influencing Punishment Effectiveness:
1. Immediacy: Immediate presentation or removal of the stimulus is required for maximum effectiveness.
2. Intensity / Magnitude: Higher intensity or magnitude of a punishing stimulus produces faster and more complete reduction of behavior.
3. Schedule / Consistency: Continuous punishment (punishing 100% of target occurrences) is significantly more effective than intermittent punishment.
4. Availability of Alternative Reinforcement: Providing reinforcement for acceptable alternative behaviors significantly enhances the reduction of the punished behavior.
5. Motivating Operations (MOs):
  - Effect on Negative Punishment: An EO that enhances the current value of a stimulus increases the punishing effectiveness of removing that stimulus; an AO decreases its punishing effectiveness.
  - Effect on Positive Punishment: MOs alter the current degree of aversiveness or potency of the stimulus presented following the behavior.

Antecedents, Three-Term Contingency, and Stimulus Control

Antecedent ( $A$ ): An environmental condition, stimulus, or event that precedes the occurrence of a target behavior in time.
Three-Term Contingency: The foundational framework of operant behavior represented as: $\text{Antecedent } (A) \rightarrow \text{Behavior } (B) \rightarrow \text{Consequence } (C)$
- Antecedents set the occasion for responding, while consequences alter the future probability of responses occurring under similar antecedent conditions.
Stimulus Control: A condition in which a behavior occurs at a higher frequency or probability in the presence of a specific antecedent stimulus than in its absence, established through a history of differential consequences.

Stimulus Discrimination Training, $S^D$ , and $S^\Delta$

Discriminative Stimulus ( $S^D$ ): An antecedent stimulus present when a specific behavior is reinforced, signaling that reinforcement is available.
S-Delta ( $S^\Delta$ ): An antecedent stimulus present when a specific behavior is not reinforced (or is extinguished/punished), signaling that reinforcement is unavailable.
Stimulus Discrimination Training Procedure:
- A procedure in which a behavior is reinforced in the presence of an $S^D$ and subjected to extinction or non-reinforcement in the presence of an $S^\Delta$ .
Vending Machine Discrimination Example:
- $S^D$ : Machine display shows "READY" (signals that inserting money and pressing a button will produce a drink).
- $S^\Delta$ : Machine display shows "SOLD OUT" (signals that inserting money and pressing a button will not produce a drink).

Stimulus Generalization vs. Stimulus Discrimination

Stimulus Generalization: Occurs when a behavior is emitted in the presence of novel antecedent stimuli that share similar physical or structural properties with the original $S^D$
Comparative Rule of Thumb:
- Discrimination: "I respond differently when the stimuli are different."
- Generalization: "I respond similarly when the stimuli are similar."

Practical Application Scenarios and Case Analysis

Comprehensive Consequence Discrimination Examples

Alicia
- Antecedent: Teacher asks Alicia to do her math worksheet.
- Behavior: Alicia tells her teacher to "shut up".
- Consequence: Teacher sends Alicia to sit in the corner for 5 minutes.
- Future Probability: Alicia continues to tell the teacher to "shut up" when asked to complete math worksheets.
- Principle: Reinforcement (specifically Positive Reinforcement via attention or Negative Reinforcement via escape from work, as future behavior rate maintained/increased).
Bart
- Antecedent: Wants to play on the computer.
- Behavior: Screams at his teacher.
- Consequence: Teacher sends Bart to sit in the corner for 5 minutes.
- Future Probability: Bart no longer screams at his teacher when he wants to play on the computer.
- Principle: Negative Punishment (Timeout) (removal of computer access resulting in future behavior decrease).
Shante
- Antecedent: Mom is on the phone.
- Behavior: Shante interrupts her mom.
- Consequence: Mom reprimands her.
- Future Probability: Shante continues to interrupt her mom on the phone.
- Principle: Positive Reinforcement (addition of verbal attention maintains/increases future behavior rate).
Precious
- Antecedent: Dad is talking to her teacher.
- Behavior: Precious interrupts her dad.
- Consequence: Dad reprimands her.
- Future Probability: Precious no longer interrupts her dad when he is talking to other adults.
- Principle: Positive Punishment (addition of reprimand decreases future behavior frequency).
Jorge
- Behavior: Helps neighbor with home improvement tasks.
- Historical Consequence: Neighbor gives Jorge $20.
- Current Consequence: Last several times, Jorge received no money.
- Future Probability: Jorge stops helping his neighbor.
- Principle: Extinction (discontinuation of previous maintaining reinforcer leads to cessation of behavior).
Undergraduate Vaccination
- Behavior: Showing proof of vaccination.
- Consequence: Provided with a gift card to favorite fast-food restaurant.
- Future Probability: Increases likelihood of getting vaccinated.
- Principle: Positive Reinforcement (addition of stimulus increases future probability of behavior).
Grocery Store Workers
- Behavior: Being on time every scheduled day during a pay period.
- Consequence: Receive $10 bonus.
- Future Probability: Number of workers on time stays the same.
- Principle: Maintenance / Non-Reinforcement Effect (does not demonstrate reinforcement to increase behavior beyond baseline, though it maintains ongoing frequency).
Retail Managers
- Behavior: Making sales quota for a quarter.
- Consequence: Given one 8-hour day off every 3 months.
- Future Probability: Increase in managers making their sales quota.
- Principle: Reinforcement (Positive Reinforcement via earning time off or Negative Reinforcement via removal of a work shift increases future target behavior).
Marissa
- Behavior: Throwing a tantrum.
- Historical Consequence: Sister gave toys to "calm her down" (behavior maintained).
- Current Consequence: Sister stopped giving toys during tantrums.
- Future Probability: Tantrums decrease in frequency.
- Principle: Extinction (withholding previously maintaining reinforcer decreases behavior rate).
Josh
- Behavior: Getting out of seat during class.
- Consequence: Teacher removes a token from his token board.
- Future Probability: Decrease in getting out of seat.
- Principle: Negative Punishment (Response Cost) (removal of specific positive reinforcer unit decreases future behavior).
Isabelle
- Behavior: Making excuses to avoid dressing out for PE.
- Consequence: Coach requires her to dress out regardless of the excuse (escape removed).
- Future Probability: No longer gives excuses to miss PE.
- Principle: Extinction (Escape Extinction) (escape reinforcer is withheld, decreasing behavior rate).

Stimulus Control and Antecedent Scenarios

IDD Adult Program Consultation
- Scenario: Consultants train staff on interaction best practices and conduct on-site observations. Staff perform practices frequently when consultants are present in person, but remote observations reveal staff do not engage in these practices when consultants are absent.
- Three-Term Contingency Analysis:
  - $S^D$ (Discriminative Stimulus): On-site physical presence of consultants (signals reinforcement/feedback for staff behavior).
  - $S^\Delta$ (S-Delta): Absence of consultants / remote observation context (signals lack of immediate feedback/reinforcement).
  - Generalization Failure: Behavior is under tight stimulus control of the consultants' physical presence and fails to generalize to the novel/absent stimulus condition.
School vs. Home Behavioral Differences
- Scenario: A child displays appropriate behavior at school but exhibits problem behaviors at home.
- Analysis: The school environment contains specific antecedent stimuli ( $S^D$ s) paired with structured reinforcement contingencies for appropriate behavior. The home environment lacks these specific $S^D$ s or maintains conflicting reinforcement contingencies ( $S^D$ s for problem behavior).
Selective Mutism Case Context
- Scenario: An individual speaks fluently in specific settings (e.g., at home) but remains mute in other settings (e.g., at school).
- Analysis: Specific settings act as $S^D$ s for speech (due to history of reinforcement), while other settings act as $S^\Delta$ s or conditioned aversive stimuli due to history of non-reinforcement or punishment.