Module 4: Operant Conditioning

Fundamentals of Operant Conditioning vs. Respondent Conditioning

  • Respondent Conditioning:
    • Deals with antecedent stimuli paired together to elicit reflexive, unlearned responses.
    • Operates on a two-term contingency framework: Antecedent →\rightarrow Response.
  • Operant Conditioning:
    • Refers to learned behavior that is controlled and shaped by the selective effects of consequences experienced in daily life.
    • Operates on a three-term contingency framework: Antecedent →\rightarrow Behavior →\rightarrow Consequence.
  • Functional Consequences:
    • A functional consequence is a stimulus change that follows a given response closely in time and alters the future occurrence of similar responses under similar conditions.
    • Consequences operate exclusively on future behavior, selecting response classes rather than individual isolated responses.
  • Real-World Behavioral Shaping Examples:
    • Texting Friends: Texting Friend A produces no reply, whereas texting Friend B produces an immediate reply. The immediate response reinforces texting Friend B, increasing future texting behavior toward Friend B, while the lack of response punishes or fails to reinforce texting Friend A, decreasing future texting toward Friend A.
    • Sharing Jokes: Telling corny dad jokes to two adult sons where Son A never responds and Son B responds immediately shapes texting behavior. The behavior is modified to stop sending group texts and send jokes exclusively to Son B. Similarly, telling a dad joke in a large group setting that results in silence or groans acts as a punisher, decreasing the future probability of telling dad jokes in large groups.
    • Workplace Feedback: Submitting a workplace report that receives praise from a supervisor reinforces hard work, increasing the likelihood that equal effort will be applied to future reports.

Mechanisms of Reinforcement and Punishment

  • Reinforcement:
    • Occurs when operant conditioning produces an increase in the future rate or frequency of a response.
    • The consequence responsible for increasing the response rate is defined as a reinforcer.
  • Punishment:
    • Occurs when operant conditioning produces a decrease in the future rate or frequency of a response.
    • The consequence responsible for decreasing the response rate is defined as a punisher.
  • Behavioral Consequence Effects:
    • Behavioral consequences select response classes rather than individual, isolated responses.
    • Responses emitted due to reinforcement effects will differ slightly in topography from previously reinforced responses, but they will share at least one functional element to produce the same consequence.
  • Specific Examples of Punishment:
    • Peer Teasing: Wearing a specific shirt or outfit to elementary school and being teased by peers (e.g., being told the outfit is "babyish") functions as a punisher, reducing the probability of wearing that shirt or outfit in the future.
    • Speeding Ticket: Receiving a speeding ticket at a precise location while driving to a beach house shapes driving behavior, causing strict adherence to the speed limit whenever driving through that exact location in the future.

Response Classes and Temporal Sensitivity in Behavior Shaping

  • Response Classes:
    • A response class consists of multiple topographically distinct behaviors that share the same function and yield the same consequence.
    • Gaining Attention: Behaviors such as screaming loudly, calling a person's name, raising a hand, or sending a text look topographically different, but all belong to the same response class aimed at gaining attention.
    • Social Interactions: Engaging with a poor conversationalist at a party punishes social interaction behaviors toward that specific individual, making future engagement with them at subsequent events unlikely.
  • Immediate Consequences and Temporal Relations:
    • Behavior is most sensitive to stimulus changes that occur immediately or within a few seconds after a response.
    • The temporal relation between behavior and its consequence is functional, not logical or topographical.
    • Language Acquisition Example: When teaching a child to speak, holding a cookie and prompting "say cookie" must be followed by immediate delivery of the cookie upon any vocal approximation (e.g., "cookie" or "cook"). Delaying reinforcement prevents the child from associating the reward with the target vocal behavior.
    • Delayed Gratification in Weight Loss: Exercising and maintaining dietary changes for 22 to 33 days or 33 to 44 days without immediate weight loss represents a delayed consequence. Smaller, short-term goals provide faster gratification, making them more effective for maintaining motivation.
    • Academic Testing: Studying all afternoon, taking an examination that evening, and receiving an AA immediately reinforces studying behavior for subsequent examinations.
    • Workplace Evaluations: Employee evaluations conducted at long intervals (e.g., every 66 to 77 months) are less effective at shaping specific daily task behaviors due to the delay in reinforcement.

Operant Automaticity and Reinforcement Types

  • Automaticity of Operant Conditioning:
    • Operant conditioning occurs automatically throughout daily life via natural consequences, without requiring explicit conscious awareness.
    • Traffic Route Example: Driving a new route to work that adds 15 minutes15\,\text{minutes} to travel time punishes that specific route choice, decreasing the likelihood of choosing that route again at the same time.
  • Positive vs. Negative Terminology in ABA:
    • In Applied Behavior Analysis (ABA), "positive" and "negative" do not denote good or bad; they indicate the addition or subtraction of a stimulus.
  • Positive Reinforcement:
    • The presentation or addition of a stimulus immediately following a response that increases the future frequency of that behavior.
    • Token Economy Example: Presenting a child with tokens, verbal praise ("good job"), and high fives following correct answers on flashcards adds stimuli to increase future correct responses.
  • Negative Reinforcement:
    • The removal, termination, or reduction of an aversive stimulus immediately following a response that increases the future frequency of that behavior.
    • Break Privileges: Allowing a child to take an academic break after earning 33 tokens negatively reinforces work behavior by temporarily removing the aversive stimulus of academic demand.
    • Classroom Management Example: A fifth-grade teacher informing students that walking quietly upstairs will allow them to skip completing a math worksheet negatively reinforces quiet walking behavior by removing the aversive task.
    • Seatbelt Alarm: Buckling a seatbelt upon entering a vehicle terminates the annoying beeping chime, negatively reinforcing seatbelt buckling in future instances.
  • Aversive Stimuli:
    • Refers to stimulus conditions whose termination functions as reinforcement.
    • Headache Relief: Taking ibuprofen terminates the aversive stimulus of a painful headache, negatively reinforcing medication-taking behavior for future headaches.

Extinction, Punishment, and Behavior Change Tactics

  • Extinction:
    • The procedure in which reinforcement for a previously reinforced behavior is discontinued, resulting in a decrease in the future frequency of that behavior.
    • Extinction is distinct from punishment and is not strictly identical to planned ignoring, though planned ignoring can be a form of extinction when attention was the maintaining reinforcer.
    • Grocery Store Lollipop Example: A child who historically received a lollipop during grocery store visits is denied a lollipop per dental advice. The child engages in screaming and throwing a tantrum throughout the store. Maintaining the refusal to provide a lollipop despite the tantrum constitutes extinction.
    • Attention Seeking: Ignoring repeated verbal calls of "Jamie, Jamie, Jamie" until the individual displays an alternative target behavior, such as raising a hand or saying "excuse me".
    • Ethical Application: Extinction should ethically be paired with functional communication training or differential reinforcement of alternative behaviors.
  • Positive Punishment:
    • The addition or presentation of an aversive stimulus following a behavior that decreases the future frequency of that behavior.
    • Extra Homework: Assigning extra practice worksheets to a student following a zero mark on a homework assignment.
    • Icy Road Driving: Driving at normal speeds on icy roads resulting in a car crash adds an aversive collision stimulus, decreasing normal-speed driving under icy conditions in the future.
  • Negative Punishment:
    • The removal or withdrawal of a preferred stimulus following a behavior that decreases the future frequency of that behavior.
    • Parental Disciplinary Action: Grounding a child, revoking cell phone access, or removing video game privileges following target misbehaviors.
    • Digital Pop-Up Prompts: Ignoring pop-up warnings when deleting unread messages resulting in the loss of important messages punishes ignoring future system warnings.
  • Evaluative Criterion for Punishment:
    • A consequence can only be formally categorized as a punisher if the future frequency of the target behavior actually decreases.
    • Garage Door Example: Applying financial fines or positive practice procedures to address leaving a garage door open overnight fails to qualify as punishment if the rate of leaving the garage door open does not decrease.
  • Principles of Behavior vs. Behavior Change Tactics:
    • Principles of Behavior: Empirical, evidence-based functional relations derived from controlled basic experimental research (e.g., B.F. Skinner's foundational research with pigeons examining continuous versus intermittent schedules of reinforcement, extinction, and punishment).
    • Behavior Change Tactics: Technological methods and strategies derived from basic behavior principles used to alter human behavior in applied settings (e.g., behavior chaining, shaping, and Differential Reinforcement of Other Behavior [DRO]).

Unconditioned vs. Conditioned Stimuli and Individual Differences

  • Unconditioned Reinforcers (Primary Reinforcers):
    • Unlearned stimuli that increase behavior without prior learning history due to evolutionary biological importance.
    • Examples include food, water, warmth, and sexual stimulation (which retain value even in individuals with severe intellectual disabilities).
  • Unconditioned Punishers (Primary Punishers):
    • Unlearned, naturally aversive stimulus conditions that decrease behavior without prior learning.
    • Examples include physical pain and electric shock.
  • Conditioned Reinforcers and Punishers (Secondary):
    • Stimuli that acquire reinforcing or punishing capabilities through stimulus-stimulus pairing with primary or established secondary reinforcers/punishers.
    • Examples include money (e.g., a $100 bill or $500 bill), tokens in a token economy, and social praise.
  • Individualization of Consequences:
    • Reinforcers and punishers are idiosyncratic and depend on an individual's unique history, culture, and learning background.
    • Public Praise: Public recognition from a supervisor may reinforce behavior for one employee, but act as an aversive, punishing stimulus for an introverted employee who dislikes public attention.
    • Trauma History: Entering a walk-in closet may be benign or pleasant for most individuals, but highly punitive for an individual with historical trauma involving confinement in closets.

Discriminative Operants, Three-Term, and Four-Term Contingencies

  • Discriminative Operants:
    • Behaviors under stimulus control (SDSD) due to a past history of reinforcement or punishment in the presence of specific antecedent stimuli.
    • Traffic Driving: A red light, stop sign, or crossing pedestrian acts as an SDSD that evokes placing a foot on the brake pedal; a green light acts as an SDSD that evokes pressing the accelerator.
    • Telephone Auditory Cue: A ringing telephone evokes the behavior of answering the phone, whereas a silent telephone does not evoke answering behavior.
  • Three-Term Contingency (ABCs of Behavior):
    • A→B→CA \rightarrow B \rightarrow C
    • Antecedent (AA): Stimulus change preceding a behavior.
    • Behavior (BB): The observable and measurable response emitted.
    • Consequence (CC): Stimulus change immediately following the behavior that determines future response rates.
  • Four-Term Contingency:
    • MO→A→B→CMO \rightarrow A \rightarrow B \rightarrow C
    • Incorporates Motivating Operations (MOMO), which alter the momentary value of a consequence and the current frequency of behaviors that have produced that consequence.
    • Wawa Restaurant Example: Skipping lunch creates state deprivation/hunger (MOMO). Seeing a sign for Wawa (AA) evokes pulling into the parking lot (BB) to purchase a sub sandwich (CC). Conversely, if pizza was consumed for lunch, hunger (MOMO) is absent; seeing the Wawa sign (AA) fails to evoke pulling into the parking lot (BB).
  • Contingency Definition:
    • Refers to the strict dependency of a specific consequence upon the emission of a specific target response (the response must be emitted for the consequence to occur).

Complex Behavioral Control, Emotions, and History of Reinforcement

  • Joint Control:
    • Occurs when two separate but interrelated forms of an individual's verbal behavior combine with acquired stimulus control to evoke a response in the presence or absence of either stimulus.
  • Rule-Governed Behavior:
    • Behavior controlled by explicit rule statements and verbal descriptions of contingencies rather than direct contact with immediate consequences.
  • Emotions in Behavior Analysis:
    • Emotions represent a complex commingling of respondent (reflexive) and operant (learned) behavioral processes.
    • Identifying causal variables behind emotional behaviors requires gathering objective ABC data to isolate true underlying behavioral functions.
  • Unique History of Reinforcement:
    • No two individuals experience the world identically; every person enters a given situation with an individualized behavioral repertoire shaped and maintained by their historical contingencies.
    • Toddler Behavioral Repertoire Comparison: A toddler who has been historically reinforced with candy for throwing tantrums will exhibit tantrums when entering new environments until extinction and alternative shaping occur. Conversely, a toddler taught early to utilize sign language or vocal words to communicate will exhibit a completely different behavioral repertoire in the same environment.