PY 322: Respondent and Operant Conditioning Flashcards

Foundations and Core Terminology of Behavioral Conditioning

• Definition of Conditioning: Conditioning is defined as synonymous with learning; it represents the mechanism by which behavior changes as a result of experience with environmental stimuli.
• Target of Reinforcement and Punishment: Reinforcement and punishment are always applied strictly to a specific behavior, never to an individual person or an animal.
• Fundamental Operational Symbols and Definitions:
  • Positive ($+$): The addition, presentation, or onset of a stimulus to the surrounding environment following a target response.
  • Negative ($-$): The removal, termination, or withdrawal of an existing stimulus from the surrounding environment following a target response.
  • Reinforcement: Any behavioral procedure or environmental relation that increases the future frequency, rate, or probability of a specific target behavior.
  • Punishment: Any behavioral procedure or environmental relation that decreases the future frequency, rate, or probability of a specific target behavior.
• Distinction Between Operant and Respondent Conditioning:
  • Respondent Conditioning: Operates via stimulus-stimulus pairing ($NS - US$) to elicit involuntary reflex responses ($CR$). It does not rely on post-behavior consequences to modify future response frequency.
  • Operant Conditioning: Operates via stimulus-response-consequence relationships ($S - R - S$). Involves consequential stimuli (reinforcers or punishers) immediately following a response, resulting in an altered future frequency of that response.

Respondent Conditioning Mechanics and Applications

• Core Concepts and Four Key Definitions:
  • Unconditioned Stimulus ($US$): A stimulus that elicits an unlearned, involuntary response without any previous exposure, training, or pairing history.
  • Unconditioned Response ($UR$): An unlearned, reflex response automatically elicited by an unconditioned stimulus.
  • Conditioned Stimulus ($CS$): A previously neutral stimulus that acquires the capacity to elicit a response due to systematic pairing with an unconditioned stimulus (or another conditioned stimulus).
  • Conditioned Response ($CR$): A learned response elicited by a conditioned stimulus as a consequence of prior conditioning.
• Discovery and Historical Foundations:
  • Ivan Pavlov (1901): Accidentally discovered respondent conditioning while conducting research on canine endocrine systems and digestive processes.
  • Initial Observation: Pavlov noted that laboratory dogs began to salivate simply upon seeing the laboratory assistant responsible for their daily feedings, prior to food being placed in their mouths.
  • Experimental Process:
    1. Pairing Phase: Pavlov presented a neutral stimulus (a ringing bell, $NS$) immediately before introducing meat powder ($US$), which naturally elicited salivation ($UR$).
    2. Test Phase: Pavlov presented the ringing bell ($NS$) in isolation without the meat powder.
    3. Experimental Outcome: The bell produced salivation on its own ($CR$), establishing the bell as a conditioned stimulus ($CS$).
• Everyday Examples of Conditioned Stimuli:
  • Example 1 (Dog and Package Sound):
    • Conditioned Stimulus ($CS$): The crinkling sound of a plastic package.
    • Unconditioned Stimulus ($US$): Receiving edible treats.
    • Behavioral Outcome: A dog runs over immediately upon hearing a plastic package crinkle because the crinkling sound routinely occurs right before treats are delivered.
  • Example 2 (Garbage Truck Routine):
    • Conditioned Stimulus ($CS$): The distinctive, loud noise of a garbage truck entering the neighborhood on Wednesday mornings (previously a neutral stimulus).
    • Unconditioned Stimulus ($US$): The truck arriving directly at the house to collect garbage.
    • Conditioned Response ($CR$): Running quickly to the garage every Wednesday morning upon hearing the distant truck noise.
  • Example 3 (Refrigerator Ice Dispenser Sound):
    • Conditioned Stimulus ($CS$): The familiar beeping sound produced when pressing the ice button on a refrigerator door.
    • Unconditioned Stimulus ($US$): The subsequent loud, startling noise of ice being mechanically dispensed into a cup.
    • Conditioned Response ($CR$): A four-year-old child running to another room immediately upon hearing the ice button beep.
• Higher-Order Respondent Conditioning:
  • Definition: Establishing a new conditioned stimulus ($CS_2$) by pairing a neutral stimulus ($NS$) with an already established conditioned stimulus ($CS_1$), without directly involving the original unconditioned stimulus ($US$).
  • Practical Example (Treat Cabinet):
    • Context: Dog treats are stored inside a cabinet located in a laundry room.
    • Primary Conditioned Stimulus ($CS_1$): The sound of a crinkling food package.
    • Neutral Stimulus ($NS$): The mechanical sound of the laundry room cabinet door opening.
    • Pairing Process: Opening the cabinet door ($NS$) consistently precedes the crinkling package sound ($CS_1$).
    • Outcome: The dog runs to the owner upon hearing the cabinet door open, transforming the cabinet door sound into a secondary conditioned stimulus ($CS_2$).
• Establishment of Phobias (The Little Albert Experiment, 1920):
  • Researchers: Conducted by John B. Watson and his research assistant.
  • Experimental Methodology:
    1. Presented an infant named Little Albert with a white rat ($NS$), toward which he initially displayed no fear.
    2. While Albert examined the rat, researchers struck a heavy iron bar with a hammer ($US$) directly behind his head, eliciting a sudden fear and crying response ($UR$).
  • Outcome: The white rat became a conditioned stimulus ($CS$) that elicited intense fear ($CR$). This fear response generalized broadly to other white, furry objects (e.g., rabbits, furry coats).
• Respondent Extinction:
  • Definition: The process of repeatedly presenting a conditioned stimulus ($CS$) in the absence of the unconditioned stimulus ($US$) or without the established $CS_1$.
  • Effect: The conditioned stimulus progressively loses its eliciting power until the conditioned response ($CR$) completely ceases.
  • Application to Little Albert: Extinction would require repeatedly presenting the white rat to Albert without producing the loud hammer noise. Over time, the learned association between white rats and loud noise would diminish and extinguish.
• Systematic Desensitization:
  • Definition: A clinical therapeutic intervention that combines progressive relaxation procedures with a graded hierarchy of fear-producing stimuli arranged from least to most frightening.
  • Core Requirement: The client must maintain a state of total physical relaxation so that anxiety is physiologically counter-conditioned (inhibited) at each step of the hierarchy.
  • Implementation Modalities:
    • In-Vivo Desensitization: Conducted in real-world settings where the client utilizes relaxation skills while directly confronting physical, fear-producing situations.
    • Imagery Desensitization: Conducted in a clinical office setting where the client practices remaining relaxed while vividly imagining scenarios that elicit phobic distress.
• Structured Application of Systematic Desensitization to Little Albert:
  • Imagery/Office Hierarchy Progression:
    1. Relaxation Initiation: Initiate relaxation protocols, such as deep breathing exercises.
    2. Discussion: Facilitate a neutral discussion with Albert regarding squirrels, rats, and rabbits.
    3. Static Visuals: Present pictures of furry animals in books or magazines.
    4. Dynamic Visuals: Display video recordings of furry animals playing.
    5. Tactile Simulation: Introduce soft, furry animal toys for Albert to handle while remaining relaxed.
  • In-Vivo Hierarchy Progression:
    1. Window Viewing: Accompany Albert to a pet store and view a live rabbit through the store window.
    2. Distant In-Store Viewing: Enter the pet store and observe the rabbit from across the room.
    3. Approaching: Walk closer and approach the rabbit's enclosure.
    4. Touching: Reach out and make initial finger contact with the rabbit.
    5. Holding: Hold the rabbit securely in his arms.
    6. Petting: Calmly pet and interact with the rabbit.

Operant Conditioning Principles and Thorndike's Law of Effect

• Historical Foundations:
  • Edward Thorndike: Formulated the Law of Effect based on empirical laboratory experiments using animal puzzle boxes.
• Core Principles of the Law of Effect:
  • The environmental effects or consequences of an organism's actions determine whether those actions will be repeated in future similar situations.
  • Responses immediately preceding "pleasant" (satisfying) events become more tightly connected to the situation and are more likely to recur.
  • Responses immediately preceding "unpleasant" (annoying) events have their connections weakened and are less likely to recur.
  • Learning Mechanism: Organisms solve environmental problems through gradual trial-and-error learning rather than through sudden, cognitive insight.
  • Scientific Significance: Serves as the foundational historical cornerstone of modern behavior analysis.
• Behavioral Principles versus Applied Behavior Change Procedures:
  • Behavioral Principles: Define functional relations between a behavior and its controlling environmental variables. They are inferred directly from controlled laboratory research, describing fundamental scientific laws (e.g., reinforcement, punishment, extinction).
  • Applied Behavior Change Procedures: Technological derivations of basic principles used in applied settings to assist individuals in acquiring, maintaining, or reducing socially significant behaviors.

Mechanics and Operations of Operant Conditioning

• The Four Basic Operations:

• Principles and Mechanics of Reinforcement:
  • Definition: Reinforcement is the single most important principle of behavior and serves as the core component of virtually all behavior change programs.
  • Operational Definition: Occurs when a new stimulus is added to the environment or an existing stimulus is removed from the environment immediately following a target response, leading to an increase in the future frequency of that response.
  • Three Essential Criteria for Reinforcement:
    1. The target response must produce immediate environmental consequences.
    2. The probability or rate of the response must increase over time.
    3. The increase in response probability must occur specifically as a function of those consequential stimuli.
  • Establishment and Maintenance Dynamics:
    • Significant behavior change can occasionally occur after a single delivery of a reinforcer.
    • Typically, multiple response-consequence pairings are necessary before strong conditioning is established.
    • Once a behavior is established, continuous reinforcement (reinforcing every response) is no longer required.
    • Durable, high response rates are effectively maintained over long periods using intermittent schedules of reinforcement.
• Positive Reinforcement:
  • Positive Reinforcer: A stimulus whose presentation following a response increases the future frequency of that response.
  • Positive Reinforcement Contingency: A response-contingent presentation of a stimulus that results in an increased future frequency of that response.
  • Potty Training Example: Elsa receives an M&M piece immediately after sitting on her potty chair. As a direct result, her frequency of sitting on the potty chair increases.
• Negative Reinforcement:
  • Negative Reinforcer: An aversive stimulus whose removal, termination, reduction, or postponement following a response increases the future frequency of that response.
• Principles and Mechanics of Punishment:
  • Definition: The functional inverse of reinforcement, defined strictly by a reduction in future consequential responding.
  • Three Essential Criteria for Punishment:
    1. The target response must produce immediate environmental consequences.
    2. The probability or rate of the response must decrease over time.
    3. The decrease in response probability must occur specifically as a function of those consequential stimuli.
  • Punishment Contingencies:
    • Punisher: A stimulus whose presentation or removal following a response decreases the future frequency of that response.
    • Positive Punishment Contingency (Punishment): The response-contingent presentation of a punisher resulting in a decreased future frequency of that response.
      • Traffic Citation Example: Joan receives a traffic citation carrying a heavy monetary fine after speeding in a school zone. Following this consequence, her speeding in school zones ceases.
    • Negative Punishment Contingency (Penalty): The response-contingent removal or withdrawal of a reinforcing stimulus resulting in a decreased future frequency of that response.
      • Curfew Example: Pete is restricted from spending time with friends over the weekend because he arrived home after his mandated curfew the previous weekend. Consequently, he refrains from coming home late in the future.
• Behavioral Contingency Summary Matrix:
  • Contingent: Means dependent upon or caused by.
  • Behavioral Contingency: Specifies the structural interrelationship between the occasion for a response, the target response itself, and the consequential outcome.
  • Reinforcement Contingencies: Always increase future behavior frequency.
  • Punishment Contingencies: Always decrease future behavior frequency.
  • Positive Contingencies: Involve stimulus presentation/addition.
  • Negative Contingencies: Involve stimulus removal/termination.

Operant Extinction and Behavioral Dynamics

• Operational Definition: The process of discontinuing the positive or negative reinforcement contingency maintaining a previously reinforced response, resulting in a progressive decrease in response frequency over time until it reaches pre-reinforcement baseline levels.
• Grocery Store Example (Ellie and Her Father):
  • Contingency History: Ellie asks for candy while standing in a grocery store checkout line and is denied. She engages in a severe temper tantrum. Her embarrassed father delivers candy to terminate the tantrum.
  • Implementation of Extinction: After several repeated episodes, the father stops providing candy during tantrums and systematically ignores the tantrum behavior when it occurs.
  • Outcome: Ellie's tantrums gradually decrease in frequency and ultimately cease.
• Extinction Burst Dynamics:
  • Definition: An immediate, temporary escalation in the intensity, frequency, duration, or variability of the target behavior upon the initial withdrawal of reinforcement.
  • Mechanism: Ellie's tantrums increase in intensity prior to declining because she has a history of obtaining candy via outbursts and attempts to "up the ante" to achieve reinforcement.
  • Implementation Requirement: Total consistency is mandatory during extinction protocols. Delivering intermittent or variable reinforcement during an extinction burst inadvertently strengthens the behavior, making it far more resistant to future change.

Temporal Factors, Immediacy, and Reinforcement Schedules

• The Immediacy Principle:
  • Reinforcement is most powerful when delivered immediately following the target response.
  • Optimal Timing: The ideal temporal delay target is $0\,\text{s}$. The reinforcing effect declines sharply as delay increases by even a few seconds.
  • Immediate Reinforcement Standard: A reinforcer must be delivered within no more than $1\,\text{s}$ post-response to meet the standard for immediate reinforcement.
  • Temporal Bound: A reinforcer must follow a response within $60\,\text{s}$ or less to alter behavior directly without requiring verbal mediating rules.
• Real-World Comparative Dynamics (Social Media vs. Real Life):
  • Social Media Posting: Highly reinforcing due to extreme immediacy; posting a photo yields notifications, likes, and comments within seconds ($0 - 60\,\text{s}$).
  • Real-World Social Dynamics: Real-world social reinforcement is typically delayed; receiving compliments regarding a haircut from friends or colleagues often occurs hours, days, or weeks later.
• Delayed Reinforcement Dynamics:
  • Definitions: Delayed reinforcement occurs when a reinforcer is delivered between $1\,\text{s}$ and $60\,\text{s}$ post-response. Delayed delivery of a reinforcer refers to outcomes delivered after $60\,\text{s}$.
  • Cognitive Requirement: For delays exceeding $60\,\text{s}$ to effectively govern behavior, the learner must possess verbal competence to comprehend behavioral contingencies and rules.
  • First-Then Contingencies: Verbal structures used with children to bridge temporal gaps (e.g., "First we complete our handwriting task, then we can go to the playground").
  • Examples of Delayed Reinforcers: Earning academic grades, receiving biweekly paychecks, and developing a fit physique.
• Idiosyncratic and Superstitious Behavior:
  • Because reinforcers follow responses in time, functional control is tightly bound to temporal proximity.
  • Delays between a target response and reinforcer delivery can accidentally reinforce incorrect intervening responses.
  • Arbitrary temporal pairings between responses and non-contingent reinforcers generate idiosyncratic or superstitious behavior.
  • Lucky Ritual Example: An athlete engages in a rigid ritual (e.g., refusing to wash socks during a winning streak) because that specific behavior was non-contingently followed by victory in the past.
• Automaticity of Reinforcement:
  • Consequences modify behavior automatically, regardless of whether the individual is consciously aware that reinforcement has occurred.
  • Cognitive awareness or explicit verbalization of the relationship between a response and its consequence is not required for reinforcement to operate.

Rule-Governed versus Contingency-Shaped Behavior

• Core Concepts and Definitions:
  • Rule: An explicit verbal or written statement describing a behavioral contingency.
  • Rule-Governed Behavior: Behavior controlled by explicit rule statements. The individual does not directly contact the environmental consequences but alters behavior based on verbal descriptions or observing others.
  • Contingency-Shaped Behavior: Behavior acquired and maintained through direct, immediate contact with environmental consequences over time.
  • Contingency Contract: A formal rule statement detailing the target behavior, the environmental occasion for the behavior, and the specific outcome associated with performance or non-performance.
• Comparative Application (Vending Machine Scenario):
  • Rule-Governed: Refraining from inserting money into a vending machine after reading an "Out of Order" sign taped to the glass.
  • Contingency-Shaped: Ceasing to insert money into a vending machine because the machine previously lost your money on three consecutive attempts without dispensing a drink.
• Comparative Application (Mask-Wearing Application):

• Rule-Governed Masking: Retrieving a mask from a pocket and placing it over one's face after reading a grocery store door sign stating masks are required for entry.
• Contingency-Shaped Masking: Wearing a mask prior to entering a grocery store because one previously contracted COVID-19, suffered severe illness, and acts directly to avoid re-exposure based on that direct physical experience.

Individualization and Self-Management Systems

• Individual History ("The 'I' in Contingency"):
  • No two individuals experience environmental events in the exact same manner.
  • Every person enters a given context with a unique, personal learning history of reinforcement and punishment.
  • Behavioral repertoires are selected, shaped, and maintained by unique personal histories.
  • Behavioral interventions must be tailored individually to accommodate specific stimulus sensitivities and learning histories.
• Self-Management Systems:
  • Definition: The application of a contingency contract wherein the individual whose behavior is targeted actively executes one or more structural components of the contract.
  • The Six Sequential Steps of Self-Management:
    1. Target Selection: Select the specific desired target behavior to increase or undesired target behavior to decrease.
    2. Occasion Identification: Select the specific environmental occasions and contexts when the behavior should or should not occur.
    3. Environmental Modification: Alter the antecedent environment to increase the probability that behavioral goals will be achieved.
    4. Self-Monitoring: Systematically observe, monitor, and record occurrences of the target behavior.
    5. Outcome Selection: Select the specific added reinforcer or outcome for meeting behavioral criteria.
    6. Outcome Delivery: Present or administer the added outcome following performance of the target behavior.

Comprehensive References

• Cooper, J., Heron, T., & Heward, W. (2020). Applied behavior analysis (3rd ed.). Pearson Education, Inc.
• Fisher, W., Piazza, C., & Roane, S. (2011). Handbook of applied behavior analysis. The Guilford Press.
• Malott, R. & Kohler, K. (2021). Principles of behavior (8th ed.). Routledge.