12th CLASS PSY Operant and Classical Conditioning Principles

Foundations of Conditioning: Classical vs. Operant Conditioning

• Classical Conditioning Overview:

  • Involves forming an association between two stimuli.

  • Controls involuntary behaviors (automatic physiological or emotional responses).

  • Conditioning does not involve teaching or commanding an voluntary action (e.g., a dog is not instructed or taught to salivate; salivation occurs involuntarily as a direct physiological reaction to a stimulus).

• Operant Conditioning Overview:

  • Serves as the foundation for analyzing behavioral consequences and predictions.

  • Operates on the principle: $\text{Behavior} \rightarrow \text{Consequence} \rightarrow \text{Prediction of Future Behavior}$.

  • Individual behavior is evaluated based on whether the resulting consequence or obstacle is favorable or unfavorable, which directly determines whether the behavior will increase or decrease in frequency.

• Experimental Chamber Methodology:

  • Early empirical studies utilized an experimental apparatus known as a chamber (commonly referred to as an ear box).

  • Subjects studied in these chambers include animals such as fidgets and rats.

  • Experimental design: Animals are placed inside the chamber equipped with a lever or bar. When the subjects press the lever or bar at the correct time, a reinforcer (such as food) is delivered to reinforce the behavior.

The Reinforcement and Punishment Framework

• Core Rule of Operant Terminology:

  • Value judgements such as "good" or "bad" must be entirely removed when analyzing reinforcement and punishment.

  • Terminology reflects strictly functional effects on behavior frequency and the nature of stimulus change.

• Directional Behavioral Goals:

  • Reinforcement: Any procedure or stimulus modification that increases the probability or frequency of a behavior.

  • Punishment: Any procedure or stimulus modification that decreases the probability or frequency of a behavior.

• Stimulus Operations:

  • Positive ($+$): The addition or presentation of a stimulus following a behavior.

  • Negative ($-$): The removal or subtraction of a stimulus following a behavior.

• The Four Quadrants of Operant Conditioning:

  • Positive Reinforcement: Adding an agreeable stimulus to increase a behavior.

  • Negative Reinforcement: Removing an unpleasant stimulus to increase a behavior.

  • Positive Punishment: Adding an unpleasant stimulus to decrease a behavior.

  • Negative Punishment: Removing an agreeable stimulus to decrease a behavior.

Deep Dive: Types of Reinforcement and Real-World Applications

• Positive Reinforcement Details:

  • Mechanism: A desirable stimulus is presented contingent on a response, strengthening that response.

  • Examples:

  • Earning $10.00 for mowing the lawn.

  • Receiving monetary compensation at a job (employment behavior persists due to positive reinforcement; without payment, attendance ceases).

  • Awarding medals or trophies at the conclusion of an athletic competition.

  • Giving a treat to a dog immediately after it executes a desired trick.

  • Verbal praise from a sports coach ("good job") following athletic performance.

  • Physical body changes seen months after starting a gym routine, driving continued gym attendance.

• Negative Reinforcement Details:

  • Mechanism: An unpleasant or aversive stimulus is removed or terminated contingent on a response, strengthening that response.

  • Examples:

  • Automobile Seatbelt Chime: Vehicle systems emit an annoying repetitive beep when a seatbelt is unbuckled. Buckling the seatbelt removes the unpleasant acoustic stimulus, thereby increasing seatbelt-buckling behavior.

  • Preemptive Chores: Taking out the trash before parents begin nagging or complaining removes or prevents the unpleasant verbal stimulus, increasing prompt cleaning behavior.

• Academic vs. Workforce Transition Dynamics:

  • Academic Setting: Characterized by frequent, short-interval positive reinforcement (e.g., submitting a paper and receiving an A, direct positive feedback, constant performance validation).

  • Workplace Setting: Reinforcement structures shift significantly. While salary serves as a positive reinforcer, pay schedules are spaced out (non-daily) and often fixed regardless of whether performance is exceptional or mediocre.

  • Impact on High Achievers: Individuals accustomed strictly to high-frequency external academic reinforcement may experience adjustment difficulties in professional environments where external praise is minimal and compensation remains constant. Success requires cultivating internal goals (e.g., aiming for promotions or advanced degrees).

Primary vs. Secondary Reinforcers

• Primary Reinforcers (Unconditioned Reinforcers):

  • Biologically rooted reinforcers that do not require prior learning or instruction to establish their value.

  • Essential for biological survival and physical comfort.

  • Examples: Food, water, shelter/safe living conditions, and pain alleviation.

  • Biological signaling example: An injured or broken arm naturally produces pain upon movement, directly suppressing movement without requiring external instruction.

  • Economic overlap: Employment often links to primary reinforcement because income is required to secure basic needs like food and rent payment.

• Secondary Reinforcers (Conditioned Reinforcers):

  • Neutral stimuli that acquire reinforcing value through learning, conditioning, and association with primary reinforcers.

  • Examples: Money, academic grades, certificates, and social tokens.

  • Development Demonstration in Children:

  • A 3-year-old presented with a $1.00 bill versus a $20.00 bill lacks understanding of monetary value and cannot select based on economic worth.

  • Given a choice between a $20.00 bill and 5 shiny quarter coins, young children routinely choose the 5 quarters due to visual quantity, tactile properties, and sound.

  • Preschoolers presented with an "A" grade versus an arbitrary letter (e.g., "K" or the initial of their first name) will select the letter associated with their name because academic grades carry no inherent value until learned.

Behavioral Shaping and Step-by-Step Acquisition

• Definition of Shaping:

  • The method of successively reinforcing closer approximations of a target complex behavior until the target behavior is fully established.

  • Complex behaviors rarely occur fully formed instantly; acquisition occurs incrementally step-by-step.

• General Examples of Shaping:

  • Reading: Mastered by learning individual letters, learning letter sounds, forming single words, combining words into sentences, and eventually reading whole novels.

  • Musical Performance: Mastered by learning basic notes and finger placement before playing complete musical pieces.

  • Bicycle Riding: Transitioning from riding with training wheels accompanied by praise to independent two-wheel riding.

• Developmental Example: Infant Walking:

  1. Step 1: Infant pulls up to stand while holding onto furniture. Parents respond with high enthusiasm, applause, and verbal praise ("woo", "you did it").

  2. Step 2: Standing while holding support becomes routine. Praise is withheld until the infant lets go of support.

  3. Step 3: Infant takes an initial unsupported step forward when prompted ("come"). Praise is delivered.

  4. Step 4: Full unassisted walking is established and reinforced.

  5. Maintenance: Adults no longer receive external praise for walking, tying shoes, or traveling to school, as reinforcement thresholds shift across developmental milestones (e.g., grade school alphabet memorization $\rightarrow$ college laboratory performance $\rightarrow$ undergraduate GPA for graduate admissions).

• Animal Training Example: Dog Rolling Over:

  1. Reinforce the dog for performing a initial stationary stop.

  2. Reinforce partial body tilting or flipping.

  3. Withhold reinforcement until a complete $360^\circ$ roll is executed.

Reinforcement Schedules: Continuous, Partial, Ratio, and Interval

• Continuous Reinforcement:

  • Delivery of a reinforcer after every single correct response.

  • Results in rapid learning/acquisition of behavior.

  • Highly vulnerable to rapid extinction once reinforcement stops.

  • Vending Machine Example: Inserting $1.00 into a vending machine yields a snack item. If the machine fails to deliver a snack upon payment twice in a row, the behavior immediately stops because reinforcement ceased.

• Partial (Intermittent) Reinforcement:

  • Delivery of a reinforcer after some, but not all, correct responses.

  • Results in slower initial acquisition but demonstrates significantly greater resistance to extinction.

  • Gambling / Slot Machine Example: Pulling a lever on a slot machine yields payouts unpredictably. Absence of a reward on any given attempt does not extinguish the behavior because the individual maintains the expectation that subsequent attempts may produce a payout.

  • Fishing Example: Anglers can spend an entire afternoon without catching a fish yet consistently return for future trips due to the unpredictable schedule of reward.

• Dimensional Breakdown of Reinforcement Schedules:

  • Ratio: Reinforcement depends on the number of responses executed.

  • Interval: Reinforcement depends on the passage of time.

  • Fixed: Requirements are predictable and constant.

  • Variable: Requirements are unpredictable and changing.

• The Four Intermittent Schedules:

  • Fixed Ratio (FR):

  • Reinforcement occurs after a set, predetermined number of responses.

  • Example: Receiving a free cup of coffee after making 10 purchases; earning a financial bonus for every 5 major sales closed.

  • Fixed Interval (FI):

  • Reinforcement occurs for the first response after a set, predetermined time period has elapsed.

  • Behavioral pattern: Response rate drops immediately post-reinforcement and surges sharply as the deadline/interval endpoint approaches.

  • Example: Studying intensity dramatically increasing as a weekly scheduled exam (occurring every 7 days) approaches.

  • Variable Ratio (VR):

  • Reinforcement occurs after an unpredictable, varying number of responses.

  • Yields the highest response rates and the strongest resistance to extinction due to the persistent possibility that the next response yields the reward.

  • Examples: Slot machines, checking smartphone notifications/likes, digital media algorithm feeds designed with variable reward mechanics (mixing content hits and misses to drive perpetual scrolling).

  • Variable Interval (VI):

  • Reinforcement occurs for the first response after unpredictable, varying time intervals pass.

  • Yields steady, moderate response rates.

  • Example: Periodically checking an inbox for incoming emails.

Extinction, Extinction Bursts, and Behavioral Persistence

• Process of Extinction:

  • Occurs when reinforcement is permanently disconnected from a previously reinforced behavior, resulting in a gradual decrease and ultimate cessation of that behavior.

• Extinction Burst Phenomenon:

  • The temporary, dramatic increase in frequency, duration, and intensity of a behavior immediately following the termination of reinforcement.

  • An individual or animal amplifies response efforts to test if former reinforcement parameters are still active.

• Child Tantrum Mechanics:

  • Baseline: A child's crying in a store was previously positively reinforced by receiving candy.

  • Extinction Implementation: A parent decides to stop giving candy when the child cries.

  • Extinction Burst Response: Instead of immediately stopping, the child cries significantly louder, lasts longer, and throws a physical tantrum on the floor.

  • Critical Failure Condition: If the parent surrenders during the extinction burst and delivers the candy due to exhaustion or distress, the parent inadvertently reinforces the extreme tantrum behavior.

  • Consequence of Surrender: The child learns that escalation, louder screaming, and severe tantrums are required to obtain candy, rendering the behavior even more persistent and resistant to future extinction.

Mechanics and Limitations of Punishment

• Inherent Limitation of Punishment:

  • Punishment signals what behavior not to perform, but completely fails to teach or demonstrate the alternative desired behavior.

  • Punishment applied in isolation is insufficient for long-term behavioral change; it must always be paired with explicit instruction and positive reinforcement of acceptable alternative behaviors.

• Determinants of Punishment Effectiveness:

  • Immediacy: Punishment must occur instantly following the unwanted behavior.

  • Consistency: Punishment must be applied reliably every single time the unwanted behavior occurs.

  • Intensity: The severity level of the stimulus (though high intensity risks severe side effects).

• Adverse Effects of Harsh / Physical Punishment:

  • Generates fear and generalized avoidance of the person administering punishment.

  • Increases contextual aggression.

  • Serves as a social model for violent or aggressive problem-solving.

  • Empirical research confirms physical punishment does not teach constructive functional alternatives to children.

Questions & Self-Assessment Review

• Scenario 1: A student answers a classroom question and receives teacher praise, increasing the likelihood of future participation.

  • Classification: Positive Reinforcement (adding a positive stimulus—praise—to increase target behavior—participation).

• Scenario 2: An employee arrives late repeatedly and receives a formal written reprimand/warning in their file.

  • Classification: Positive Punishment (adding an unpleasant stimulus—written reprimand—to decrease target behavior—tardiness).

• Scenario 3: A real estate agent or salesperson receives a financial bonus after closing every 5th property sale.

  • Classification: Fixed Ratio Schedule (reinforcement delivered predictably based on a set number of completed responses, $N = 5$).

• Diagnostic Checklist for Behavioral Analysis:

  1. Identify Target Behavior: Is the goal to increase or decrease the behavior frequency?

  • Increase = Reinforcement

  • Decrease = Punishment

  1. Identify Stimulus Operation: Is a stimulus being introduced or removed following the behavior?

  • Addition = Positive ($+$)

  • Removal = Negative ($-$)