Comprehensive Study Guide to Operant Conditioning, Classical Conditioning, and Behavioral Principles
Administrative Announcements and Course Logistics
Exam Scoring and Grade Rescaling:
Exams originally graded on a scale of questions/points are being rescaled to a total out of points.
The conversion from a scale to a scale produces fractional point values on student records (e.g., ).
Copies of the exam are held by Doctor Summers, Ashlyn, and instructional TAs.
Student bubble sheets detailing individual item responses and missed questions are accessible under the Gradescope tab.
Final Exam Scheduling Correction:
The final exam is officially scheduled for December 15 at 3:30 PM.
An erroneous Canvas syllabus entry indicating December 17 (carried over from a previous semester) has been permanently removed.
Mini Quiz Policies and Structure:
Mini quizzes open at 3:00 PM on the day of administration and close the following day at midnight ().
The quiz duration is strictly and consists of questions (updated from a previous limit per the course syllabus).
Discussion of quiz questions among students is strictly prohibited until after the quiz window has officially closed.
Across the semester, or mini quizzes will be administered, and the lowest quiz scores are dropped from final grade calculations.
Classical Conditioning Recap and Biological Preparedness
Stimulus Generalization and Predictive Value:
Stimulus generalization occurs when a conditioned response is elicited by novel stimuli that share perceptual features with the original conditioned stimulus.
The strength of conditioning depends on predictive reliability; if a conditioned stimulus (e.g., a bell) does not consistently precede an unconditioned stimulus (e.g., food), its predictive value drops, weakening the conditioned response.
Case Study: Arachnophobia Acquisition:
An eight-year-old child putting on shoes at the start of summer break experienced a hairy garden spider jumping out of his shoe.
The child's mother, standing immediately behind him, screamed upon seeing the spider.
Unconditioned Stimulus (UCS): The mother's sudden scream automatically elicits an Unconditioned Response (UCR) of fear and startle in the child.
Conditioned Stimulus (CS): The previously neutral stimulus (the spider) became paired with the UCS (mother's scream).
Conditioned Response (CR): The spider alone elicits fear and startle.
Generalization: Subsequent fear responses were not restricted to the specific garden spider; the fear generalized to all spiders.
Biological Preparedness:
Organisms display evolutionary predispositions (biological preparedness) to form fear responses to certain stimuli (such as spiders or snakes) much more rapidly than to neutral objects.
History and Foundations of Radical Behaviorism
Behaviorism as an Umbrella Framework:
Behaviorism encompasses two distinct primary branches: Classical Conditioning (respondent learning) and Operant Conditioning (instrumental learning).
B. F. Skinner and Radical Behaviorism:
B. F. Skinner expanded upon John B. Watson's behaviorist framework, championing radical behaviorism.
Rejection of Free Will: In his text Beyond Freedom and Dignity, Skinner argued that human free will is an illusion.
Determinism via Conditioning: An individual's personality, identity, and choices represent nothing more than a cumulative history of reinforcement and punishment.
Predictability: Complete knowledge of an organism's total conditioning history would allow perfect prediction of its future actions.
Socio-Legal Implications: Criminal behavior should not be attributed to individual moral fault, as criminals are merely recipients of specific, unfortunate conditioning histories; anyone subjected to the identical history would commit the same crime. Conversely, high achievers (e.g., Olympic gold medalists) should not be praised for personal merit, as their performance is merely the lucky result of specific shaping histories.
Historical Anecdote: Richard Davidson and B. F. Skinner:
In the late 1960s, neuroscientist Richard Davidson arrived as a graduate student at Harvard University's William James Building (Psychology Department).
Davidson entered an elevator, followed immediately by B. F. Skinner. Intimidated, Davidson accidentally pressed the wrong floor button.
Attempting to correct his mistake, Davidson pressed the correct button and muttered under his breath: "Change my mind."
Skinner overheard and corrected him: "No, son. You change your behavior. What is this mind stuff?"
This exchange highlighted the radical behaviorist imperative: unobservable internal mental dialogues are scientifically invalid; only concrete, objective behavior can be observed and modified.
Classical vs. Operant Conditioning
Target Behaviors:
Classical Conditioning: Constrained to reflexive, respondent, implicit, and involuntary behaviors (e.g., eye blinks, nausea, salivation, knee-jerk responses, startle reactions).
Operant Conditioning: Applies to voluntary, flexible, complex, and goal-directed behavioral repertoires.
Temporal Orientation:
Classical Conditioning: Focuses on environmental events paired before the target behavior occurs.
Operant Conditioning: Focuses on environmental consequences occurring after the target behavior takes place.
Cognitive Awareness Effects:
Classical Conditioning: Operates effectively without explicit conscious awareness.
Operant Conditioning: In cognitive human adults, explicit awareness that a third party is manipulating behavior contingencies can undermine or attenuate the conditioning effect. (Works highly effectively in structured educational settings, such as elementary token economies or reading rewards programs like earning free pizza).
Operational Definitions and Mechanics of Operant Conditioning
Core Concepts:
Reinforcement: Any consequence following a behavior that increases the future frequency, probability, or strength of that behavior (represented conceptually by an up arrow ). Whether a consequence acts as a reinforcer is an empirical question depending on individual preference (e.g., candy reinforces one child, whereas additional recess or computer time reinforces another).
Punishment: Any consequence following a behavior that decreases the future frequency, probability, or strength of that behavior (represented conceptually by a down arrow ).
Positive (): The addition or application of a stimulus following a behavior.
Negative (): The subtraction or removal of a stimulus following a behavior.
The Four Operant Quadrants:
Positive Reinforcement: Adding an appetitive (pleasant) stimulus following a behavior to increase that behavior.
Lab Example: A rat in an operant chamber (Skinner Box) presses a lever/bar and receives food or water.
Human Example: A parent gives a child ice cream for completing homework.
Negative Reinforcement: Removing an aversive (unpleasant) stimulus following a behavior to increase that behavior.
Lab Example: A rat presses a lever in a Skinner Box to turn off or escape an active electric shock.
Human Example: A parent waives a child's weekly chore obligations (e.g., taking out garbage, washing dishes) as a reward for studying.
Health Example: Taking an aspirin to eliminate an unpleasant headache. The behavior of taking aspirin increases because it removes the aversive stimulus (headache pain).
Positive Punishment: Adding an aversive (unpleasant) stimulus following a behavior to decrease that behavior.
Lab Example: A rat presses a lever and receives an electric shock, decreasing future lever pressing.
Human Example: A parent assigns extra unpleasant chores (e.g., picking up trash, washing dishes) to a teenager who breaks curfew.
Diagnostic Distinction: Inflicting pain or discomfort (e.g., squirting water in someone's face, pulling adhesive tape off skin) represents positive punishment because an aversive sensation is applied, not negative reinforcement.
Negative Punishment: Removing an appetitive (pleasant) stimulus following a behavior to decrease that behavior.
Lab Example: A rat presses a lever, resulting in the removal of access to food.
Human Example: A parent revokes a teenager's cell phone or car driving privileges for a week after breaking curfew.
Diagnostic Algorithm for Operant Identification:
Assess Behavior Trajectory: Is the behavior increasing or intended to increase ($ ightarrow$ Reinforcement) or decreasing/intended to decrease ($ ightarrow$ Punishment)?
Assess Stimulus Manipulation: Is a stimulus being applied/added ($ ightarrow$ Positive) or removed/withdrawn ($ ightarrow$ Negative)?
Media Misconceptions of Operant Conditioning
Misconception Prevalence:
The distinction between negative reinforcement and punishment is widely documented as the single most misunderstood concept in introductory psychology, frequently misconstrued by both the general public and popular media.
The Big Bang Theory Analysis:
Sheldon Cooper uses chocolates as positive reinforcement to shape Penny's behavior (e.g., leaving the room to take calls, lowering voice pitch), citing operant principles developed by Edward Thorndike and B. F. Skinner.
Leonard Hofstadter incorrectly refers to squirting Penny with water as "negative reinforcement." Squirting water adds an aversive stimulus to reduce behavior, which is Positive Punishment.
Media Correction: In a subsequent episode, the show's writers formally corrected the error, explicitly stating that using pain/tape removal to eliminate unwanted behavior is positive punishment, not negative reinforcement.
Ghostbusters Analysis:
In the opening scene, Bill Murray's character incorrectly refers to administering electric shocks to human subjects during an ESP test as "negative reinforcement." Because shocks are aversive stimuli applied to decrease incorrect responses, the procedure is positive punishment.
Schedules of Partial and Continuous Reinforcement
Continuous Reinforcement:
Mechanism: Reinforcement is delivered after every single instance of the target behavior.
Primary Application: Essential for shaping brand-new behaviors through successive approximations (reinforcing small incremental steps toward a final complex behavior).
Vulnerability: Highly susceptible to rapid extinction once the continuous reinforcer is withheld.
Partial (Intermittent) Reinforcement:
Mechanism: Reinforcement is delivered for some, but not all, instances of the target behavior.
Primary Application: Maintains established behaviors long-term.
Characteristics: Behavioral acquisition occurs more slowly than continuous schedules, but the resulting behavior is vastly more resistant to extinction.
Accidental Intermittent Reinforcement: Parents who repeatedly say "no" to a child's grocery store tantrum but eventually yield to an escalated outburst inadvertently place tantrums on an intermittent schedule, making the behavior exceptionally resistant to extinction. The same dynamics apply to pets begging for food or dogs stealing socks to receive treats.
The Four Intermittent Reinforcement Schedules:
Fixed Ratio (FR):
Reinforcement occurs after a fixed, set number of responses.
Examples: A rat receives a pellet after every lever presses (); buy--get--free retail loyalty cards.
Fixed Interval (FI):
Reinforcement occurs for the first response made after a fixed, set duration of time has elapsed.
Examples: A rat is reinforced for the first lever press occurring after has passed.
Behavioral Signature: Produces a "scalloped" response pattern where response rates drop to near zero immediately after reinforcement and surge sharply right before the time window expires.
Variable Ratio (VR):
Reinforcement occurs after an unpredictable, varying number of responses that average out to a target number ().
Examples: A rat receives reinforcement after presses, then , then , then (averaging ).
Behavioral Signature: Produces high, steady, highly uniform response rates. Represents the stickiest schedule (most resistant to extinction).
Real-World Application: Casino slot machines utilize variable ratio schedules, keeping players engaged continuously because any single press could yield a reward.
Variable Interval (VI):
Reinforcement occurs for the first response made after an unpredictable, varying duration of time that averages out to a target time interval.
Examples: A rat is reinforced for lever pressing on an average interval (e.g., individual intervals of , , , ).
Real-World Application: Tapping feet or re-pressing elevator call buttons while waiting for an elevator to arrive.
Evaluative Comparison of Punishment vs. Reinforcement
Efficacy Comparison:
Reinforcement approaches modify behavior far faster, more effectively, and more durably than punishment strategies in both humans and non-human animals.
Traditional punishments (such as telling a child to "go to your room and think about what you did") have a near success rate, typically causing the individual to ruminate on the injustice of the punishment rather than behavioral modification.
Five Major Flaws of Punishment:
Behavioral Suppression vs. Elimination: Punishment suppresses behavior only while the punishing agent or setting is present; the behavior reappears once the threat is removed.
Lack of Direction: Punishment signals what not to do, but fails to instruct or teach desirable replacement behaviors.
Conditioned Fear: Punishment induces negative emotional reactions and conditioned fear directed toward the person administering the punishment.
Satiation/Override by Rewards: Competing environmental rewards (e.g., staying out past curfew to remain with romantic partners or peers) frequently overpower the threat of punishment.
Modeling Aggression: Punitive measures model and legitimize physical or verbal aggression as an acceptable method for resolving interpersonal problems.
Requirements for Effective Punishment (If Employed):
Reasonable: Must be proportional to the behavioral infraction.
Legitimately Unpleasant: Must be genuinely perceived as aversive by the recipient (e.g., sending a child who desires isolation on their phone to their room fails as a punishment).
Immediate: Must follow the undesirable behavior instantly; increasing temporal delays drastically reduces efficacy.
Reframing Punishment into Positive Reinforcement:
Instead of framing contingencies negatively ("If you are not out of bed by 7:30 AM, you lose iPad privileges tonight"), contingencies should be reframed positively ("If you are out of bed and ready for school by 7:30 AM, you earn iPad access tonight"). Reinforce the desired alternative behavior directly.
Functional Behavioral Analysis (FBA) in Education:
1998 Federal Mandate: School systems are prohibited from placing misbehaving students directly into special education without a formal Functional Behavioral Analysis conducted by a school psychologist.
Operant Premise: Persistent misbehavior is maintained by an unrecognized environmental reinforcer.
Classroom Dynamics Example: A child acting out in class is repeatedly sent to the principal's office. If the child experiences parental neglect or lack of attention at home, adult attention—even punitive scolding from teachers or principals—acts as positive reinforcement.
FBA Intervention: Identify the hidden maintaining reinforcer (attention) and alter classroom contingencies so adult attention positively reinforces desirable behavior instead.
Final Operant Evaluation Example:
Scenario: An operant chamber plays a loud, aversive noise. A rat presses a bar, and the loud noise instantly stops.
Classification: Negative Reinforcement (removal of an aversive auditory stimulus following the bar-press behavior increases the probability of bar pressing in the future).