Comprehensive Study Guide: Behaviorist Principles and Theories of Learning

Basic Assumptions in Behaviorism

• Definition: Behaviorism is a collection of theories focusing on the relationship between environmental stimuli and observable responses. Historically, it emerged as an objective alternative to introspection.

• Equipotentiality: The assumption that principles of learning apply equally to different behaviors and physical species. Behaviorists often use the term "organism" to refer to any animal species, including human beings, and apply research from rats and pigeons to human learning.

• Objectivity and S-R Psychology: Psychologists focus on environmental stimuli ($S$) and the responses ($R$) that organisms make. Because internal mental processes (thoughts, motives) cannot be directly observed, they are often excluded from research explanations.

• Black Box Perspective: Radical behaviorists view the organism as a "black box" where stimuli go in and responses come out, but the internal workings remain a mystery.

• Neobehaviorism: A variation ($S-O-R$ theories) that considers factors within the organism ($O$), such as motivation or strength of association, as essential for understanding behavior.

• Learning as Behavior Change: Behavioral theories define learning as a long-term change in behavior. Although some modern behaviorists acknowledge cognitive factors, they traditionally maintain that learning has occurred only when it is visible in actions.

• Tabula Rasa (Blank Slate): Organisms enter the world without predispositions, aside from basic biological instincts. A unique set of environmental experiences "writes" a unique set of behaviors on the individual.

• Environmental Determinism: Early behaviorists like B. F. Skinner proposed that behaviors are the result of past experiences and current circumstances. If we had complete knowledge of an organism's history, we could theoretically predict its next response with $100\%$ accuracy.

• Parsimony: Behaviorists prefer the simplest possible explanations for all behaviors, whether simple or complex.

Classical Conditioning

• Ivan Pavlov's Discovery: While studying digestion in dogs, Pavlov noticed they salivated at the sight of a lab assistant even before seeing meat powder. He summarized this in his book Conditioned Reflexes (1927).

• The Three-Step Process:

  • Step 1: Identify Neutral Stimulus (NS): A stimulus the organism does not respond to (e.g., a bell).

  • Step 2: Pairing with Unconditioned Stimulus (UCS): The NS is presented just before the UCS (e.g., meat powder), which naturally elicits an Unconditioned Response (UCR) (e.g., salivation).

  • Step 3: Formation of Conditioned Stimulus (CS): After pairing, the NS becomes a CS that elicits a Conditioned Response (CR) (e.g., salivation at the bell alone).

• Examples in Human Learning:

  • Aversions: Developing a distaste for creamy cucumber dressing ($CS$) after associating it with pregnancy nausea ($UCS$).

  • Phobias (Little Albert): Watson and Rayner (1920) conditioned an 11-month-old infant to fear white rats by striking a steel bar (loud noise, $UCS$) whenever he touched the rat ($NS$). After seven pairings, Albert cried and crawled away when seeing the rat ($CS$).

  • Attitudes: Pokémon characters associated with pleasant images (puppies) were rated higher ($+4$) than those paired with cockroaches ($-4$). This explains why commercials pair products with adorable children or loving couples.

• Physiological Counter-responses: Certain drugs ($UCS$) cause responses like hypoglycemia. Environmental cues ($CS$) can elicit the opposite response (hyperglycemia) as the body prepares to counteract the drug, leading to drug tolerance and addiction.

Common Phenomena in Classical Conditioning

• Contingency: Classical conditioning is most likely to occur when the $CS$ serves as a signal that the $UCS$ is coming (signal learning), typically appearing about half a second before the $UCS$.

• Extinction: The disappearance of the $CR$ when the $CS$ is repeatedly presented without the $UCS$.

• Spontaneous Recovery: The reappearance of an extinguished $CR$ after a rest period. The recovered response is usually weaker and extinguishes more quickly.

• Generalization: Responding to stimuli similar to the $CS$. Little Albert generalized his fear from a white rat to a dog, a rabbit, a sealskin coat, and a fuzzy-bearded Santa Claus mask.

• Stimulus Discrimination: Learning to respond only to a specific stimulus ($CS+$) while not responding to a different one ($CS-$) because it was never paired with the $UCS$.

• Higher-Order Conditioning: A process where a second neutral stimulus ($NS2$) becomes a conditioned stimulus ($CS2$) by being paired with an existing $CS1$. For example, a student might fear school ($CS2$) because it is associated with tests ($CS1$), which were associated with failure-induced punishment ($UCS$).

Eliminating Unproductive Classically Conditioned Responses

• Counterconditioning: Overpowering an existing $CS-CR$ association with a different, stronger association involving an incompatible response.

• Mary Cover Jones's Study: She cured "Little Peter's" fear of rabbits by giving him candy (eliciting happiness) and gradually moving the rabbit closer in each session over two months.

• Systematic Desensitization: A therapeutic technique where an anxious person relaxes while imagining increasingly stressful scenarios (or using virtual reality goggles) to replace anxiety with relaxation.

  • Note: Treating test anxiety without improving academic skills may not yield higher test scores.

Operant Conditioning

• Edward Thorndike's Law of Effect: Based on studies of cats in a "puzzle box," Thorndike concluded that responses followed by satisfaction are strengthened, while those followed by discomfort are weakened. He later revised this to deemphasize the effectiveness of punishment.

• B. F. Skinner's Principles: Skinner moved beyond Thorndike by developing the "Skinner box" for rats and pigeons. He defined operant conditioning: A response followed by a reinforcer is strengthened and likely to occur again.

• Reinforcer vs. Reward: Skinner preferred "reinforcer" because it is defined objectively by its effect on behavior (an increase in frequency), avoiding subjective judgments of "pleasantness."

• Contrast with Classical Conditioning:

  • Classical: Association between two stimuli ($S-S$); involuntary/automatic responses; the stimulus elicits the response.

  • Operant: Association between response and consequence ($R-S^{Rf}$); voluntary behaviors; the organism emits the response.

Conditions for Operant Conditioning

• Sequence: The reinforcer must follow the response (e.g., instructors promising an A on day 1 often saw decreased attendance).

• Immediacy: Reinforcement must follow the behavior immediately to ensure the correct response is reinforced (e.g., Ethel the pigeon inadvertently learned to spin because the experimenters waited too long after her disk-peck).

• Contingency: The reinforcer must be provided only after the desired response has occurred.

Forms That Reinforcement Might Take

• Primary Reinforcers: Satisfy biological/built-in needs (food, water, warmth, physical affection, smiles).

• Secondary (Conditioned) Reinforcers: Neutral stimuli that become reinforcing through association with other reinforcers (praise, good grades, money).

• Positive Reinforcement: Presentation of a stimulus.

  • Material: Actual objects like toys or food.

  • Social: Smiles, attention, or positive regard from teachers/peers.

  • Activity (Premack Principle): Using high-frequency (enjoyed) behaviors to reinforce low-frequency (less-preferred) ones (e.g., finishing housework before reading a mystery novel).

  • Token: Accumulating items (chips, stickers) to "purchase" privileges.

  • Positive Feedback: Communicating mastery or progress. Effective when it guides improvement.

  • Intrinsic: Internal feelings of success, pride, or mastery.

• Negative Reinforcement: Increase in a response via the removal of an aversive stimulus.

  • Escape Behaviors: Learning to get away from aversive stimuli (e.g., making excuses to avoid homework, lying to escape trouble).

  • Teacher Example: Ms. Taylor yells at Ethan; Ethan stops talking, which negatively reinforces Ms. Taylor's yelling.

Common Phenomena in Operant Conditioning

• Superstitious Behavior: Resulting from non-contingent (random) reinforcement (e.g., Skinner's pigeons performing pendulum movements after being fed at regular intervals regardless of their behavior).

• Shaping (Successive Approximations): Gradually reinforcing closer and closer versions of a target behavior (e.g., children moving from printing large letters on wide-lined paper to small letters on single lines).

• Chaining: Learning a sequence of responses.

  • Forward Chaining: Reinforcing the first step then adding the next (e.g., Somjai the elephant painting: holding the brush, then drawing the back, then the head).

  • Backward Chaining: Reinforcing the final step and working backward (e.g., a chicken hitting a bat and running bases to find food).

• Extinction: A decrease in response frequency when reinforcement is removed.

  • Extinction Burst: A brief spike in the behavior's frequency when extinction first begins.

Effects of Reinforcement Schedules

• Continuous Reinforcement: Every response is reinforced. Leads to fast acquisition but rapid extinction.

• Intermittent Reinforcement: Only some responses are reinforced. Leads to slower acquisition but high resistance to extinction.

• Ratio Schedules:

  • Fixed-Ratio (FR): Reinforcement after a constant number of responses ($1:3$, $1:50$).

  • Variable-Ratio (VR): Reinforcement after a changing average of responses (e.g., Margaret's persistence in begging for quarters, slot machines). Recommended for high response rates.

• Interval Schedules:

  • Fixed-Interval (FI): Reinforcement for the first response after an exact time period ($5\text{ minutes}$). Results in a "scallop" pattern (goof-off-now-and-cram-later).

  • Variable-Interval (VI): Reinforcement for the first response after an unpredictable average of time (e.g., checking email, pop quizzes). Leads to a slow, steady response rate.

• Differential Schedules:

  • DRH (High Responding): Reinforcement only if many responses occur in a short time.

  • DRL (Low Responding): Reinforcement only for low rates or long delays (e.g., waiting for a flooded engine to clear, teaching a student not to over-rely on teacher help).

Effects of Antecedent Stimuli and Behavioral Momentum

• Discriminative Stimulus ($S+$): A stimulus that sets the occasion for a response to be reinforced. The presence of an $S+$ puts the organism under stimulus control.

• Cueing: Providing signals (flashing lights, verbal prompts) to let students know how to behave.

• Setting Events: Environmental conditions (e.g., furniture arrangement, specific toys) that make behaviors more likely.

• Generalization: Transference of response behaviors from one $S+$ to a similar situation (e.g., hand-raising in kindergarten generalizes to first grade).

• Discrimination ($S+$ and $S-$): Learning to identify which environments reinforce a behavior and which do not (e.g., students knowing they can ask questions when a teacher wears a green lei and cannot when they wear a purple one).

• Behavioral Momentum: Increased likelihood of a desired response when the learner is already making similar, easier ones (e.g., giving simple one-digit multiplication problems before hard three-digit ones).

Avoidance Learning

• Definition: Learning to stay away from an aversive stimulus following a pre-aversive stimulus (cue of impending doom).

• Active Avoidance: Making a specific response to avoid the event (e.g., studying to avoid a failing grade).

• Passive Avoidance: Avoiding an event by not behaving in a certain way (e.g., math-anxious students never signing up for statistics).

• Extinction Challenge: Avoidance behaviors are difficult to extinguish because the organism never stays in the situation long enough to find out the threat is gone.

Punishment

• Punishment I (Positive Punishment): Presentation of an aversive stimulus (scolding, failing grade).

• Punishment II (Negative Punishment): Removal of a pleasant stimulus (grounding, monetary fines).

• Effective Forms:

  • Verbal Reprimands: Best when brief, immediate, quiet, and spoken in close proximity.

  • Restitution and Overcorrection: Logical consequences (paying for a broken window) or practicing the correct behavior (walking instead of running).

  • Time-out: Short periods (2–10 minutes) without reinforcement. Only works if class activities are actually reinforcing.

  • Response Cost: Withdrawal of a previously earned reinforcer (losing a privilege or paying a fine).

• Ineffective Forms:

  • Physical Punishment: Models aggression and leads to truancy or resentment.

  • Psychological Punishment: Humiliation that deflates self-esteem and motivation.

  • Extra Classwork: Communicates that schoolwork is unpleasant.

  • Out-of-School Suspension: Often negatively reinforcing for struggling students who want to escape school.

Questions & Discussion

• Case Study: Andrea: A 7-year-old with hearing loss performed an average of $72$ pinches or bites per day. Shouting "No!" (Punishment I) nearly eliminated the behavior.

• Michael's Cursive: Michael struggled with handwriting for weeks. Progress occurred only when his teacher constructed a graph to track his mastered letters (positive feedback), enabling him to write all $26$ letters for $3$ straight days.

• Tina's Curfew: The author's daughter, Tina, used a doll head and blanket to sneak out. Being grounded for $2\text{ weeks}$ for each infraction (Punishment II) eventually improved her curfew adherance.

• Cognitive Shift: Contemporary behaviorists acknowledge that conditioning often involves internal mental representations (forming categories like "cats" vs. "chairs") and expectations about outcomes.