PSYCH 1101: Operant Conditioning Notes

Operant Conditioning Foundations and Principles

  • Operant conditioning was developed by B.F. Skinner (1904–1990).
  • Operant Conditioning Definition: A form of learning in which behavior is impacted due to its consequences. Certain behaviors lead to specific consequences.
  • Thorndike's Law of Effect:
    • If a behavior is followed by a "satisfying effect", the behavior is more likely to be repeated.
    • If a behavior is followed by a "discomforting effect", the behavior is less likely to be repeated.

The Operant Conditioning Matrix

  • Operant conditioning procedures are categorized based on whether the goal is to increase or decrease a behavior, and whether a stimulus is added or removed:
    • Reinforcement: Aimed at increasing or strengthening a behavior.
    • Positive Reinforcement: Something added (positive) to increase or strengthen behavior.
    • Negative Reinforcement: Something taken away/removed (negative) to increase or strengthen behavior.
    • Punishment: Aimed at decreasing or weakening a behavior.
    • Positive Punishment: Something added (positive) to decrease or weaken behavior.
    • Negative Punishment: Something taken away/removed (negative) to decrease or weaken behavior.

Operant Conditioning Reinforcement and Punishment Matrix

Types of Reinforcers

  • Primary Reinforcers: Reinforcers that are innately desired because they fulfill a biological need.
  • Secondary Reinforcers: Reinforcers that are associated with primary reinforcers and are not inherently desired on their own.

Operant Extinction and Extinction Bursts

  • Operant Extinction: If a consequence stops following a behavior, the conditioning stops.
  • Extinction Burst: When a consequence is removed, the targeted behavior temporarily increases in duration, intensity, and/or frequency before eventually fading.
    • Example: Texting someone constantly after being ghosted to get their attention.

Behavioral Shaping

  • Shaping: A procedure in which reinforcement gradually guides an organism's actions toward a desired behavior.

Efficacy and Implications of Punishment

  • Effectiveness: Punishment can powerfully change behavior; however, the underlying behavior is NOT replaced.
  • Mandatory Usage Guideline: Punishment MUST be used in tandem with reinforcement.
  • Physical Punishment and Spanking:
    • Spanking is used as discipline, but major professional organizations such as the American Psychological Association (APA) and the American Academy of Pediatrics (AAP) have official policies against physical punishment.
    • Physical punishment will stop behavior in the short-term, but it has severe negative long-term effects.
    • Long-Term Effects: Increased aggression, behavior problems, poor parent-child relationships, and poor mental health.

Observational Learning and Social Learning Theory

  • Observational Learning: Learning that occurs through watching others.
  • Social Learning Theory: Developed by Albert Bandura (1925–Present).
  • Modeling: The process of observing and imitating behavior.
    • Example: Learning how to serve in pickleball via a TikTok tutorial.

Types of Modeling

  • Live Modeling: Direct demonstration of a behavior.
  • Verbal Modeling: Description or explanation of a behavior in words.
  • Symbolic Modeling: Behavior demonstrated by someone in media.

Steps in Observational Learning

  1. Attention: Noticing and attending to the model. Identifying with the model leads to increased attention.
  2. Retention: Remembering what the model did.
  3. Reproduction: Having to attempt to copy the behavior.
  4. Motivation: The want or desire to do the behavior.
    • Motivation is influenced by observed consequences:
      • Vicarious Reinforcement: Increases desire and motivation to perform the behavior.
      • Vicarious Punishment: Decreases desire and motivation to perform the behavior.
    • After imitation occurs, direct reinforcement or direct punishment also affects ongoing motivation.

Bandura's Bobo Doll Experiment

  • Aim: Showcased the relationship between observational learning and media violence.
  • Findings: Children imitated an adult model by beating up a Bobo Doll when left alone in a room.
  • Consequence Effect: Children were significantly more likely to imitate the behavior if the adult model was rewarded or experienced no consequences, compared to when the adult model was punished.
  • Model Consistency: This pattern held true whether using a live model or a symbolic model.
  • Media Connection: Media frequently contains violent images where acts of violence are left unpunished or are even rewarded.

Media Violence and Aggression

  • Short-Term Impact: Media violence directly increases short-term aggression (YES).
  • Long-Term Impact:
    • There is a strong correlation between the amount of violence watched and aggression exhibited at school and home in children and teenagers.
    • Higher exposure correlates with increased violent crimes as adults.
    • Longitudinal studies confirm that media violence exposure predicts aggression in adults.
  • Methodological Note: A distinction must be maintained between cause and correlation.

Cognition, Problem-Solving, and Cognitive Systems

  • Cognition: Mental activity associated with thinking, communicating, and remembering.
  • Problem-Solving: A process of cognition that occurs when a goal must be reached by thinking and behaving in certain ways.

Methodologies in Problem-Solving

  • Algorithm: A precise set of rules applied in order to solve a problem.
    • Characteristics: Slow and takes a lot of effort, but guarantees an exact solution.
  • Heuristics: Quick cognitive strategies and mental shortcuts used to solve problems quickly while expending little effort.
    • Characteristics: Fast, but much more likely to be wrong.

Dual-Process Theory: System 1 vs. System 2

  • System 1:
    • Fast, subconscious, automatic, used for everyday decisions, and error-prone.
    • Active mostly in daily life.
    • Produces more cognitive flaws.
  • System 2:
    • Slow, conscious, effortful, used for complex decisions, and reliable.
    • Takes deliberate effort to activate.

Cognitive Heuristics and Biases

  • Availability Heuristic: The tendency to estimate the likelihood or importance of something based on how easily we can think of an example.
  • Representative Heuristic: The assumption that any object or individual sharing characteristics with the members of a particular category is also automatically a member of that category.
    • Forms the cognitive basis for stereotypes.
  • Anchoring Heuristic: The tendency to focus disproportionately on the first piece of information encountered when problem-solving or assessing value.
    • Example: Seeing an initial price tag of 500500 reduced to 350350 creates an anchor where 350350 is perceived as an exceptional deal ("What a deal!").

Cognitive Obstacles in Problem-Solving

  • Mental Set: The tendency to only see or try solutions that have worked in the past.
  • Functional Fixedness: A specific type of mental set where an individual fails to solve a problem because they get stuck thinking only of an object's usual or primary function.