ch 7.1

Respondent–Operant Interrelationships

Behavioral Objectives
  1. Describe how operant and respondent contingencies interrelate.

  2. Explain the processes of sign tracking, auto-shaping, and negative auto-maintenance.

  3. Learn about the biological context of conditioning and taste aversion learning.

Operants and Respondents

  • Operants and respondents are defined by the experimental procedures that produce them.

  • Conditioning is frequently simplified into two categories: respondent and operant.

  • However, most conditioning procedures involve both types of learning.

Biological Context of Conditioning

  • Species-characteristic behavior can be elicited concurrently with operant behavior.

  • Respondent procedures can be embedded within operant reinforcement contingencies.

  • Both operant and respondent behaviors are biologically integrated into the organism's functioning.

  • Evolution through natural selection has shaped both species-specific behaviors (such as reflexes and fixed action patterns, FAPs) and the fundamental mechanisms involved in both respondent and operant conditioning.

Species-Characteristic Behavior and Operating Contingencies

The Breland and Breland Demonstration
  • The Brelands encountered challenges with instinctive drift while training animals, notably raccoons, which could not learn to deposit coins in a box.

  • Raccoons exhibited instinctive rubbing behavior instead of performing the desired operant of dropping coins.

  • For example, a raccoon performing “drop shots” into a basketball hoop instead showed species-specific responses, such as rubbing the ball rather than executing the intended behavior.

Respondent Contingencies Override Operant Regulation

  • The association formed during training includes:
      - Conditioned Stimulus (CS): coins
      - Unconditioned Stimulus (US): food
      - The process can be summarized as:
      CSextcoins+USextfood<br>ightarrowURextrubCS_{ ext{coins}} + US_{ ext{food}} <br>ightarrow UR_{ ext{rub}}

  • Each presentation of the food reinforcer strengthens the conditioned response (CR).

Sign Tracking

  • Defined as the tendency to approach a stimulus that is associated with a biologically relevant event.

  • For instance, the conditioned stimulus (CS) becomes linked with the delivery of food (unconditioned stimulus, US), inducing food-related responses (CR).

  • A scenario involves a dog approaching the signal (CS) for food and making “food-soliciting” responses, rather than simply going to the food dish directly.

Autoshaping

  • Technique developed for teaching pigeons to peck a response key without manual shaping.

  • Brown and Jenkins (1968) implemented magazine training for food.

  • The process involved illuminating the key light for a duration of 8 seconds (NS) before turning it off and delivering the food (US).

  • Pigeons began to orient towards and peck at the key light.

  • In most experiments, pecking the key results in the immediate extinction of the light and activation of the feeder.

  • Key point: The onset of the light occurs before the presentation of food, thus appearing to elicit the key peck, showing respondent control taken over by operant contingencies.

Cumulative Responses Example

  • A graph example in a lab illustrating responses categorized into different session structures.

Conclusions from Brown and Jenkins (1968)

  • The study concluded that the look-peck coupling is species-specific and directly leads to pecking at an illuminated key due to the bright signaling of food presentation.

Comparison of Respondent & Operant Contingencies

Formulation
  • Respondent behavior:
      - USextfood<br>ightarrowURextpeckUS_{ ext{food}} <br>ightarrow UR_{ ext{peck}}
      - CSextlight+USextfood<br>ightarrowURextpeckCS_{ ext{light}} + US_{ ext{food}} <br>ightarrow UR_{ ext{peck}}
      - CSextlight<br>ightarrowCRextpeckCS_{ ext{light}} <br>ightarrow CR_{ ext{peck}}

  • Operant behavior:
      - SDextlight:Rextpeck<br>ightarrowSrextfood+SD_{ ext{light}}: R_{ ext{peck}} <br>ightarrow Sr^+_{ ext{food}}

  • The light serves as a conditioned stimulus that drives key pecking, which is operant behavior sustained by food presentation.

Contingencies and Species-Specific Behavior

  • Phenomena like instinctive drift, autoshaping, and sign tracking highlight species-specific behaviors triggered by biologically salient stimuli.

  • The concept of stimulus substitution explains that the CS can act as a substitute for (or generalize from) the US.

  • Issues with stimulus substitution:
      1. The laws of the reflex do not apply to the CS-CR relationship.
      2. The conditioned response can be the opposite of the unconditioned response.
      3. Certain autoshaping experiments contradict stimulus substitution principles.

Behavior System and Species-Specific Behavior

  • Wasserman (1973) illustrated autoshaping with chicks using a light (CS) paired with heat from a lamp (US).

  • Chicks began “snuggling” the light and exhibited different responses to heat (freezing and extending wings), challenging stimulus substitution.

  • Timberlake (1983, 1993) theorized a behavior system, where each US activates a unique set of species-specific responses based on stimulus characteristics.

Analysis of Conditioning and Reflexive Behavior

Miller and Carmona (1967) Experiment
  • Investigated how operant conditioning influenced reflexive behaviors such as salivation in dogs.

  • Dogs were divided into groups to either reinforce increased or decreased salivation levels according to the training contingencies.

  • Results indicated that the dogs conditioned for increased salivation displayed attentiveness, whereas those conditioned for decreased salivation were less alert (appearing drowsy).

Miller and DiCara (1967) Experiments
  • Rats were immobilized with curare, and through electrical brain stimulation, different heart rate contingencies were reinforced.

  • The experimental group showed significant changes in heart rate after extensive training periods.

Context of Conditioning

  • Contextual conditions include the evolutionary history, ontogeny, and current neuropsychological status, impacting behavior regulation through contingencies.

  • The influence of context is significant; contingencies depend on current conditions and consequences for the organism.

Taste Aversion Learning

  • Taste aversion refers to the learned behavior to avoid certain tastes (CS) linked to illness (CR).

  • Example: Quail and rats received a paired stimulus (blue-salty water) with an illness reaction.

  • Upon recovery, given a choice between two flavors, species-specific aversion was observed (rats avoiding salty flavors, quail avoiding blue flavors).

Preparedness and Taste Aversion Learning

  • Preparedness refers to an innate predisposition to learn certain CS–US associations over others.

  • Garcia and Koelling (1966) observed that rats developed taste aversion based on flavor association with illness, illustrating the concept of preparedness in learning.

Additional Observations

  • Results of Garcia and Koelling noted unique observations:
      1. Temporal Separation: Unusual because CS and US occur at a delayed interval causing conditioning with minimal pairings.
      2. Species-Specific Avoidance: Various species exhibit preference or avoidance behaviors towards specific compounds based on their ecological context.

Behavioral Neuroscience Insights
  • Andre et al. (2006) employed brain imaging techniques to measure neuronal activity markers associated with taste aversions.

  • Elevated levels of c-Fos in gustatory areas of the thalamus were observed after illness-inducing treatment (LiCl).

  • c-Fos aids in bridging the delay period between the CS and the onset of nausea, validating the integration of learning and neurobiology in taste aversion development.