Chapter 13
STIMULUS CONTROL OF BEHAVIOR - external stimuli determine whether a behavior will or will not be reinforced
critical feature of normal adaptive behavior
Examples:
Hugging a friend or family member is appropriate, but not a stranger.
Taking a snack and putting it into your pocket is acceptable when departing from home, but not when departing from a grocery store.
ENVIRONMENTAL STIMULI AND BEHAVIOR
Environmental stimuli are complex; for instance:
Stoplights vary in colors, shapes, brightness, and positions.
Differential Responding (alternation): Response controlled by stimulus if the response is altered after changes in that stimulus. This alteration is termed differential responding and is crucial for determining stimulus control.
SENSORY CAPACITY & ORIENTATION
Sensory Capacity: Limitations of an organism's perception.
Example: Humans cannot respond to sounds above 20,000 cycles/sec, whereas dogs can.
Limitations of Sensory Capacity: It's merely a precondition; it does not guarantee influence on behavior by any particular stimulus.
Sensory Orientation: Concerns how accessible a stimulus is to the relevant sense organ. For example:
To perceive a small stimulus, an organism must orient itself towards it.
Ambient sounds and lights continuously affect the environment regardless of the organism's orientation, thus often used in experiments.
STIMULUS INTENSITY & ORGANISM’S MOTIVATION
Stimulus Intensity: Intense stimuli are more likely to gain behavioral control than weak ones.
Intense stimuli lead to more rapid learning and more vigorous responses.
Overshadowing: Occurs when intense stimulus gains control at the expense of a weaker stimulus.
Motivational State: Changes in the emotional state of an organism can shift attention from one stimulus to another, functioning as a form of filtering.
GENERAL DETERMINANTS OF STIMULUS CONTROL
Behavior is influenced by the significance of a stimulus. Two conditioning types ensure significance:
Pavlovian Conditioning: Establishes association between a CS and an US, making an initially unimportant stimulus significant.
Instrumental Conditioning: Establishes significance based on responses to specific features of the environment, such as a lever or response key.
Limitations: These procedures cannot determine which aspects of the environment will be most significant, hence the role of explicit discrimination training.
STIMULUS DISCRIMINATION & GENERALIZATION
Stimulus control involves:
Discrimination: Responding differently to different stimuli.
Generalization: Responding similarly to different stimuli.
These two phenomena are considered two sides of the same coin.
Methods of Discrimination and Generalization:
Different methods exist for teaching these concepts, including simultaneous and successive discrimination methodologies.
DISCRIMINATION LEARNING
Simultaneous Discrimination: Responding to stimuli presented at the same time.
Successive Discrimination: Conducting trials where stimuli are presented one after the other, emphasizing learning across a series of trials.
STIMULUS GENERALIZATION GRADIENT TESTING - Conduct training on a Variable Interval (VI) schedule and test randomly on an extinction (EXT) schedule to investigate generalization gradients.
Stimulus discrimination training - Involves differential reinforcement in the presence of various stimuli, leading to different outcomes based on exposure to these stimuli.
Requires at least two stimuli in both Pavlovian and Instrumental conditioning procedures.
Differential reinforcement associates the unconditioned stimulus (US) or reinforcer with one cue (S+), but not with another cue (S-).
PAVLOVIAN SUCCESSIVE DISCRIMINATION TRAINING
Initial generalization occurs where responding to S+ is extended to S-.
Over time, response to S+ increases while response to S- decreases, resulting in strong discrimination between the two responses.
In INSTRUMENTAL SUCCESSIVE DISCRIMINATION TRAINING, target response is reinforced ONLY in the presence of S+, NOT S-.
Training consists of procedures such as S+ → R → O trials and S- → R → No O trials, utilizing a multiple schedule of reinforcement.
Stimulus generalization - defined by reinforced responding to one stimulus also occurring for other similar stimuli.
Generalization gradients reflect how steep gradients indicate stronger control by specific stimulus dimensions:
STEEP Gradient = STRONG Control
shallow Gradient = weak Control
CONTRASTING CONCEPTIONS OF STIMULUS GENERALIZATION
Pavlov's Theory: Spread-of-effect - activation in one brain area influences nearby regions.
Lashley & Wade's Theory (1946): Generalization occurs due to the organism not having learned to distinguish between stimuli.
Implication: If correct, discrimination training can modify stimulus generalization rates.
SPENCE’S THEORY OF DISCRIMINATION LEARNING - Centers on the association of excitation and inhibition with S+ (reinforced) and S- (nonreinforced) stimuli.
Paired with reinforcement, a gradient of excitation develops around a stimulus, with the peak excitation at the training stimulus, decreasing orderly with distance.
Paired with nonreinforcement results in a gradient of inhibition surrounding that stimulus, with similar orderly decreases.
EXPERIMENTAL VALIDATION OF SPENCE'S THEORY
Honig studied pigeons trained with varying line stimuli and observed predicted behaviors aligning with the peak shift phenomenon, demonstrated Spence’s theory.
Peak Shift Phenomenon: The predicted peak of intradimensional generalization gradient shifts away from S+ towards points distinct from S-.
Acquired Distinctiveness: Increased precision in stimulus control resulting from differential reinforcement, which decreases generalization.
Acquired Equivalence: A decrease in precision of stimulus control often arising from non-differential reinforcement, which increases generalization.
These concepts bolster Lashley & Wade's assertion of learning's crucial role in stimulus control, particularly in perceptual concept learning.
PERCEPTUAL LEARNING
Discrimination between compound stimuli (e.g., AX and BX) can be taught through differential reinforcement or through repeated exposure for habituation leading to familiarity, but differential reinforcement is faster.
STIMULUS EQUIVALENCE TRAINING -Trains participants to respond similarly to different stimuli (e.g., a square and circle), promoting generalization but slowing later discrimination.
In perceptual concept learning, responding uniformly across varied perceptually distinct stimuli creates equivalence classes (e.g., naming all fruits similarly) and supports the theory of learning significantly affecting stimulus control.
SUMMARY
Response timing and location are determined by stimulus control which involves differential responding measured by the steepness of generalization gradients across training procedures.
Influencing factors include:
Sensory capacity
Sensory orientation
Stimulus intensity
Motivational state
Emotional state.
Overall role of Discrimination Training: The primary mechanism for establishing stimulus control; can involve both interdimensional and intradimensional stimuli, with the latter yielding more acute stimulus control in expert performances such as wine tasting.
Importance of Stimulus Equivalence: Essential in various learning contexts such as simple equivalence, perceptual concept learning, language acquisition, and applied behavioral analysis.