a behavior is triggered by the presence or absence of some stimuli
stimulus control
stimulus control is triggered by
presence or absence of some stimuli
in modern research, stimulus control is called
animal cognition
the study of cognitive processes in animals
Animal Cognition
G Alan Marlatt and Colleagues
Drug Abusers
The RP model proposed by Marlatt and Gordon suggest that
both immediate determinants and covert antecedents can contribute to relapse.
Global strategies comprise balancing the client’s lifestyle and helping the addict to
employing stimulus control techniques
Bond and Kamil Study( 1998, 2002, 2006)
Stimulus control processes can affect BOTH predator and its prey
moths that were different from their neighbors were more likely to survive than moths that were not that different
Virtual Evolution
refers to a set of things ( objects, ideas, events) that are grouped together
Categorization
the ability to perceive and respond to differences among stimuli
Discrimination
one reason the pigeon is a popular subjects is because
their eyesight is very good
Trees, Water, and Margaret: Hernstein, Loveland, and Cable( 1976)
- Birds learned to discriminate tree slides from other slides after many trainings
-birds learned to categorize pictures( if they had trees or if they didn’t)
-birds responded well to new pictures they hadn’t see before
the mental and intellectual process through which objects and ideas are sorted and classified, recognized, and understood
Categorization
Hernstein and Loveland( 1964)
pigeons could discriminate pictures containing people from pictures that did not
Ed Wasserman experiment
pigeons learned to discriminate between four categories at the same time
Vaugh and Green experiment
pigeons can remember 320 difference photographs
Cook et. Al.
pigeons have the capacity to remember over 800 photographs
Three Approaches to Categorization
Feature Theory
Prototype Theory
Exemplar Theory
an approach to categorization which assumes that organisms associate the many features of category exemplars with reinforcers( or category labels) and then reposed to new items according to the combined associative strength of their features
Feature Theory
an approach to categorization which assumes that animals and humans learn what is typical or average for a category and then respond to new examples
PROTOTYPE THEORY
representation of what is typical or average for a particular category
Prototype
an approach to categorization which assumes that organisms store representations of a large number of individual members of a category and then respond to new items depending on how similar they are to the items they were presented before
EXEMPLAR THEORY
this approach is successful in human learning, but not so much for animals
exemplar theory
the tendency for behavior to occur in situations different from the one in which the behavior was learned
Generalization
Thorndike Puzzle Box
-Generalization example
-Cat put in box and leans to claw its way out
-Any reaction to totally new phenomenon, when first experienced, will be called instinctive
Gutman and Kalish
-Generalization example
-pigeon receives food when pecking a yellow disk even though no food is given
Learned behavior is most likely to appear in situations that
closely resemble the training situation
The more similar a new stimulus is to the training stimulus
the more likely the participant is to behave as thought it were the training stimulus
responding to a new stimulus depends on its similarity to a stimulus that has already been reinforced
Stimulus Generalization Gradient
suggest that generalization gradient can influence the results of discrimination training
Peak shift phenomenon
Influences on the Generalization gradian Curve
shape of gradient affected by learning
inhibition
peak shift
the tendency for behavior to occur in situations that closely resemble the one in which the behavior was learned but not in situations that differ from it
discrimination
relatively flat generalization gradient
indicates little or no discrimination
steep generalization gradient
indicates considerable discrimination
Pavlov’s Theory
psychological
Spence’s Theory
Excitatory and Inhibitory Gradient
Lashley-Wade Theory
depend on prior experience with stimuli similar to those used in testing
occurs when behavior comes under the operant control of one stimulus when it is in the presence or context of another stimulus
conditional discrimination
experienced dependent enhancement of our ability to make sense of what we see, hear, feel, taste, or smell
perceptual learning
the ability to interpret the surrounding environment using light in the visible spectrum reflected by the objects in the environment
visual perception
Discrimination and generalization processes are
always interacting
Theories of associative learning that emphasize inhibition, excitation, and generalization go to a surprising distance in explaining
Stimulus Control Phenomena
Primitive components called
geons(geometric ions)
the simple 2D or 3D forms such as cylinders, cones, bricks, wedges, circles, and rectangles corresponding to the simple parts of an object
geons
geons theory proposes that the visual input is matched abasing structural representations of objects in the
brain
a mathematical measure of the inconsistency contained in the display
Entropy
two people talking to you at the same time; we switch out our attention back and forth
Divided Attention
method used to study working memory in pigeons
Radial Maze
Radial Maze was developed by
David Olton
ones memory of behavior procedures( how to do things)
Procedural Memory
words, facts, etc.
Sematic Memory
your personal memories
Episodic Memory
Behavior is very
sensitive to time
regardless of the interval that is being timed, on a given task the probability of responding is related to the proportion of the time into the interval
Scarlar Property
if I know where something is, I can know where to look for it
dead recocking
can see the goal in the distance
beacons
ones ability to monitor and report on their own cognitions
METACOGNITION
Rhesus Monkey know when they remember Hampton experiment
suggested that monkeys were able to monitor their memory and accept or decline the test in a way that improved their chances of reward
Instructional Strategies for Metacognition
develop PLAN before learning task
MONITOR understanding
EVALUATE thinking after finishing task
Behavior is
Goal oriented
Organized around achieved desired outcomes
There are two formal properties of behavior
Behavior is a variable
Persistence is another property of behavior
behavior being a variable and persistence being another form of behavior are common features of instrumental action and they both suggest that
behavior is motivated
Toleman’s view on reinforcers
not really necessary for learning, instead they’re essential for motivating behavior and giving behavior a purpose
Coleman separated
learning from performance
difference between learning and performance according to Coleman
Learning is a continuous process
Performance is tangible and measurable
motivation is the element that often translates knowledge to
action
Experiments suggest that humans and other animals that were deprived of specific nutrients had __ that motivated them to eat more of these mussing nutrients
specific hungers
Homeostasis: Clark Hull
Drive(D), the major motivator, multiplied by Habit(H) produces behavior produces behavior strength
Behavior strength formula (Hull)
Drive(D) x Habit(H)
Drive do three things
1. Consummatory behavior like eating/drinking
Generate activity
Goal directed action
actions that are performed for their consequences or outcomes, whether these are access to valuable resources or avoidance of aversive events
instrumental actions
Depletion repletion theory according to Hull
motivated behavior is organized in anticipation rather than in repose to need
Motivational states do affect __ but their effects are more subtle and interesting than Hull imagined
instrumental behavior
animals in need of food/water will perform behaviors to correct the deficit
depletion repletion
seems to anticipate rather then respond to need
motivated behavior
you advertise for one thing then substitute it for something inferior
bait and switch routine
acquired through experience unlike the motivation thought to be provided by drive and needs
acquired motivation
Reward shifts can have what kind of effects
emotional effect on behavior
Incentive is __ and motivation is __
external
internal
behavior is a function of learning( habit) and need (drive), and is dependent on the motivating effect( incentive of the reward-K)
incentive motivation
Motivating effects of reward are attributed to a mechanism based on
classical conditioning
occurs when an animals expects a big reward, but then receives a small reward
frustration
The size of the frustration reaction is determined by
size of the discrepancy b/t reward expected and the reward obtained
Partial reinforcement extinction effect (PREE)
One group is continuously reinforced
One group is reinforced 50% of the time
teach your children to persevere in face of adversity( Amsel 1992)
Practical Application
We now know quite a bit about how to slow down extinction and thus maintain persistence in behavior by using
partial reinforcement techniques
psychological phenomenon that occurs when a conditioned stimuli(CS) that has been associated with rewarding or averse stimuli via CC alters motivation and instrumental behavior
Pavlovian instrumental transfer theory(PIT)
Outcome Specific in PIT- CS is paired with
same reward
General Outcome in PIT : CS is paired with
different reward
suggest that we’ll be motivated to seek food when we encounter cues associated with food(packaging), commercial, or restaurant
general PIT
suggests that cues for specific food (Cane’s) will enhance our tendency to seek and choose that food, even when we do not really need it
Outcome Specific PIT
probably the mechanism that underlies the effects of advertisement
PIT
The CS acquires the power to engage a whole set or
system of responses
Operant process theory(three things)
-Fear then relief
-thrill sadness
-repeated exposure to rewards or punishers can cause a profound change in their motivational consequences
theory suggesting that any emotional reaction is followed automatically by an opposite reaction and repeated exposure to a stimulus causes the initial reaction to weaken and the opponent process, or opposite reaction, to strengthen
opponent process theory
The opponent process approach emphasizes
withdrawal-like effects are the motivational basis for addictive behavior
Need states do not automatically energize instrument action; instead the organism must learn about the effect that an outcome has on the need state
incentive learning
Eating and drinking actually occurs in __ rather than in response to need
anticipation of
term ‘coined’ by the author of our textbook( Mark E. Bouton)
Synthetic approach to instrumental learning