Chapter 6 - Conditioning and learning

classical conditioning

The most common name for a type of learning in which a neutral stimulus acquires the ability to evoke a response that was originally evoked by another stimulus.

concurrent schedules

Two or more reinforcement schedules simultaneously available for two or more different responses.

unconditioned stimulus (UCS)

A stimulus that evokes an unconditioned response without previous conditioning

unconditioned response (UCR)

The response to an unconditioned stimulus.

Conditioned Stimulus (CS)

A previously neutral stimulus that has acquired the capacity to evoke a conditioned response.

conditioned response (CR)

A learned reaction to a conditioned stimulus that occurs because of previous conditioning.

matching law

Under concurrent schedules of reinforcement, rate of responding tends to match the rate of reinforcement available on each alternative response.

Extinction

The gradual weakening and disappearance of a conditioned response tendency. (Caused by absence of UCS.)

Spontaneous Recovery

The reappearance of an extinguished response after a period of nonexposure to the conditioned stimulus.

generalization

Occurs when an organism responds to new stimuli that are similar to the stimulus used in conditioning.

Discrimination

Occurs when an organism learns not to respond to stimuli that are similar to the stimulus used in conditioning.

higher order conditioning

Occurs when a conditioned stimulus functions as if it were an unconditioned stimulus.

law of effect

Law stating that if a response in the presence of a stimulus leads to satisfying effects, the association between the stimulus and the response is strengthened. (Thorndike)

Skinner box

A standard operant chamber in which an animal's responses are controlled and recorded.

Shaping

The reinforcement of closer and closer approximations of the desired response.

optimal foraging strategy

The food-seeking behaviors of many animals maximize nutrition gained in relation to energy expended to locate and eat the foods.

Resistance to extinction

Occurs when an organism continues to make a response after delivery of the reinforcer for it has been terminated.

distriminative stimuli

Cues that influence operant behavior by indicating the probable consequences (reinforcement or nonreinforcement) of a response.

primary reinforcers

Stimulus events that are inherently reinforcing because they satisfy biological needs.

secondary reinforcers

Stimulus events that acquire reinforcing qualities by being associated with primary reinforcers.

Continuous reinforcement

Occurs when every instance of a designated response is reinforced.

partial/intermittent schedule of reinforcement

The name for all schedules of reinforcement in which a designated response is reinforced only some of the time.

fixed ration

The schedule in which the reinforcer is given after a fixed number of nonreinforced responses.

variable ratio

The schedule in which the reinforcer is given after a variable number of nonreinforced responses.

fixed interval

The schedule in which the reinforcer is given for the first response that occurs after a fixed time interval has elapsed.

variable interval

The schedule in which the reinforcer is given for the first response that occurs after a variable time interval has elapsed.

positive reinforcement

Occurs when a response is strengthened because it is followed by the arrival of a rewarding (presumably pleasant) stimulus.

negative reinforcement

Occurs when a response is strengthened because it is followed by the removal of an aversive (unpleasant) stimulus.

avoidance learning

Occurs when an organism engages in a response that prevents aversive stimulation from occurring.

positive punishment

Giving an unpleasant consequence that weakens or suppresses the tendency to make that response.

Negative Punishment

Removal of a pleasant stimulus that weakens or suppresses the tendency to make that response.

Instinctive Drift

Occurs when an animal's innate response tendencies interfere with conditioning processes.

Observational Learning

Occurs when an organism's responding is influenced by the observation of others, who are called models.

behavior modification

A systematic approach to changing behavior through the application of the principles of conditioning.

preparedness

A species-specific predisposition to be conditioned in certain ways and not in others.

Albert Bandura

Person who described and extensively investigated the process of observational learning.

John B. Watson

Founded behaviorism; examined the generalization of conditioned fear in a boy known as ""Little Albert."

insight

A mental process marked by the sudden and expected solution to a problem

imprinting

Inherited tendencies or responses that are displayed by newborn animals when they encounter certain stimuli in their environment

cognitive learning

Type of learning involving mental processes, such as attention and memory. May not involve observable behaviors or external rewards.

mental/cognitive map

A mental representation in the brain of the layout of an environment and its features

learning-performance distinction/latent learning

Learning may occur but may not always be measured by, or immediately evident in, performance (term coined by Bandura)

attention, retention, reproduction, motivation

the four processes necessary for observational learning

systematic desensitization

A type of exposure therapy that associates a pleasant, relaxed state with gradually increasing anxiety-triggering stimuli commonly used to treat phobias (or anticipatory naseua).

Overjustification effect

when an external incentive decreases a person's intrinsic motivation to perform a behavior or participate in an activity

backward conditioning

presenting the UCS before the NS (not very effective)

two process theory of avoidance (Mowrer)

Process where fear is acquired through CC, and maintained through OC

signal-relations theory (cognitive perspective)

the idea that classical conditioning has cognitive components in which the CS has predictive power (Rescorla)

response-outcome relations (contingency theory)

the idea that operant conditioning involves cognitive components - the animals understand the connection between their behaviors and the consequences

Albert Bandura's Bobo Doll Experiment

experiment that showed observational learning of aggression; children who watched an adult in a room kicking and beating an inflatable clown toy imitated the aggressive behavior

Harry Harlow experiment

stressed the importance of care-giving and companionship in social development; demonstrated that contact comfort can be a primary reinforcer

learned food aversions/conditioned food aversions

example of classical conditioning where a distinctive flavor becomes a conditioned stimulus for the conditioned response of sickness (despite not usually being the real cause of the sickness)

species specific learning

unique learning abilities based on the evolution of specific problems and solutions

Little Albert experiment

Watson - classical conditioning on a 9 month old baby - white rat was paired with a loud clanking noise resulting in crying and fear of rat