L4-L7 Instrumental Conditioning

Flashcards covering key vocabulary and concepts related to instrumental conditioning.

Instrumental or Operant Conditioning

A learning process where behaviors are modified by their consequences (rewards or punishments).

Law of Effect

Thorndike's principle that behaviors followed by positive consequences become more likely, while those followed by negative consequences become less likely. Reinforcement and punishment

The opperant

the response defined in terms of its environmental effect.

B.F. Skinner

A central figure in Behaviourism known for his work on operant conditioning.

Skinners version of the law of effect

When a response is followed by a reinforcer, the strength of the response increases. When followed by a punisher, it decreases.

Acquisition

Behaviour shaped by successive approximations. Eg, teaching lana mario kart, start with steering, then powers, then drifting. Once she moves to a new skill stop praising her for the old one and start praising her for the new one.

Reinforcement

increases the likelihood of a behavior. Can be positive or negative.

Positive Reinforcement

Adding a stimulus or event contingent upon a response increases that behavior. Eg pocket money for doing chores.

Negative Reinforcement

Removing a stimulus or event contingent upon a response increases that behavior. Eg, child does homework to avoid detention.

Punishment

Decreases the likelihood of a behavior. Can be positive or negative.

Positive Punishment

Adding a stimulus or event contingent upon a response decreases that behavior. Eg electrical shock for pressing a lever.

Negative Punishment

Removing a stimulus or event contingent upon a response decreases that behavior. Eg quinton taking away technology.

Conditioned Reinforcer

A stimulus that is reinforcing through association with primary reinforcers eg food.

Conditioned Punisher

A stimulus that has acquired punishing properties through association with primary punishers eg pain.

Token reinforcer

Eg money, can be exchanged for primary reinforcers

Experimental analysis of behaviour

Systematic study of relation between bahaviour and its concequences, eg Skinner Box is deliberately sparse to see how they interact with things.

Schedules of Reinforcement

Specific patterns of presenting reinforcers over time. Types are continuous, partial, ratio, interval.

Continuous Reinforcement (CRF)

Every instance of a response is reinforced. Resource heavy, but useful for learning behaviours quickly.

Partial Reinforcement

A designated response is reinforced only some of the time. FR, VR, FI, VI

Fixed-Ratio Schedule (FR)

The reinforcer is given after a fixed number of non-reinforced responses. After reward is given it rests. Eg loyalty card.

Variable-Ratio Schedule (VR)

The reinforcer is given after a variable number of non-reinforced responses which varies around a predetermined average. High and steady rate of response, eg gambling.

Fixed-Interval Schedule

The reinforcer is given for the first response after a fixed period of time has elapsed. Rats pause after recieving reinforcer, steady increase in response rate as interval elapses. Eg cooking pasta, you check more frequently when its closer to being done.

Variable-Interval Schedule

The reinforcer is given for the first response after a variable time interval has elapsed ehich varies around an average. High steady rate of response but not as high as VR

Extinction

The process of no longer delivering reinforcers contingent upon a response, leading to a decrease in the strength of the response.

Partial-Reinforcement Extinction Effect

Partial reinforcement schedules lead to greater resistance to extinction compared to continuous reinforcement. Because they have learned to persist in the face of frustration produced by absence.

Problems using extinction

Inability to control all sources of reinforcement. Failure to provide alternative behaviour leading to same reinforcer. Spontaeneous recovery.

Premack's Principle

The principle that a high probability behaviour can be used to reinforce a low probability behaviour.

Stimulus Control (ABC’s of learning)

The ability of antecedent stimuli to control instrumental behavior.

Stimulus Generalization

The extent that stimulus dimensions control behaviour.

Stimulus Discrimination

Responding differently in the presence of two or more stimuli.

Generalisation of punishment

Adding a punishment for a response will reduce the response across associated responses as well.

Selective stimulus control

In complex environments, they often ignore redundant info even if relevant.

Biological Constraints

Limitations that result from animal's evolutionary history. Eg pigs and coins, they start associating coins with food, so coins trigger instinctual food behaviour and they treat the coins like food.

Species specific defense reactions

Rats easily learn to press lever for food, and jump out of box, but its hard to train them to press a lever to avoid shock. Because fleeing and freezing is the dominant response for rats in danger.

Latent Learning

Learning that occurs without any obvious reinforcement or punishment for the specific behavior.