Overcoming Delays in Instrumental Conditioning: Marking, Reinforcement, and Behavioral Theories

What are secondary reinforcers?

Stimuli that have been previously paired with primary reinforcement to bridge the delay between the instrumental response and the delivery of primary reinforcement.

How can delays in reinforcement be overcome?

By using secondary reinforcers or a marking procedure.

What is a marking procedure?

A technique where the instrumental response is marked to distinguish it from irrelevant responses.

What was the purpose of the marking procedure in the study on rats?

To facilitate learning with long delays in reinforcement.

What was the delay duration used in the rat study?

30 seconds.

What did the marking group experience in the rat study?

A light was presented for 5 seconds at the beginning of the delay interval after the instrumental response.

What is the response-reinforcer contingency?

The causal relationship between a response and the reinforcer.

What did early researchers believe was critical for instrumental learning?

Temporal contiguity between the response and the reinforcer.

What was the main finding of Skinner's Superstition Experiment?

Pigeons developed superstitious behaviors due to accidental pairings of irrelevant responses with rewards.

What is adventitious reinforcement?

Reinforcement that occurs accidentally due to temporal contiguity.

What are terminal responses according to Staddon and Simmelhag?

Behaviors that are more likely to occur just before the next reward is expected.

What are interim responses?

Behaviors that are more likely to occur at the beginning of an interval after a reward is delivered.

What did Staddon and Simmelhag find regarding accidental reinforcement?

They failed to find evidence for accidental reinforcement effects.

What does Behavioral Systems Theory suggest about terminal and interim responses?

They belong to the same behavioral system activated by the periodic delivery of food.

What are post-food focal search responses?

Responses exhibited by animals just after food has been delivered.

What are general search responses?

Responses exhibited by animals in the middle of a food delivery interval.

What are focal search responses?

Responses exhibited by animals towards the end of the interval just before food is expected.

How did Skinner's experiment influence the understanding of animal behavior?

It advanced the idea that temporal contiguity was the main factor responsible for learning.

What was the reinforcement schedule in Skinner's Superstition Experiment?

Food was delivered every 15 seconds regardless of the birds' behavior.

What behaviors did pigeons exhibit in Skinner's experiment?

Superstitious behaviors, such as making counter-clockwise circles.