Reinforcement Schedules and Choice Behaviour (Video)

40 flashcards focusing on reinforcement schedules, choice behaviour, and related concepts for exam preparation.

What does Thorndike's Law of Effect say about responses in the presence of a stimulus followed by a pleasant reward?

They strengthen the stimulus–response (S–R) association.

What happens to the S–R association when a response is followed by a punishment?

The S–R association is weakened.

What does Partial Reinforcement mean in operant conditioning?

Not all occurrences of a behaviour are reinforced; reinforcement is intermittent.

Why does behaviour often persist under partial reinforcement in real life?

Reinforcement is not always immediate or guaranteed, so behaviour can persist.

How is a schedule of reinforcement defined?

A rule that determines which occurrence of the instrumental response is followed by the reinforcer.

What is a Ratio schedule?

Reinforcement based on the number of responses performed.

In a Fixed Ratio (FR) schedule, when is reinforcement given?

For every nth instance of the behaviour.

Give an FR9 schedule example.

Reinforcement after every 9 responses.

Fixed Ratio

Steady and high rate of responding with a post-reinforcement pause.

What is the relationship between the number of required responses and the post-reinforcement pause?

The pause length increases as the number of required responses increases.

What is Continuous Reinforcement (CRF)?

Every instance of the behaviour is reinforced; FR1.

What FR schedule characterizes CRF?

FR1 (every instance is reinforced).

How does CRF affect the pattern of responding?

Steady and moderate rate with brief, unpredictable pauses.

What is a Variable Ratio (VR) schedule?

Reinforcement is given for every nth response on average; steady responding with no predictable pauses.

Give an example of a VR schedule from the notes.

VR100 – reinforcement on average every 100 responses (payouts can occur at 80th, 120th, etc.).

What is a Fixed Interval (FI) schedule?

Reinforcement is available after a fixed amount of time since last reinforcement.

Under FI, what happens if a response occurs before the fixed time has elapsed?

It is not reinforced.

What is the crosswalk button example used to illustrate?

A Fixed Interval schedule; reinforcement after a fixed time.

What pattern is typical for FI performance?

A scalloped pattern with increasing responding as the reinforcement time nears.

What is a Variable Interval (VI) schedule?

Reinforcement becomes available after varying time intervals; average interval is specified (e.g., VI 24h).

How do responses typically look under VI schedules?

Steady and stable rate with no noticeable pauses.

What is the main difference in response patterns between FR/FI and VR/VI schedules?

FR/FI show post-reinforcement pauses and bursts; VR/VI yield steady rates without clear pauses.

What does the Molecular Theory say about ratio schedules?

Higher response rate on ratio schedules due to incentives to produce short inter-response times.

Why do ratio schedules reinforce short inter-response times according to the Molecular Theory?

Waiting between responses delays reinforcement.

How do interval schedules affect inter-response times according to the Molecular Theory?

Waiting to respond can be advantageous since reinforcement is time-based.

What is the 'feedback function' in the Molar Theory?

The relationship between responses and reinforcement across the session; ratio is an increasing linear function; interval has an upper limit (asymptote).

In a 10-minute session with VI-2 min reinforcement, what is the maximum number of reinforcers?

5 reinforcements (limited by the interval).

What does 'Limited Hold' mean in reinforcement schedules?

A restriction on how long the reinforcement remains available.

What are Concurrent Schedules of Reinforcement?

Two or more reinforcement schedules operate simultaneously for different responses.

What does the Concurrent Schedule procedure allow researchers to measure?

Choice behavior and the distribution of responses between options.

What does the Matching Law state about relative rates of responding?

They match the relative rates of reinforcement.

What does the Generalised Matching Law add to the Matching Law?

Parameters for sensitivity and bias to account for imperfect matching.

What does the 's' parameter represent in the Generalised Matching Law?

Sensitivity of choice behavior to relative reinforcement; s < 1 indicates undermatching.

What does the 'b' parameter represent in the Generalised Matching Law?

Bias or preference for a particular option.

Do people generally prefer ratio or interval schedules?

Generally prefer ratio over interval, and variable over fixed.

What is Self-Control in the context of instrumental conditioning?

Complex choice behavior involving prioritizing long-term benefits over short-term costs.

How can self-control be trained according to the notes?

Shaping with increasing delay, low-effort tasks, or distraction during the delay.

What is Delay Discounting?

The value of a reinforcer decreases as waiting time increases.

What do V, M, D, and K stand for in the delay discounting function?

V = value of reinforcer; M = magnitude; D = delay; K = discounting rate.

What does a steeper delay discounting function imply about a person?

Greater impulsivity and more difficulty showing self-control.

What is the essence of the 2-process theory of instrumental conditioning?

Both Pavlovian and instrumental learning contribute to motivation via S–O associations activating emotional states.

What is Pavlovian Instrumental Transfer (PIT)?

A Pavlovian S–O association motivates instrumental responding when the CS is present.

What is the Response Deprivation Hypothesis?

Restricting access to certain activities can make low-probability responses reinforcing.

What is the Response Allocation approach?

Examines how restricted conditions alter the distribution of responses from a bliss point baseline.

What is a bliss point in behavioral economics?

The unconstrained baseline distribution of responses that maximizes overall benefit.

What is elasticity of demand in this context?

How sensitive consumption is to changes in price.

What do some items’ responses to prices demonstrate in behavioral economics?

That different goods have different price sensitivities and substitutes.

What is the link between elasticity and complementary commodities?

Demand for one item can be linked to demand for another (e.g., BBQ buns and hamburgers).

What summarizes the overall purpose of using reinforcement schedules in this material?

To understand motivation, choice, and how different schedules influence behavior and preferences.