Chapter 3 Terms

Chaining: Used to develop a sequence of desired behaviours. Each correct response is reinforced with the chance to perform the next step in the sequence. Step by step, a chain of responses is built leading to the final sequence of behaviours.

Continuous Reinforcement (CRF): A reinforcer follows every correct response made by the individual.

Contrast Effects: Changes in the value of a reward lead to shifts in response rate. Negative contrast occurs when a response originally receiving a high reward is shifted to a lower reward; this results in reduced responding. Positive contrast occurs when a response originally receiving a low reward is shifted to a higher reward; this results in increased responding.

Cumulative Recorder: Records the cumulative response rate during an instrumental conditioning experiment.

Discriminative Stimuli: A signal to the organism when a given response-reinforcer relationship is valid. Can indicate either the presence (S+) or absence (S-) of the relationship.

Escape Training: A negative reinforcer is removed after a response. Will increase response rate.

Fixed Interval (FI) Schedule: The first correct response that occurs after a fixed interval of time is reinforced.

Fixed Ratio (FR) Schedule: Reinforcement follows after a fixed number of responses.

Law of Effect: A response followed by a satisfying effect is strengthened and likely to occur again in that situation, while a response followed by an unsatisfying effect is weakened and less likely to occur again in that situation.

Mirror Neuron: A cell that responds in the same way when performing an action as it does when the organism possessing that cell observes someone else perform the action or even imagines performing the action. Believed to play a key role in observational learning.

Omission Training: A positive reinforcer is removed after a response. Will decrease response rate.

Operant Chamber: Also referred to as a Skinner Box. A special chamber with a lever or other mechanism by which an animal could respond to produce a reinforcer.

Overjustification Effect: A newly introduced reward for a previously unrewarded task can alter an individual’s perception of that task. A task that was previously regarded as having intrinsic value (an activity pursued because it is, in and of itself, rewarding) now becomes viewed as work with extrinsic value (an activity undertaken only because it leads to reward coming from other sources).

Partial Reinforcement (PRF): The reinforcer follows only some of the responses.

Post-Reinforcement Pause: A period during which the organism momentarily stops responding before starting up again. Occurs after reinforcement on a fixed ratio schedule.

Primary Reinforcer: A reinforcer with intrinsic value such a food, water or a mate.

Punishment Training: A negative reinforcer is presented after a response. Will decrease response rate.

Ratio Strain: As the number of responses required for reward increases the post-reinforcement pause tends to get longer. If the required responses continue to increase the organism will eventually reach break point and stop responding completely.

Reward Training: A positive reinforcer is presented after a response. Will increase response rate.

Secondary Reinforcer: A reinforcer that can be exchanged for a primary reinforcer. Money is the most commonly used for humans.

Shaping: Used when a desired behaviour is too complex for a subject to discover on their own in a single step. The behaviour is broken down into smaller, easier steps, eventually leading to the more complex behaviour.

Variable Interval (VI) Schedule: Reinforcement follows the first correct response to occur after a variable interval of time has passed. The average time required characterizes a particular VI schedule.

Variable Ratio (VR) Schedule: Reinforcement follows after a variable number of responses have been completed. The average number of responses required characterizes a particular VR schedule.