Chapter 3: Operant Conditioning - Vocabulary Flashcards

Vocabulary flashcards covering fundamental terms and concepts of operant conditioning from Chapter 3.

Operant Behavior

A class of emitted responses that result in certain consequences; these consequences, in turn, affect the future probability (strength) of those responses.

Operant Conditioning

A type of learning in which the future probability (strength) of a behavior is affected by its consequences; also known as instrumental conditioning.

Law of Effect

As stated by Thorndike, the proposition that behaviors that lead to a satisfying state of affairs are strengthened or "stamped in," while behaviors that lead to an unsatisfying or annoying state of affairs are weakened or "stamped out."

Respondent Behavior

Involuntary, reflexive-type behavior that can often be classically conditioned to occur in new situations.

Reinforcer

An event that (1) follows a behavior and (2) increases the future probability of that behavior. Often represented by the symbol $S^R$.

Punisher

An event that (1) follows a behavior and (2) decreases the future probability of that behavior. Often represented by the symbol $S^P$.

Reinforcement

The process or procedure whereby a behavior is strengthened by its consequences.

Punishment

The process or procedure whereby a behavior is weakened by its consequences.

Positive Reinforcement

The presentation of a stimulus (one that is usually considered pleasant or rewarding) following a response, which then leads to an increase in the future strength of that response. Often represented as $S^{R+}$.

Negative Reinforcement

The removal of a stimulus (one that is usually considered unpleasant or aversive) following a response, which then leads to an increase in the future strength of that response. Often represented as $S^{R-}$.

Positive Punishment

The presentation of a stimulus (one that is usually considered unpleasant or aversive) following a response, which then leads to a decrease in the future strength of that response. Often represented as $S^{P+}$.

Negative Punishment

The removal of a stimulus (one that is usually considered pleasant or rewarding) following a response, which then leads to a decrease in the future strength of that response. Often represented as $S^{P-}$.

Discriminative Stimulus ($S^D$)

A stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced; that is, a stimulus that signals the availability of reinforcement.

Discriminative Stimulus for Extinction ($S^\Delta$)

A stimulus that signals the absence of reinforcement.

Discriminative Stimulus for Punishment ($S^{Dp}$)

A stimulus that signals that a response will be punished.

Three-Term Contingency

The relationship between a discriminative stimulus, an operant behavior, and a consequence (reinforcer or punisher); often thought of as an Antecedent-Behavior-Consequence (ABC) sequence.

Primary Reinforcer

An event that is innately reinforcing; also called an unconditioned reinforcer.

Secondary Reinforcer

An event that is reinforcing because it has been associated with some other reinforcer; also called a conditioned reinforcer.

Generalized Reinforcer

A type of secondary reinforcer that has been associated with several other reinforcers; also called a generalized secondary reinforcer.

Intrinsic Reinforcement

Reinforcement provided by the mere act of performing the behavior; the behavior itself is the reinforcer.

Extrinsic Reinforcement

The reinforcement provided by a consequence that is external to the behavior (i.e., an extrinsic reinforcer).

Natural Reinforcers

Reinforcers that are naturally provided for a certain behavior; they are a typical consequence of the behavior within that setting.

Contrived Reinforcers

Reinforcers that have been deliberately arranged to modify a behavior; they are not a typical consequence of the behavior in that setting. Also called artificial reinforcers.

Shaping

The gradual creation of new behavior through reinforcement of successive approximations to that behavior.

Extinction

The weakening of a behavior through the nonreinforcement of a previously reinforced behavior.

Escape Behavior

A behavior that results in the termination of an aversive stimulus.

Avoidance Behavior

Behavior that occurs before the aversive stimulus is presented and thereby prevents its delivery.