Skinner’s Experiments

What is the Law of Effect, formulated by Edward Thorndike?

The principle that rewarded behavior tends to be repeated.

What is a Skinner Box (Operant Chamber)?

An enclosed box with a bar or key that an animal can press or peck to get a food or water reward, while measuring devices record their responses.

What is reinforcement in operant conditioning?

Any event that strengthens (increases the frequency of) a preceding response.

What is shaping behavior?

Gradually guiding an animal's or human's actions closer and closer to a desired behavior by rewarding successive approximations.

How does shaping work in practice?

You give a reward for small steps toward the goal (e.g., walking toward a bar, then touching it) while ignoring other actions.

What is positive reinforcement? Give an example.

Adding a desirable stimulus to increase a behavior (e.g., giving a dog a treat when it comes).

What is negative reinforcement? Give an example.

Removing an unpleasant stimulus to increase a behavior (e.g., taking an aspirin to end a headache, or fastening your seat belt to stop annoying beeps).

What is an important distinction to remember about negative reinforcement?

Negative reinforcement is NOT punishment; it provides relief by getting rid of something bad.

What are primary reinforcers? Give an example.

Unlearned and innately satisfying reinforcers (e.g., getting food when hungry).

What are conditioned (secondary) reinforcers? Give examples.

Reinforcers learned through association with primary reinforcers (e.g., money, good grades, social media "likes").

Why is immediate feedback important in reinforcement?

It works best for animals and fast learning (e.g., immediate food pellet for a rat).

How do humans differ regarding delayed reinforcers?

Humans can wait for delayed rewards like end-of-the-week paychecks, good grades, or future goals, and delaying gratification leads to greater success.

What is continuous reinforcement, and what is its result?

Rewarding the behavior every single time it occurs. Result: Fast learning, but fast extinction if the reward stops.

What is partial (intermittent) reinforcement, and what is its result?

Rewarding the behavior only sometimes. Result: Slower learning, but much greater resistance to extinction (e.g., slot machines, fishing).

What is a Fixed-Ratio schedule? Give an example.

Reinforcement after a set number of responses (e.g., buy 10 coffees, get 1 free).

What is a Variable-Ratio schedule? Give examples and state its effect.

Reinforcement after an unpredictable number of responses (e.g., slot machines, fishing). It produces high, steady rates of response.

What is a Fixed-Interval schedule? Give an example.

Reinforcement after a fixed time period (e.g., Tuesday discount prices; checking mail more often right as delivery time nears).

What is a Variable-Interval schedule? Give an example and state its effect.

Reinforcement after unpredictable time intervals (e.g., checking phone updates). It produces slow, steady persistence.

What is punishment in operant conditioning?

Any consequence that decreases the frequency of the behavior it follows.

What is positive punishment? Give an example.

Adding an unpleasant stimulus to decrease a behavior (e.g., giving a traffic ticket).

What is negative punishment? Give an example.

Taking away a pleasant stimulus to decrease a behavior (e.g., taking away driving privileges).

What are the 5 major drawbacks of physical (corporal) punishment?

1. Punished behavior is suppressed, not forgotten (stops only when the punisher is around).

2. It does not teach alternative behaviors (doesn't show what to do instead).

3. It teaches discrimination (children learn not to misbehave in front of specific people).

4. It can teach fear (children may fear the parent/teacher or avoid the location).

5. It may increase aggression by modeling violence as a way to solve problems.

What is a better alternative to physical punishment?

Focusing on reinforcement (praise what people do right) and using time-outs (removing access to attention) combined with clear expectations for positive behavior.