Exhaustive Study Guide on Learning: Classical Conditioning, Operant Conditioning, and Cognitive Models

Foundations of Learning and the Measurement of Progress

• Definition of Learning: Within the scope of psychology, learning is defined as a change in behavior specifically based on experience.
• The Learning Curve:     * Graphic Representation: This is any graphic representation illustrating the process of learning.     * Typical Shape: The curve is typically characterized as being negatively accelerated.     * Rate of Learning: Humans do not learn at a constant rate, which is reflected in the non-linear path of the learning curve.     * Acquisition: This refers to the first steep upward slope observed on the learning curve. It represents the portion of the learning process characterized by a consistent increase in responsiveness. This change carries a level of permanence.

The Forgetting Curve and Memory Loss

• Hermann Ebbinghaus: The researcher Hermann Ebbinghaus established that humans do not forget information at a constant rate.
• Patterns of Forgetting: The forgetting curve shows a sharp drop in retention immediately following the learning event. This initial plunge is followed by a much slower, gradual loss of the material over time.

Classical (Pavlovian) Conditioning

• Definition: Also known as Pavlovian conditioning, this is a type of learning where an involuntary response—which is naturally elicited by one specific stimulus—comes to be elicited by a different, formerly neutral stimulus.
• Pavlov’s Classic Experiment (Figure $8-2$):     * Before Conditioning:         * The Unconditioned Stimulus (UCS), such as food in the mouth, produces an Unconditioned Response (UCR), such as salivation.         * A Neutral Stimulus, such as a tone, produces no salivation (no response).     * During Conditioning:         * The Neutral Stimulus (tone) is presented just before the Unconditioned Stimulus (food in mouth). The UCS continues to produce the Unconditioned Response (salivation).     * After Conditioning:         * The previously neutral stimulus now produces a Conditioned Response (CR), thereby becoming a Conditioned Stimulus (CS).         * Result: The tone (CS) leads to salivation (CR).
• McGraw-Hill Corporate Example of Classical Conditioning:     * Before Conditioning: A Boss's criticism (US) leads to Tension and high blood pressure (UCR).     * Conditioning Phase: A Neutral stimulus, which is anything related to the boss (office, job, co-workers), is associated with the Boss's criticism (UCS), which still leads to Tension/high blood pressure (UCR).     * After Conditioning: Anything related to the boss (office, job, coworkers) becomes the Conditioned Stimulus (CS), leading to Tension and high blood pressure as the Conditioned Response (CR).

Specialized Phenomena in Classical Conditioning

• The Garcia Effect: This is a conditioned taste aversion. It occurs when an organism seeks to avoid a specific food due to an aversion response to its smell or taste. Notably, it can be formed after just a single consumption of a novel food.
• Generalization: The tendency to give the identical response to different but similar stimuli. This involves making responses similar to the original reinforced or conditioned response within the conditioning environment.     * Examples: Pigeons pecking at disks of different colors; humans dating people who share a common mode of dress.
• Stimulus Discrimination: The inverse of generalization. This occurs when an organism learns to respond only to a stimulus that is exactly the same as the original conditioned stimulus.     * Example: In the case of Little Albert, he would fear only the furry white rat and would not show fear toward masks, coats, or dogs.
• Key Concept of Association: The fundamental key to classical conditioning is forming a connection between a stimulus and a response. These associations are not necessarily permanent.

Behavioral Changes and Timing in Conditioning

• Habituation: A decrease in response to a stimulus after it has been presented repeatedly. For example, a novel sound in the environment draws attention only at first.
• Dishabituation: The restoration of a response to its full strength after it has been weakened by habituation.
• Order of Presentation:     * Backward Conditioning: The reward precedes the stimulus.     * Trace Conditioning: There is a specific period of time between the stimulus and the reward.     * Simultaneous Conditioning: The stimulus occurs at the exact same time as the reward.     * Delayed Conditioning: The reward is presented only toward the end of the stimulus.

Breaking the Conditioned Connection

• Extinction: The repeated presentation of the Conditioned Stimulus (CS) without the Unconditioned Stimulus (UCS).
• Counterconditioning: A second, incompatible response is conditioned to a stimulus that is already conditioned.
• Desensitization: The process of conditioning a relaxation response to a stimulus that previously evoked anxiety.
• Spontaneous Recovery: The recurrence of a response even after extinction has seemingly been accomplished.     * Example: Dogs may still occasionally drool at the sound of a bell even after they have realized the bell no longer strictly represents food.

Operant Conditioning and the Law of Effect

• Origins: Based on early $20^{th}$ century experiments conducted by Edward Thorndike.
• Definition: The shaping of behavior through the use of positive reinforcement to strengthen desirable behavior and punishment to discourage undesirable behavior.
• Thorndike’s Law of Effect: Also known as the "Principle of Reinforcement," it states that behavior that is consistently rewarded will be "stamped in" as learned behavior, while behavior that results in discomfort will be "stamped out."
• Successive Approximations (Shaping): A method used to reinforce complex behaviors by rewarding small, sequential bits of the target behavior to build toward the final conduct.     * Example: Training tigers to jump through flaming hoops.

Reinforcement and Reinforcers

• Reinforcement: A reward presented after a behavior to increase the probability that the behavior will recur.     * Positive Reinforcement: Any event whose presence increases the likelihood of a behavior recurring.     * Negative Reinforcement: Any event whose reduction or termination increases the likelihood of a behavior recurring.
• Types of Reinforcers:     * Primary Reinforcers: These are intrinsically rewarding. Their value does not need to be learned. Examples include food, water, and sex.     * Secondary Reinforcers: These have no intrinsic value on their own but acquire value through association with primary reinforcers. Money is the primary example.

Schedules of Reinforcement

• Continuous Reinforcement: Providing reinforcement every single time a response is made (e.g., putting coins into a vending machine).
• Fixed-ratio Schedule: Reinforcement occurs after a fixed number of responses (e.g., being paid for every $100$ dresses sewn).
• Variable-ratio Schedule: Reinforcement occurs after a varying number of responses (e.g., slot machines or the success of a car salesman).
• Fixed-interval Schedule: Reinforcement is provided after a fixed amount of time has elapsed (e.g., a salaried paycheck).
• Variable-interval Schedule: Reinforcement of the first response occurs after varying amounts of time have passed (e.g., a teacher collecting homework at random times; watching a football game waiting for a touchdown).

Educational and Behavioral Implications of Operant Conditioning

• The Premack Principle: Identified by David Premack (and known as the "grandmother clause"), this involves identifying what is reinforcing for a subject and using that to reinforce desired behaviors the subject is unlikely to do independently.     * Example: A grandmother promising her grandchild she will play in the sandbox with him only if he finishes his asparagus.
• Overjustification: The phenomenon where reinforcing a behavior the individual is already naturally disposed to do can actually discourage them from continuing the behavior.     * Example: Children in reading programs may actually read less once the external reward for reading is removed.
• Behavior Modification: B. F. Skinner was a major proponent of operant conditioning but argued against the use of punishment due to the risk of negative outcomes. He favored behavior modification through reinforcement alone.

The Limitations and Risks of Punishment

• Ineffectiveness: Punishment merely stops a behavior; it does not teach a desired alternative behavior.
• Ethical/Social Concerns: Physical punishment can suggest that inflicting pain on others is a justifiable action.
• Learned Helplessness: Punishment delivered without a clear, identifiable cause generates learned helplessness.
• Superstitious Behavior: Conversely, reinforcement provided without a clear cause promotes superstitious behavior.

Latent Learning and Human Insight

• Latent Learning: This is learning that is not immediately reflected in a change of behavior.     * Study: In $1930$, Honzik and Tolman demonstrated that rats learn even without receiving a reward.     * Mechanism: It is believed to be stored as a mental image known as a "cognitive map," which can be recalled as needed.
• Human Insight: The sudden "coming together" of elements in a situation so that the solution or most efficient path becomes instantly clear (the "Eureka!" moment).     * Nature of Learning: This suggests learning is not always a smooth, steady path.     * Classic Experiment: Wolfgang Kohler’s work with chimpanzees during WWI.

Observational Learning

• Definition: Learning that occurs by watching others rather than through direct conditioning.
• Key Proponent: Albert Bandura is the foremost proponent of this theory.
• Vicarious Learning: Learning occurs by witnessing vicarious reinforcement and vicarious punishment. Social behaviors like aggression and concern for others are often learned this way.
• Examples:     * Baby monkeys learning to knock food out of a tree with a stick after watching their mothers do it.     * First-time patrons at a Japanese restaurant taking off their shoes and sitting on the floor after observing other patrons.