conditioning and learning exam #3

Thorndike research methods

cats/chicks in puzzle boxes

thorndike data analysis

quantitative measurements, learning curve, trial and error analysis (connection strength), frequency of successful actions over multiple trials

throndike key contributions

law of effect, transfer of learning

law of effect

responses followed by a satisfying/rewarding outcome are more likely to be repeated than those followed by negative/unpleasant outcomes

transfer of learning

when learning in one situation facilitates or hinders learning in another

skinner research methods

operant conditioning chamber, shaping

operant conditioning chamber

box containing a lever or button that an animal could press to receive a food reward or avoid receiving a mild shock

shaping

successive approximations towards a more complex behavior are reinforced (rewarding small steps towards a more complex behavior)

skinner data analysis

identified patterns in behavior through recording response rates and the effects of different reinforcement schedules

skinner key contributions

developed the theory of operant conditioning, reinforcement schedules

theory of operant conditioning

behaviors are influenced and modified by their consequences

reinforcement schedules definition

plans that determine how/when a reward is given following a desired behavior

puzzle box

focused on trial and error learning, confined box with a mechanism than an animal must use to escape, clear goal of escape, usually used cats, observes how quickly animal learns to escape over successive trials

operant conditioning chamber

delivers rewards/consequences in response to animal behavior, animal learns to complete specific actions in order to receive reward/avoid consequence, focuses on relationship between behavior and its consequences, records response rates and effects of different reinforcement schedules

latency

amount of time that elapses between presentation of a stimulus (red light) and the initiation of a response (rat pressing lever)

responce rate

frequency of a specific behavior during a set time period

latency puzzle box

amount of time it takes cat to escape the puzzle box, shorter latency=cat is learning how to escape

latency operant conditioning chamber

amount of time time it takes animal to initiate a desired response (pressing a lever) after a specific stimulus (red light)

response rate puzzle box

frequency with which the cat performs the actions necessary for escape within a given time frame

response rate operant conditioning chamber

number of times animal engages in target behavior over a specific time frame (amount of time rat presses lever after cue in 30 minutes)

three term contingency

relationship between antecedent/discriminative stimulus (light turns on), behavior/response (rat presses lever), consequence/reinforcer/punisher (rat receives food pellet)

three term contingency in lab example

red light in a skinner box turns on, rat presses lever, rat receives food pellet

three term contingency out of lab example

teacher asks question, student answers correctly, student receives praise

pavlovian learning

learning to associate one stimulus with another, passive/involuntary responses (salivating, blinking), applied in emotional responses/phobias

operant conditioning

behaviors are modified based on their consequences, active/voluntary responses (pressing a lever, answering a question), applied in behavior modification/education

similarities between operant conditions and pavlovian learning

both involve the formation of associations (behaviors with consequences/stimuli with response), both are essential to behavior modification

example where pavlovian learning and operant conditioning both occur

dog training: dog hears a bell (CS) and is given food (US), the dog will begin to salivate (CR) at the sound of the bell (CS). dog sits and receive treats, dog will associated sitting with being given a reward

positive reinforcement

behavior is followed by a positive outcome

negative reinforcement

removal of an aversive stimulus following a specific behavior

positive reinforcement in lab example

after a rat presses a lever it receives a food pellet

positive reinforcement out of lab example

students who raise their hands in class receive tokens (ex. stickers)

primary reinforcement

reinforcement that satisfies a basic biological need/drive (food, water)

ffw

free feeding weight (weight when animal has free access to food)

conditioned reinforcement

reinforcement that acquires its value through association with primary reinforcers (money, praise)

eo

establishing operation (manipulation prior to three term contingency exposure that INCREASES the efficacy of the reinforcer)

ao

abolishing operation (manipulation prior to three term contingency exposure that REDUCES the efficacy of the reinforcer)

primary reinforcement in lab example

primary reinforcement in skinner box is the food pellet the rat receives after pressing the lever

primary reinforcement out of lab example

dog is given a treat every time it successfully sits on command

conditioned reinforcement in lab example

conditioned reinforcement in skinner box is the red light that flashes when the rat is given a food pellet

conditioned reinforcement out of lab example

clicker used in animal training

similarities between positive and conditioned reinforcement

both aim to increase the target behavior, both can experience extinction, both involve stimulus association

differences between positive and conditioned reinforcement

positive reinforcement is intrinsic/conditioned reinforcement is formed through association, positive reinforcement has direct association/conditioned reinforcement has indirect association

functional definition

describes a concept based on purpose/function rather than on physical characteristics/inherent qualities

Describe the three conditions that must be met to conclude that a reinforcement effect has been demonstrated

behavior must have a consequence, behavior must increase in strength, increase in strength of behavior must be due to the consequence

natural reinforcement

the process by which behaviors and strengthened/weakened through the natural consequences of that behavior

contrived reinforcement

rewards/consequences that are intentionally designed to encourage/discourage a specific behavior

natural reinforcement out of lab example

a child shares toys and receives praise and friendship

contrived reinforcement in lab example

pidgeon in skinner box receives a food pellet every time it pecks at a button

contrived reinforcement out of lab example

students in a classroom receiving tokens as a reward for good behavior

Describe why contrived reinforcement is crucial in developing socially appropriate skills.

contrived reinforcement can be built to provide immediate feedback which quickly reinforces the behavior, children may not naturally engage i socially appropriate behavior without significant motivation

Where do primary reinforcers gain their efficacy from?

primary reinforces gain efficacy from their innate/evolutionary value (biological need for food/water)

Where do conditioned reinforcers gain their efficacy from?

conditioned reinforcers gain their efficacy through association with primary reinforcers

positive reinforcement/negative reinforcement similarities

more effective when reinforcer immediately follows target behavior, effectiveness varies from person to person, aim to increase the occurrence of the desired behavior

positive reinforcement/negative reinforcement differences

positive reinforcement involves addition of desired stimulus, negative reinforcement involves removal of an aversive stimulus

why are positive/negative reinforcement functional definitions

they are defined by their impact on behavior and the outcomes they produce, rather than by the specific stimuli or actions involved.

shaping

behavioral technique used to teach a complex behavior by reinforcing smaller steps towards this behavior

shaping out of lab example

learning to tie shoes: parent rewards child for first step, second step etc.

shaping in lab example

training rats to complete maze:rats initially rewarded for simply entering maze

contingency

the predictability of a behavior being follow by a specific consequence, for learning to occur contingency must be high

contiguity

the closeness in time between a behavior and its consequence, can vary (such as cases of taste aversion), usually must be short for higher learning

immediate reinforcement

consequence directly after target behavior

un signaled delayed reinforcement

consequence for desired behavior is delivered after a time delay without any signal that a consequence will occur

signaled delayed reinforcement

clear indication following behavior (clicker) that consequence will occur, consequence occurs after time delay