fuck it we ball.

What is the importance of schedules of reinforcement?

It demonstrates how environmental events are related

IV

Constellation of antecedent/consequent events

DV

The actual behavior

Sd \= \_____ (in relation to the skinner box)

stimulus light/lever press/drop of water

How many ways can the three part contingency be arranged?

Can be arranged thousands of different ways, these ways are called schedules.

includes schedules of reinforcement and consequences

Schedules

A general assumption regarding schedules/the three-part contingency

That IVs cause DVs \----we should not assume this but rather confirm this through our hypothesis.

Four things that will change behavior:

1) Changes in the SD will change behavior
2) Changes in the MO will change the behavior
3)A particular history will change the behavior
4) Changes in Sr/Sd will change the behavior

What helps determine functional (aka casual) realtions?

The various ways in which the schedules of reinforcement. or punishment are arranged

What are the four subdivisions of Reinforcement/Punishment?

1)simple arrangements
2)complex arrangements
3) molar/molecular arrangements
4)schedules made up of other schedules

Molar vs molecular arrangements

Molar refers to longer intervals (an example could be the season of winter)\-- whereas molecular refers to moment to moment intervals/interactions.

The five subdivisions of simple schedules

1) Non intermittent schedules
2)intermittent schedules
3) response based
4) Response and time based
5)time based

The four subdivisions of complex schedules

1) various combinations of simple schedules
2) various combinations of complex schedules
3) various combinations of complex and simple schedules
4) schedules of schedules

viewing behavior as responses per unit of time yields a \______

response rate

response rate is equivalent to

the dependent variable (response patterns also show us the temporal organization)

When are cumulative records used ?

contemporary operant laboratories

Schedules of reinforcement diagram

Note that IRT\>t is not on the diagram so familiarize yourself with that one from your notes when studying this card

Response based schedules (2)

1) Non intermittent
2) Intermittent

Two types of non- intermittent schedules

1) extinction (EXT)
2) continuous reinforcement (CRF)

every response produced is reinforced (Sr) or punished the same as FR-1

Continuous reinforcement (CRF)

None of the responses are reinforced

Extinction (EXT)

Two types of intermittent schedules

1) fixed ratio
2) variable ratio

Reinforcement Sr is delivered following the occurrence of a fixed number of responses

Fixed ratio

Reinforcement Sr is delivered following the occurrence of an average number of responses/ the number of responses is expressed as an average of quasi-random series of number lying arbitrary between a fixed mean

variable ratio

What are the four response based schedules?

1) continuous reinforcement
2) Extinction
3) fixed ratio
4) variable ratio

What are the three response and time-based schedules?

1) Fixed interval
2) variable interval l
3) Inter-response time \> t (IRT \> t)

The first response produced following the passage of a fixed amount of time will be reinforced (Sr)

Fixed Interval (FI)

The first response produced following the passage of a variable amount of time will be reinforces (Sr) . The amount of time is expressed as an average of a quasi-random series of intervals lying between arbitrary values with a fixed mean.

Variable Interval (VI)

The first response produced following the passage of "t" amount of time will be reinforced (Sr). Responses occurring prior to the passage of 't' time will reset the interval. THIS IS ALSO KNOWN AS DRL

Inter-response time greater than t (IRT \> t)

What are the two time based schedules?

1) fixed time
2) variable time

Reinforcement (Sr) is presented following the passage of a fixed amount of time irrespective of the organism's behavior.

Fixed time (FT)

Reinforcement (Sr) is presented following the passage of a variable amount of time irrespective of the organism's behavior. The amount of time is expressed as an average of a quasi-random series of intervals lying between arbitrary values with a fixed mean.

Variable time (VT)

four types of complex schedules (when I say four we know there is many types of all these schedules I just mean in relation to what we are studying)

1) Chained (Chain)
2)Tandem (Tand.)
3) Concurrent (Conc.)
4)Conjunctive (Conj.)

1) A single reinforcement (Sr) is contingent on the successive completion of two or more schedules.
2) There is a programmed stimulus change between the completion of one schedule and the initiation of the next. The stimulus change functions as (Sr).

chained schedule (chain)

1) A single reinforcement (Sr) is contingent on the successive completion of two or more schedules
2) There is NO programmed stimulus change between the completion of one schedule, and the invitation of the next. NO programmed conditioned reinforcement (Sr).

tandem schedule (Tand.)

1) Two or more schedules independently arranged but in operation at the same time, with reinforcement (Sr) arranged by both schedules.

Concurrent (Conc.)

1) A single reinforcement (Sr) presentation is contingent upon the requirements of two or more schedules being met.
2) Each schedule is programmed for the same response.

Conjunctive (conj.)

Two Types of Aversive Schedules

1) Escape (Esc)
2) Discriminated Avoidance Escape (disc. AV-ESC)

1) following an intertrial period of no shock
2) of either fixed or variable duration
3) the shock is delivered and remains on until a specified response occurs (the shock is an example of any aversive event)

Escape (esc)

1) following a period, of either fixed or variable duration
2) with no onset of shock or (S-aversive), an (S-aversive) will be presented.
3) if the specified response is made prior to the off-set of the (S-aversive), the (S-aversive) turns off, and the period starts over.

Discriminated avoidance escape (dis. AV-ESC)

schedules particularly variable schedules, are much more difficult to extinguish than a non-intermittent schedule.

Intermittent schedules

Of a response is often followed by an 'extinction burst' , a return of the 'extinguished' response

Extinction

The \_________ should be delivered on a non- intermittent (FR-1) schedule

a. punisher
Why?
It is the most effective if it not delivered intermittently

The \_________ should be delivered on an intermittent schedule

a. reinforcer
Why?
It is the most effective if it is delivered intermittently

An example of engineering behavior with schedules

a. rats playing basketball

Is a very precise way of describing behavioral contingencies

State notation

A static condition of the environment

State

a number of states connected by transition lines (parallel state sets)

State-Set

\______ state(s) are always in effect

one

What is the rule with state notation?

only one state in a state set can be in effect at any time (when a procedure is running one and only one state is in effect at any given moment)

1) Reinforcement (Sr) is programmed by each of two or more schedules that usually alternate
2) Change from one schedule to the next occurs simultaneously with a change in the prevailing (Sd) for the duration of that schedule

Multiple (Multi) schedule

1) Reinforcement (Sr) is programmed by each of two or more schedules (that usually alternate)
2) Change from one schedule to the next is NOT accompanied by a change in the prevailing Sd. (AKA NO UNIQUE SDS)

Mixed (MIX) Schedule

types of events for changing the environment written on the transition line

input variables

experimenter-produced event

start

an environmental change produced by the organism (R1, R2, ,R3)

response (R)

usually denoted by the actual value (sec, min , hour )

Time

inputs and outputs are separated by a \______

colon

ways in which the environment can change

Output Variables

represented by arrows (leaving one state, and entering or re-entering another state)

Transition and Re-entry

the transition is assumed to be \_______

instantaneous

a stimulus condition (S1, S2, S3, etc)

Stimulus (S)

A stimulus change related to reinforcement

reinforcers (Sr)

a stimulus change related to punishment

punisher (sp)

output that ends the session

stop

''

seconds

'

minutes

h

hour

S1, S2, S3, etc.

the SD (example red light\---stimulus)

R1, R2, R3 etc.

the response operandum (example R1\= right lever)

sometimes we must arrange several \_____ to operate at the same time, for such occasions multiple \______ are identified separately

state sets

S,S,1

state set one

S,S,2

state set two

an electrical signal that communicates between 'state sets' will suspend activity on the schedule that produces it, will initiate activity on the schedule it enters (Z1, Z2, Z3)

z pulse

What is the problem with concurrent schedules?

It can reinforce behavior, instead of choice. This can be solved through temporal contiguity.

Which two schedules study choice?

Conjunctive, and Concurrent

The aversive control of behavior is also called \______

'the dark side'

What are the two reasons we study aversive control?

1) most of our social behavior is maintained by aversive control
2) almost all of our system juris prudence is based on aversive control

Punishment should be used as a \______

last resort

SIB

self jurying behavior (schedules with aversive consequences can be ethically used on people with SIB , as the punishments are less severe then the result of them hurting themselves)

The effects of punishment are NOT \______ to that of reinforcement

symmetrical

Reinforcement is more effectively when used \_____ and less effective when used \___________

intermittently, every-time

Punishment is more effective if used \_____ and less effective if used \_____

every time, intermittently

Punishment tends to reinforce the \______

the person utilizing punishment (hitting little brother example)

Punishment produces several 'by-products' or other disruptive behaviors.

1) avoidance and escape
2) decrease of non-related responses
3)aggressiveness toward the punishing agent/agency (leads to riots/revolutions in group/societal situations)

Aversive control can also produce

learned helplessness, reflexive (pain-induced) aggression

What do behavior analysts attribute feelings to

stimuli, and environmental factors(AKA WHAT YOU FEEL IN YOUR BODY)

Behavior analysts suggest that behavior is NOT caused by \______

feelings

People often explain their behavior and that of others as being caused by feelings

when it actually produced by the loss of reinforcement Sr

Gambling is based on

RR/VR schedules

feelings associated with extinction

anger, frustration, etc.

feelings associated with VR? With relatively small parameters?

accomplishment, success, winning

feelings associated with IRT\> t (AKA DRL SCHEDULES)

learning to patient or feel patience/waiting

feelings associated with escape schedules

anxiety, worry, stress

feelings associated with schedules of reinforcement where the density of the reinforcement is fairly high

happy, good

'feelings' are by products of

schedules of reinforcement/punishment along with classical conditioning

feelings are NOT among the class of

controlling variables

Antecedent events

Sd, Sa, MO , H

consequent events

Sr, Sp,

consequent events are \___ effective, and \_____

momentarily , transitory

the effectiveness of consequent events depends largely on

MOs