L&C - Choice, Matching, & Self-Control (10)

concurrent schedules

two or more schedules of reinforcement that are simultaneously available but independent of each other (have to choose between the two) (ex. go to the mall — we have several stores to choose from)

matching law

our rate of responding on one schedule matches the rate of reinforcement (ex. 2 schedules, A and B… between them we get 100% reinforcement, 85% from A and 15% from B)

undermatching

rate of response is lower than rate of reinforcement

overmatching

rate of response is higher than rate of reinforcement

bias

regardless of rate of reinforcement, we keep choosing one schedule over the other (this shows us our natural preferences)

general matching law (GML)

matching law but effort, accessibility, and cost are factored into the equation (ex. all nighter study, yes or no? answer depends on several factors)

self-control

the ability to delay gratification

determinist

Skinner’s perspective; believed our behaviour was shaped by our genes and the environment, but also believed that we retain a high degree of control over our
environment and can shape our destiny through self-control

controlled responses

behaviours we want to change (ex. smoking)

controlling responses

helps us change behaviours we don’t like (ex. nicotine patches)

the strength model of self-control

self-control is a limited resource but it’s like a muscle—we can exercise it to make it stronger but if we over-train it, it will be fatigued and we won’t be able to use it (it also needs rest to recover and grow)

Mishel’s delay of gratification paradigm

there are two systems at play in delay of gratification: hot system and cool system

delay of gratification

being able to say no to a small and immediate, but pleasurable reward in favour of a larger, long-term reward

hot system

• present and active at birth

• a system that is fast, automatic, reflexive, and emotional

• guided by what gives us pleasure and relief

• mainly focused on immediate rewards and threats

• linked to the limbic system

• arouses the body, creating negative emotions that make us want small rewards even more when gratification is delayed

cool system

• develops as we grow

• slow, calm, collected, deliberate

• squishes urges for immediate reward and strategizes for the long term

• linked to the PFC

• can dominate the hot system as we develop but stress and overwhelm can force this system out of control

delay discounting

the value of the same reward is going to differ depending on how close/far it is in time

steep discounting

devaluation of a reward at high rates

shallow discounting

depreciation of a reward at low rates

Ainslie-Rachlin Model

when there’s a large and small reward immediately available, the larger reward will be chosen; when there is a large and small reward available in the long-term, we will initially choose the larger reward but over time, the smaller reward gains power and we choose it instead

small but cumulative effects model

any big outcomes, positive or negative, does not occur overnight but it is the result of many small choice—every small choice is inconsequential but when they are consistently repeated, they add up in a cumulative effect and lead to big outcomes