Reward, Reinforcement, and Addiction

Fear Conditioning and Extinction Recap

  • Extinction doesn't erase fear memory but creates a new competing memory.
  • Hippocampus is vital for both fear expression and extinction.
  • Infralimbic (IL) cortex is needed for fear extinction, while prelimbic (PL) maintains fear.
  • Children and adolescents show differences in spontaneous recovery, cued extinction, and contextual conditioning related to vmPFC/IL and hippocampus.
  • Reconsolidating updates alter memory at the amygdala level, reducing fear memory recovery.
  • Several anxiety disorders exist, including PTSD, phobias, and generalized/social anxiety.
  • Stress induces physical/emotional/psychological strain (inverted U effects).
  • The hypothalamic–pituitary–adrenal (HPA) axis controls the release of stress hormones.
  • Glucocorticoid stress hormones can elevate anxiety.
  • Early life experiences can cause lasting changes in stress responses.
  • HPA response to stress is delayed and longer-lasting compared to the sympathetic nervous system.

Reward-Related Learning

  • Classical conditioning involves forming associations between conditioned stimulus (CS) and unconditioned stimulus (US).
  • Operant conditioning involves acquiring behaviors followed by a reinforcer.
  • Shaping involves gradually molding a target behavior by rewarding successive approximations.

Dopamine and Reward

  • Dopamine neurons originate in the VTA and SN (midbrain).
    • VTA projects to the frontal cortex (mesocortical) and nucleus accumbens (mesolimbic).
    • SN projects to the striatum (nigrostriatal pathway).
  • The medial forebrain bundle (MFB) contains fibers from the forebrain and brainstem, including the VTA.
  • Electrical stimulation of the MFB can have positive effects on mood.
  • Dopamine is necessary for brain stimulation to reinforce behavior.
  • Dopamine neurons fire:
    • To unexpected reward (positive prediction error).
    • To cues that predict reward.
    • Decrease firing when expected reward is omitted (negative prediction error).
  • Nucleus accumbens is activated when subjects expect monetary gain (secondary reward).
  • The nucleus accumbens is strongly activated when subjects anticipate a large smile.
  • Dopamine strengthens connections between cortical and striatal neurons during reward learning.
  • A behavior that precedes a dopamine surge (unexpected reward) is reinforced.
  • An increase in glutamate receptors at the synapse increases likelihood that animal will press lever in future.

Drug Reward and Addiction

  • Dopamine is released from dopamine neurons and cleared by dopamine transporters.
  • Cocaine blocks dopamine reuptake, increasing dopamine levels in the synapse.
  • Amphetamine increases dopamine and norepinephrine release into the synapse.
  • Dopamine receptor blockers reduce the rewarding effects of cocaine.
  • Nicotine binds to nicotinic acetylcholine receptors in the VTA boosting dopamine release in the nucleus accumbens and prefrontal cortex.
  • Heroin, morphine, and oxycodone are opioid drugs that increase dopamine release in the nucleus accumbens.
  • Alcohol produces neuroadaptations, including DA hypoactivity.
  • Alcohol advertisements activate orbitofrontal cortex and ventral striatum.
  • Drug tolerance: reduced drug effectiveness with repeated use.
    • Metabolic tolerance: body becomes better at ridding itself of the drug.
    • Functional tolerance: reduced sensitivity of target sites.
    • Conditioned tolerance: tolerance occurs only in the environment where the drug was taken.
  • Drug withdrawal includes mood changes, physical symptoms, and increased stress hormones.
  • Addiction is a vicious cycle of drug reinforcement, withdrawal, bingeing, and craving.
  • Inhibitory control depends on the prefrontal cortex; drugs of abuse impair prefrontal cortical function.
  • Korsakoff syndrome damages nerve cells and supporting cells in the CNS, and impacts memory both in acquiring and establishing new memories, and in retrieving previous memories.