(pt.2) Neuro Box 6

Instrumental learning is guided by two competing systems:

One reflects a kind of —- learning.

havit

Instrumental learning is guided by two competing systems:

One reflects a kind of habit learning→ It relies on ——- structures, such as the amygdala and striatum, and learns in an incremental fashion, guided by predictability and signal error.

lower-level

Instrumental learning is guided by two competing systems:

One reflects a kind of habit learning. It relies on lower-level structures, such as the amygdala and striatum, and learns in an —— fashion

incremental

Instrumental learning is guided by two competing systems:

One reflects a kind of habit learning. It relies on lower-level structures, such as the amygdala and striatum, and learns in an incremental fashion, guided by—— and ——

predictability (and) signal error

Instrumental learning is guided by two competing systems:

• One reflects a kind of habit learning. It relies on lower-level structures, such as the amygdala and striatum, and learns in an incremental fashion, guided by predictability and signal error.

• The other relies on the —- and provides a form of executive control that can ——-

(the) OFC ; rapidly bias behavior in the face of new information.

Instrumental learning is guided by two competing systems:

• One reflects a kind of habit learning. It relies on lower-level structures, such as the amygdala and striatum, and learns in an incremental fashion, guided by predictability and signal error.

• The other relies on the OFC and provides a form of executive control that can rapidly bias behavior in the face of new information.

  • It is the executive system that ——, ——-, and ——

evaluates potential outcomes, weighs the benefit of delayed reward, and sets goals

ndividuals who have disrupted executive function (from damage to the OFC) have trouble ——- As a result, their behavior is governed by the impulsive amygdala.

incorporating negative feedback from previous behavior to guide future behavior.

A wide range of stimuli, including ——— engage the reward system:

• smells and sexual cues,

• social reward (e.g., from positive feedback).

• arbitrary stimuli (CSs) that predict reward engage a similar pattern of neural activity

• the administration of punishment to a deserving defector can elicit reward-related neural activity

representing reward in terms of a common pattern of neural activity may facilitate the comparison of alternative outcomes that differ on multiple dimensions:

• quality

• immediacy

• magnitude

• valence

The competition between the ——— and ———- can help us understand how organisms weigh the relative value of a delayed reward

impulsive habit-based system (and) executive oversight

delayed discounting =

organisms will often choose a smaller immediate reward over a delayed larger reward

Researchers have suggested that it is the OFC that allows us to delay gratification, to select a delayed larger reward.

• Supporting this, lesioning the OFC biases behavior towards —-

immediate reward

Researchers have suggested that it is the OFC that allows us to delay gratification, to select a delayed larger reward.

• Supporting this, lesioning the OFC biases behavior towards immediate reward

• Conversely, damage to the nucleus accumbens increases ——

delayed discounting

Imaging studies have revealed that the choice of an immediate reward elicits (greater/ weaker?) activity in limbic areas

GREATER

Imaging studies have revealed that delayed reward engenders more activity in the —

frontal cortex

Imaging studies have revealed that the choice of an immediate reward elicits greater activity in limbic areas whereas delayed reward engenders more activity in the frontal cortex.

• Interestingly, again there appears to be a sub-division of labor, with immediate reward (go) eliciting activity in the——

medial OFC

Imaging studies have revealed that the choice of an immediate reward elicits greater activity in limbic areas whereas delayed reward engenders more activity in the frontal cortex.

• Interestingly, again there appears to be a sub-division of labor, with immediate reward (go) eliciting activity in the medial OFC.

• Conversely, greater activity was observed in the —— when subjects suppressed (no go) their choice in favor of a later delayed reward

lateral OFC

In —- behavior, individuals repeatedly choose an immediate outcome in the face of knowledge that doing so will likely entail long-term negative consequences.

addictive

In addictive behavior, individuals repeatedly choose an immediate outcome in the face of knowledge that doing so will likely entail long-term negative consequences.

• Such a pattern suggests a deficiency in weighing the value of outcomes over time, to—-

mentally project that choosing the delayed alternative will yield greater reward

In addictive behavior, individuals repeatedly choose an immediate outcome in the face of knowledge that doing so will likely entail long-term negative consequences.

• Such a pattern suggests a deficiency in weighing the value of outcomes over time, to mentally project that choosing the delayed alternative will yield greater reward.

  • Supporting this, research has shown that opioid addicts —— more than non-addicted subjects

undervalue a delayed reward

In addictive behavior, individuals repeatedly choose an immediate outcome in the face of knowledge that doing so will likely entail long-term negative consequences.

• Such a pattern suggests a deficiency in weighing the value of outcomes over time, to mentally project that choosing the delayed alternative will yield greater reward.

  • Supporting this, research has shown that opioid addicts undervalue a delayed reward more than non-addicted subjects.

  • Moreover, if the outcome is —-, addicts (surprisingly) discount even more

• heroin

It has been proposed that addiction arises because the hyper-reactive impulsive system——

overcomes the influence of the executive system, with a corresponding emphasis on immediate reward

drugs of abuse artificially engage reward systems and, with experience, —- the reward circuit, further biasing it towards an impulsive choice.

sensitize

treatment for addiction will require ——

a multifaceted approach, to both dampen drug reactivity and strengthen executive control.

Research has revealed a striking similarity in how the brain processes a diverse set of rewards, from food to social.

• Across these domains, instrumental learning is reinforced by ——and regulated by an error signal, the occurrence of which is well predicted by formal models.

(by) common neurochemical systems

Research has revealed a striking similarity in how the brain processes a diverse set of rewards, from food to social.

• Across these domains, instrumental learning is reinforced by common neurochemical systems and regulated by ——-, the occurrence of which is well predicted by formal models.

(by) an error signal\

Research has revealed a striking similarity in how the brain processes a diverse set of rewards, from food to social.

• Across these domains, instrumental learning is reinforced by common neurochemical systems and regulated by an error signal, the occurrence of which is well predicted by formal models.

These observations suggest a remarkable degree of —— in structure and function with regard to reinforcement learning

conservation