Neuroeconomics and Decision-Making

Comprehensive vocabulary flashcards covering neuroeconomics, cortico-basal ganglia motor loops, decision-making latency, utility theory, conditioning, habit formation, memory systems, and neuroimaging modalities based on the lecture notes.

Neuroeconomics

The study of human decision-making and thinking and how it is intertwined with economics.

Decision-Making Latency

The anatomical decision-making process begins roughly $120\,\text{ms}$ after a stimulus is introduced and anywhere from $300\,\text{ms}$ to $10\,\text{s}$ before the decision is physically executed.

Mesolimbic Pathway

A dopaminergic pathway that transports dopamine produced in the Ventral Tegmental Area (VTA) to the Nucleus Accumbens, amygdala, and medial prefrontal cortex; it determines wants, desires, and controls intrinsic motivation.

Frontal Cortex-Basal Ganglia-Thalamic Circuit

A regulatory motor loop where processed inputs from the prefrontal cortex, premotor cortex, and parietal lobe pass through the striatum (caudate and putamen) and globus pallidus to the thalamus, which then projects back to the cortex to regulate motor execution.

Direct and Indirect Basal Ganglia Pathways

Dual pathways regulating motor output: the direct pathway utilizes $D_1$ dopamine receptors in the striatum to inhibit the globus pallidus internal segment/substantia nigra pars reticulata to disinhibit the thalamus, whereas the indirect pathway utilizes $D_2$ receptors projecting through the globus pallidus external segment and subthalamic nucleus to increase inhibition onto the thalamus.

Prefrontal Cortex (in decision-making)

The cortical region where the decision itself is made.

Premotor Cortex

The cortical area that helps plan the motor actions of a movement, working simultaneously with the parietal lobe.

Parietal Lobe (in motor planning)

Helps plan movement by locating where you are in relation to surrounding objects and forwards this processed information to the striatum.

Dorsal Striatum

A basal ganglia structure that suppresses obstructing movements and helps select the specific movements necessary to execute a chosen decision.

Globus Pallidus Internal Segment (GPi)

A basal ganglia segment involved in both direct and indirect pathways that sends inhibitory signals directly to the thalamus to regulate voluntary movement.

Globus Pallidus External Segment (GPe)

A basal ganglia segment involved only in the indirect pathway that processes motor information and regulates the basal ganglia circuit without projecting directly to the thalamus.

Thalamus (in motor control)

Relays regulatory signals to the motor cortex to modulate and guide the execution of movement.

Heuristics

Any decision-making shortcut that makes it simpler to make a decision; all rules of thumb are heuristics, but not all heuristics are rules of thumb.

Nudges

Framing interventions that influence decision-making by altering how choices or incentives are presented without restricting options.

Cognitive Dissonance

A state of psychological discomfort occurring when two different views held or actions taken are hypocritical and oppose each other.

Incentive

A reward, penalty, or stimulus that influences human choices.

Reward Undermining

A phenomenon where an intended reward paradoxically ends up serving as a disincentive.

Rational (Economic Definition)

Behaving strictly according to the rules and assumptions of an economic model.

Intrinsic Incentive

An internal motivation to perform an action because of personal satisfaction, enjoyment, altruism, self-esteem, or guilt avoidance.

Extrinsic Incentive

A tangible reward or punishment external to the individual, which can be positive (adding a stimulus) or negative (removing a stimulus).

Order Effects

Downstream consequences of an incentive, where direct side effects are second order effects, and consequences caused by those side effects are third order effects.

Perverse Incentive

An incentive structure that unintentionally causes the direct opposite of the original desired goal.

Cobra Effect

A classic example of a perverse incentive where a monetary reward for dead cobras led individuals to breed and release more cobras, resulting in an overall increase in the cobra population.

Utility Function

Any formula that quantifies the relationship between subjective value (satisfaction or preference) and an objective value.

Utility (Neuroeconomic Definition)

The average firing rate of a pathway of neurons that encodes subjective value, measurable via neuroimaging.

Nash Equilibrium

A condition where individuals make decisions to optimize their utility based on the choices of others in the same environment, where the decisions of others necessarily impact one's own choice.

Expected Value

The weighted average of all possible values of an outcome.

Law of Diminishing Marginal Utility

The principle stating that each additional gain or loss of a valuable resource yields progressively smaller changes in utility or pain, flattening out as values increase or decrease.

Reference Point

An adaptive, experience-dependent baseline against which gains and losses are evaluated; an identical outcome can feel like a gain or a loss depending on whether it falls above or below this baseline.

Path Dependence

The concept that the specific history or historical path taken to reach a current state directly influences future decision-making.

Habit

An automatic, learned, ordered, and routine behavior sequence that is not reward-oriented once established.

Experience Dependent Plasticity

The capacity of the brain to alter its physical structure and functional connectivity based on personal experiences.

Habit Memory

Slowly acquired, performance-based associations between stimuli and responses formed via trial-and-error learning that depend on the basal ganglia.

Declarative Memory

Conscious memory for objective information and factual knowledge.

Episodic Memory

A subtype of declarative memory involving the ability to recall and mentally envision personal experiences rich in sensory details, linked to emotions via the amygdala.

Implicit Memory

Subconscious memory characterized by knowing or recalling learned information without explicit awareness of how it was acquired; it requires both learning and a cognitive aspect.

Procedural Memory

A form of implicit memory rooted in previous physical experience and feel, such as driving a car or riding a bicycle.

Unaware Memory

An automatic state where routine actions are executed without active processing or conscious memory retention (e.g., driving on autopilot).

Addiction (Neuroeconomic Definition)

A compulsive, automatic behavioral shift away from goal-directed action toward cue-driven compulsion, characterized by basal ganglia cue-reactivity and dopamine dysregulation.

Rat Park Experiment

An experiment demonstrating environmental dependence in addiction, showing that rats in an enriched environment with mates, food, and toys avoid drug-laced water, unlike isolated rats in barren cages.

Contiguity

The temporal proximity between a conditioned stimulus or action and the subsequent reward, which must be brief for conditioning to occur.

Contingency

The conditional probability of a reward occurring in the presence of a conditioned stimulus compared to its occurrence in the absence of that stimulus.

Unconditioned Stimulus (UCS)

A stimulus that naturally and automatically triggers an unlearned physiological or behavioral response prior to any conditioning.

Neutral Stimulus

A stimulus that initially elicits no specific response prior to conditioning, which later becomes paired with an unconditioned stimulus.

Conditioned Stimulus (CS)

A previously neutral stimulus that, through repeated pairing with an unconditioned stimulus, comes to trigger a conditioned response.

Conditioned Response (CR)

The learned behavioral response elicited by a conditioned stimulus following associative training.

Continuous Reinforcement

A reinforcement schedule where the target behavior is reinforced every single time it occurs, leading to rapid learning, a low response rate, and fast extinction once rewards stop.

Extinction

The progressive weakening and eventual disappearance of a conditioned response when reinforcement is discontinued or absent for an extended duration.

Dopamine

A neurotransmitter that signals motivation, reward, and learning, operating primarily as a surprise or Reward Prediction Error (RPE) signal rather than a pure pleasure indicator.

VTA to Ventral Striatum Pathway

A dopaminergic circuit connecting the ventral tegmental area to the nucleus accumbens involved in reward, reinforcement, and the formation of mental habits.

Substantia Nigra to Dorsal Striatum Pathway

A dopaminergic pathway critical for motor function, motor habit formation, and physical addiction.

Medial Temporal Lobe

The brain region necessary for forming new declarative memories, though not required for storing previously consolidated memories.

Reward Prediction Error (RPE)

The difference between an actual received outcome and its predicted valuation, driving dopamine neurons to increase firing for positive outcomes, decrease firing for negative outcomes, and maintain baseline for accurate predictions ($\text{RPE} = 0$).

Ordinal Utility

Relative valuations assigned by the brain to available options, ranking them comparatively as 'better', 'worse', or the 'same'.

Habituation (Dopaminergic)

The neurobiological shift where dopamine neurons cease firing in response to a fully predicted reward and instead fire exclusively in response to the predictive cue.

fMRI (Functional Magnetic Resonance Imaging)

A noninvasive neuroimaging method that measures changes in blood oxygenation levels (BOLD) to generate spatially accurate activity heat maps, with an inherent temporal delay.

PET (Positron Emission Tomography)

A semi-invasive neuroimaging technique that utilizes injected radioactive tracers to measure glucose and energy consumption across different brain areas.

EEG (Electroencephalography)

A noninvasive imaging method that reads surface electrical signals from the scalp using electrodes, offering instant temporal readings with no delay but low spatial accuracy.

Amygdala

An almond-shaped structure located in the temporal lobe that links episodic memories with corresponding emotions and generates automated, pre-conscious feelings of dread, fear, and anxiety regarding loss.