multimodality

what is multimodal perception?

perception relating to two or more sensory processes

what is the superadditive effect of multisensory integration?

the whole is grater than the sum of its parts such as hearing & seeing someone speak is more stimulating than either modality alone

what does the superior colliculus do in the superaddative effect?

receives input from multiple sensory areas (visual, auditory, motor, somatosensoty)

the sum of reactions to unimodal components of a multimodal stimulus?

is less than the overall reaction to the whole multimodal stimulus

when is multimodal integration more likely?

when multimodal stimuli arise from about the same location and occur at the same time

in what example does our visual system trick our auditory system?

ventriloquism: talking without moving your mouth

in what examples does our auditory system trick our visual system?

double flash illusion: 2 beeps but only 1 visual information

for touch & vision, what is the rubber hand illusion?

a perceptual phenomenon where a person feels ownership of a rubber hand that is being stroked in sync with their hidden real hand, creating a sense of touch in the rubber hand.

for touch & audition, what is the chalkboard writing illusion?

feels smoother when you don't hear the chalk against the chalkboard than when you do hear it

for olfaction & vision, what was the wine smelling experiment?

to describe the smell of wine (red and white), described both wines individually, week later the experiment is done again with two white wines except one is dyed red, described the same even though they’re the same white wine

for gustation & vision, what was color congruency?

perceived taste of food is influenced by its color, leading people to rate flavors differently based on visual cues.

for gustation and dining aesthetics, what does it mean?

the presentation and visual appeal of food can significantly influence the perceived taste and enjoyment of a meal, affecting diners' overall experience.

what is mental imagery?

occcurs when a representation of the type created during perception is present, but the physical stimulus is not actually perceived

mental imagery is not limited to?

not limited to visual modality (you can have it for all modalities)

whats auditory imagery?

the experience of sound without a stimulus such as mentally stimulating voices of speakers when they read

whats cross-modal imagery?

we all have synesthetic experiences where one modality can cause us to perceive something in another

what can some imagery be brought about?

perceptual cues

what is synesthesia?

when sensations in one modality are experienced simultaneously in another modality or cognitive activity

how should experiences for synesthesia be?

highly specific, automatic, and fixed over time

whats the most common synethesia?

grapheme — color

what is grapheme color?

associates color with number or letters

where does synesthesia come from?

development or experience; neural connections might have not been pruned

what is tryphobia?

texture-emotion (holes)

what is misophonia?

Sound-emotion (nails on chalkboard)

what tests for synesthesia?

stroop-like

synesthesia is a?

spectrum