Intermodal Perception & Perception and Action

What is intermodal perception and what are the two main perspectives?

Intermodal perception is the ability to perceive events through multiple sensory modalities (e.g., seeing and hearing something at the same time).

Two main perspectives explain how this works:

• Integrational perspective: different sensory inputs are processed separately and then integrated together

  • EX: I see a dog (visual) and I hear a bark (auditory)

• Unified perspective: perception is inherently multisensory from the start, with information processed as a unified whole

  • EX: It is a dog that is barking

What are amodal invariants in perception?

Amodal invariants are properties of objects or events that can be detected across multiple sensory modalities (e.g., sight, sound, touch). These include features like rhythm, tempo, intensity, and duration that remain consistent regardless of the sensory system used.

They help the brain integrate information from different senses into a unified perception of the environment.

What are the different types of Intermodal Perception?

Auditory-Visual

Visual-Kinesthetic

Auditory-Kinesthetic

Spatial-Temporal

How does auditory-visual intermodal perception develop across childhood?

Auditory-visual intermodal perception is the ability to link what we see and hear.

• Newborns: can link visual and auditory events early, with rapid improvement before 1 year of age

• Childhood (5–12 years): ability to discriminate patterns across modalities continues to improve

• Developmental trend: visual-to-auditory (V→A) matching is easier than auditory-to-visual (A→V) up to about 7 years old

How does visual-kinesthetic intermodal perception develop?

Visual-kinesthetic intermodal perception is the ability to connect what is seen with what is felt or experienced through movement/touch.

• Infants: can relate objects they see to those they have mouthed

• First year: begin to recognize objects across modalities

• Later development: ability to select matching items across modalities improves

• Childhood: finer discriminations develop, with visual-first presentation easier than kinesthetic-first

• Key point: active manipulation (hands-on exploration) is more effective and meaningful than passive experience

How does auditory-kinesthetic intermodal perception develop?

Auditory-kinesthetic intermodal perception is the ability to integrate sound with touch/movement.

• By about 7–8 months, infants can integrate auditory and tactile information

• During childhood, this ability improves, especially as knowledge of object names and meanings increases

• Overall development is still being studied, and more research is needed to fully understand this process

This integration helps link what we hear with how objects feel and how we interact with them.

What is spatial-temporal intermodal perception and how does it develop?

Spatial-temporal intermodal perception involves integrating information about space and time, often through amodal invariants (e.g., rhythm, timing, movement patterns).

• Easiest: integrating two spatial stimuli

• Hardest: integrating two temporal stimuli

• Intermediate difficulty: integrating spatial and temporal stimuli together

• The ability to integrate subtle spatial-temporal information continues to improve into adolescence

What are the key points in intermodal development across the lifespan?

• Intermodal coordination begins at birth, with infants able to link information across senses

• Matching tasks and subtle discrimination improve throughout childhood and adolescence

• Accuracy depends on order of presentation, with tasks being easiest when visual information is presented first

What are the assumptions of early theories of perceptual, motor, and cognitive development?

Early theories assumed that perceptual, motor, and cognitive development are separate, distinct systems rather than integrated processes.

• Prefrontal cortex was thought to primarily support cognitive functions

• Cerebellum was thought to primarily support motor functions

What does the current ecological approach say about perceptual, motor, and cognitive development?

The ecological approach emphasizes that the brain and body are interconnected, and their development is closely linked rather than separate.

From this perspective:

• Perceptual, motor, and cognitive systems interact continuously during development

• Sensory systems (e.g., vision, hearing, proprioception) work together within real-world environments

• Development is shaped by ongoing interaction between the individual and the environment, not isolated brain regions or systems

What does the ecological perspective say about cognitive, perceptual, and motor processes, and how do specific brain regions support this?

The ecological perspective states that cognitive, perceptual, and motor processes are interconnected and work together, rather than operating as separate systems.

Examples include:

• The prefrontal cortex and cerebellum are co-activated during cognitive tasks, such as working memory and executive function, helping to store and use information to guide behavior

• These same regions also support motor planning and execution, showing overlap between thinking and movement systems

• The caudate nucleus (part of the basal ganglia) contributes to both motor and cognitive functions, especially goal-directed movement, decision-making, and linking actions to rewards

What does it mean that development is reciprocal and intertwined, and how does BDNF relate to this?

Development is reciprocal and intertwined, meaning that cognitive, motor, and perceptual systems continuously influence each other rather than developing independently.

• Conditions like ADHD, ASD, and learning disabilities (LD) are often described in terms of motor issues, while developmental coordination disorder (DCD) is often described in terms of cognitive issues, but in reality multiple systems are affected in all of these conditions

• Brain-Derived Neurotrophic Factor (BDNF) is a key biological factor in this interaction

• BDNF is increased through movement and exercise and is essential for learning and brain development

• It helps strengthen connections between neurons, supporting both motor and cognitive development

What does recent research suggest about the relationship between perception, movement, and learning?

Recent research shows that perception and movement are closely interconnected:

• Perception often develops ahead of movement skills

• Movement skills are guided by perceptual information, helping actions become more accurate and coordinated

• As individuals develop new movement skills, they gain new perceptual experiences, creating a continuous cycle of learning

• Exercise stimulates brain activity, which supports learning and memory by enhancing neural connections

How does development progress in infancy in terms of sensation, perception, and movement?

In infancy, development follows a reciprocal cycle:

Sensation → Perception → Goal-directed movement → New perceptions → New movements → New perceptions

This means that infants:

• Use sensory input (sensation) to form perceptions

• Use perceptions to guide goal-directed movements

• Those movements create new sensory experiences, leading to new perceptions

• This ongoing cycle supports continuous learning and development through interaction with the environment

What is the role of action in perceptual development?

Developmental systems are interrelated, and movement is essential for perceptual development. Action helps the brain couple and tune perception with movement, meaning sensory information and motor skills refine each other through experience.

For example, when infants move, explore, and interact with their environment (e.g., crawling, reaching, or walking on different surfaces), they learn how their body relates to space. This active exploration is necessary for building accurate perception of movement, space, and objects.

What is self-produced locomotion and how does it relate to perception development?

Self-produced locomotion refers to movement that the individual generates themselves (e.g., crawling, walking, exploring). This action is important because it helps develop and refine perception.

As infants and children move through their environment, they gain new sensory experiences that strengthen their understanding of space, objects, and movement, showing that action directly shapes perception

How does movement influence perceptual development?

Movement is essential for perceptual development because it allows individuals to actively explore and learn from their environment.

• Movement facilitates perception, helping the brain refine spatial, visual, and kinesthetic understanding

• Deprivation of movement can negatively impact development, limiting perceptual growth

• Active movement supports healthy perceptual and motor system development

What are affordances in perception?

Affordances are the action possibilities that the environment offers based on the capabilities of the individual. They describe what the environment “permits” a person to do (e.g., whether stairs can be climbed based on their height and the person’s body size).

Key points:

• Affordances involve the relationship between the environment and the performer

• They are perceived directly, without needing conscious cognitive analysis of object features

• They depend on both environmental properties (e.g., step height) and individual characteristics (e.g., body size, strength)

What is involved in postural control and balance?

Postural control and balance rely on integrating multiple sensory systems, including visual, auditory, and kinesthetic input from proprioceptive and vestibular receptors.

Key features include:

• Maintaining posture and balance in both stationary and moving conditions

• Adjusting to different body positions and support surfaces

• Being influenced by environmental and task constraints (e.g., terrain, activity demands)

Overall, balance is an active process that depends on continuous sensory integration and adaptation to the environment.

How does tool use develop in the first year of life?

In the first year of life, early tool use begins to emerge as infants start to explore objects and use them to achieve goals (e.g., reaching, banging, or moving objects to affect the environment). This marks the beginning of goal-directed action, where perception and movement work together to support intentional interaction with objects.

How does balance develop in childhood and adolescence?

Balance improves steadily throughout childhood and adolescence, but the pattern of improvement is task-specific, meaning it can vary depending on the activity.

Over time:

• Children increasingly rely on kinesthetic (proprioceptive) information

• There is a gradual shift away from dependence on visual information

• This reflects improved integration of sensory systems for maintaining posture and stability

How does balance change with aging in older adults?

With aging, balance control declines, and older adults show several changes:

• They take longer to initiate responses to perturbations (unexpected changes in balance or movement)

• They may use different or even opposite movement strategies compared to younger adults

• These changes reflect slower and less efficient postural control and sensory integration

What system changes contribute to balance difficulties in older adults?

Balance difficulties in older adults are caused by multiple system changes:

• Changes in sensory receptors, reducing accuracy of body and environmental feedback

• Overreliance on vision to compensate for declines in other sensory systems

• Loss of muscle strength, reducing stability and control

• Arthritic changes in joints, limiting movement and flexibility

• Slower nerve conduction speed, delaying postural responses