Handout #20 - Extended Reality (XR)

Extended Reality (XR)

  • Definition: XR is an umbrella term that includes Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), which modify reality through digital augmentation or simulation.

Virtual Reality (VR)

  • Immersion: Users are fully immersed in a digital environment, experiencing it as if they are physically present.

  • Technology: Utilizes Head-Mounted Displays (HMDs) that allow navigation and manipulation of 3D spaces using avatars.

Augmented Reality (AR)

  • Enhancement: AR overlays digital data onto the real world, allowing users to interact with both virtual and real elements simultaneously.

  • Interfaces: Combines real and virtual visuals, providing real-time interaction and spatial alignment with physical locations.

Mixed Reality (MR)

  • Integration: MR merges elements of AR and VR, enabling real and digital objects to coexist and interact in real-time.

  • Function: While AR overlays information, MR anchors virtual items in the real world, facilitating interaction between the two.

Differences Between VR, AR, and MR

  • Integration:

    • VR replaces real-world surroundings with a digital environment.

    • AR enhances real-world perception by digitally augmenting it.

    • MR combines real and digital experiences, facilitating unique interactions.

Challenges in XR Development

  • Realism: Creating convincing feedback and experiences that surpass real-world possibilities is challenging.

  • Perceptual Modalities: The success of XR is defined by sensory modalities rooted in sensation processes.

Sensation in XR

  • Definition: Sensation is the detection of physical stimuli by sensory receptors in the body.

  • Role in XR: Supplies essential data for immersive environments, where stimuli are transduced into signals processed by the brain.

Perception

  • Interpretation: The brain interprets signals from sensation, organizing them into recognizable patterns.

  • Higher Processing: Involves cortical areas of the brain, integrating sensory information with memory and recognition for XR interaction.

Perceptual Modalities

  • Definition: Channels through which sensory information is processed, corresponding to senses like vision, hearing, and touch.

  • Importance in VR: Enhances user presence and immersion, critical for realistic experiences.

Visual Modality in VR

  • Harbinger of Reality: High-resolution graphics and depth cues enhance realism in virtual environments.

  • Seeing Is Believing: Users tend to believe in the experiences that closely mimic visual reality, enhancing immersion.

Body Transfer Phenomenon

  • Definition: The illusion of body ownership where users feel they have become their avatars.

  • Visual Representation: Accurate avatar movements correlate with real-world physical movements enhancing ownership perception.

  • Rubber Hand Illusion: Demonstrates how visual and tactile feedback creates a sense of belonging to a virtual body.

Auditory Feedback in VR

  • Spatial Awareness: Uses spatial audio to position sounds, enhancing realism and immersion in virtual worlds.

Haptic Feedback

  • Tactile Experience: Provides physical sensations mimicking real-world touch across various technologies.

  • Importance: Essential for tasks that require spatial understanding and fine motor skills, improving interactivity.

Illusions in VR

Place Illusion (PI)

  • Definition: The feeling of being physically present in a virtual environment, created by mimicking sensory feedback.

Plausibility Illusion (PSI)

  • Definition: Concerned with the believability of the virtual environment, focusing on the coherence of events and interactions.

  • Cognitive and Emotional Impact:

    • Cognitive: Logical consistency enhances user engagement.

    • Emotional: Emotional responses must align with the environment and narrative.

Emotional Communication in VR

  • Effectiveness: Emotional displays in virtual characters can alter user interactions, enhancing engagement.

  • Case Study: A virtual assistant named Laura showed that emotional responses influenced user willingness to cooperate.

User Emotional Experiences in VR

  • Variability: Emotional intensity and type vary among individuals. Age can influence VR emotional responses.

  • Study Findings: Certain scenarios elicit emotions but not all reactions are significant, indicating variability in emotional feedback.

Impact of Immersive Virtual Environments on Attitudes

  • Concept of Body Transfer: Participants experience the lives of non-human entities, enhancing empathy.

Key Findings and Implications

  • Nature Connection: Participants felt a deeper connection to nature when embodying animals in IVEs.

  • Educational Potential: Immersive nature enhances understanding and empathy for environmental issues.

  • Cognitive and Emotional Engagement: Rich sensory information aligns with real-life experiences, improving memory and engagement.