C4 L2

Overview of Visual Processing

1. Early Vision

• Early vision involves the process of analysis.

• Understanding the optics of the eye and how light interacts with neural cell layers.

• Role of neural cells in analyzing light.

2. Mid Level Vision

• Definition: The stage of visual processing that occurs after basic features have been extracted (low-level vision) and before complete object recognition (high-level vision).

• Major functions of mid-level vision:

  • Analysis

  • Synthesis

2.1 Synthesis

• Definition of synthesis: The ability to combine local bits of information into recognizable objects.

• Key activities in synthesis:

  • Correctly perceiving edges and surfaces.

  • Determining regions that should be grouped into objects.

• Discussion of synthesis principles will follow.

3. Object Recognition

• Understanding how the brain defines an object requires a look into different representations.

  • Example 1: Image of a real elephant against a muddy green background.

  • Example 2: A Lego figure of an elephant and a sketch drawing.

• The question of what constitutes an object: Is a tail sufficient for identification?

• Concept of recognizing objects in terms of pixel patterns.

• Challenge: Classifying edges and surfaces—what belongs to which object?

4. Receptive Fields

• Receptive Fields: Areas in the visual field where photoreceptor cells respond to stimuli.

• Example of receptive fields labeled from A to E:

  • A = Detects edges (e.g., tusk of an elephant).

  • B = Edge detecting cell—determines boundaries of the elephant.

  • C & D = Corner detectors separating edges.

  • E = Surface property detector—distinguishes edges from surfaces.

• Function: Mid-level vision combines inputs from simple features to recognize complex images like those of an elephant or zebra.

5. Perceptual Organization

• Major topics to cover:

  1. Identifying edges.

  2. Grouping similar regions.

  3. Handling missing sections.

5.1 Edge Detection and Contour Perception

• Noticing edges through luminance differences—Example of an arrow perceived without a dark background.

• Contour perception enables recognition based on perceived edges.

5.2 Illusory Contours

• Definition: A contour perceived without actual luminance changes across it.

• Example: Kaniza figure illusion where an arrow is perceived despite no explicit edges.

• Reason for perception: Brain’s predictive capability about likely occlusions.

6. Gestalt Psychology

• Overview of the Gestalt School of Thought: Proposition that "the whole is more than the sum of its parts."

• Contrast with Structuralist School of Thought: Focus on the sum of sensory experiences.

• Importance in understanding various visual illusions.

6.1 Gestalt Principles of Grouping

• Principle of Good Continuation: Elements tend to group if they seem to align on a continuation.

  • Example: Oriented lines perceived as part of the same contour.

• Texture Segmentation: Carving an image based on common textures.

• Principle of Similarity: Objects of similar features are grouped.

6.2 Challenges with Gestalt Principles

• Examples illustrating the limitations of Gestalt properties leading to illusions.

7. Figure-Ground Assignment

• Key factors influencing figure-ground perception:

  • Surroundedness: Surrounded objects tend to be perceived as the figure.

  • Size: Smaller objects may be viewed as figures.

  • Symmetry: Symmetrical figures help in distinguishing figure from ground.

  • Parallelism: Identifying parallel lines aids perception.

  • Relative Motion: Recognizing moving objects against stationary backgrounds.

8. Accidental Viewpoints

• Definition: Viewing positions that create regular patterns not present in reality.

• Examples demonstrating illusions created by accidental viewpoints.

9. Perceptual Committees

• Concept: Teams of cognitive processes determining singular interpretations from ambiguous images.

• Illustrations using cubes to clarify interpretations.

• Critical role in perceiving features accurately, despite initial visual ambiguity.

10. Global Superiority Effect

• Definition: Properties of whole objects dominate over individual parts.

• Examples where local properties become secondary.

10.1 Concavities in Perception

• Role of concavities in defining parts of objects.

• Implications on how we perceive object segmentation.

11. Conclusion

• Summary of how mid-level vision contributes to perception.

• Discussion on the significance of Gestalt principles, contour completion, figure-ground assignment, and the role of perceptual committees.