W3. Color Perception

Introduction to Color Perception

  • Welcome and course introduction

    • Instructor: Mark Scherer

    • Topic: Color Perception

    • Schedule: Two weeks of lectures (first this week, second next week)

Overview of Color and Light

  • Definition of Color: Color is experienced through perception and is our interpretation of light based on its physical properties.

  • Physical Perspective of Light:

    • Light is an electromagnetic wave.

    • Light is a mixture of different electromagnetic wave frequencies ranging from 400 to 715 nanometers in wavelength.

    • Colors Corresponding to Wavelengths:

    • Short wavelengths (around 400 nm) appear blue.

    • Middle wavelengths appear green, yellow, and orange.

    • Long wavelengths (around 700 nm) appear red.

  • Electromagnetic Spectrum:

    • Includes frequencies beyond visible light:

    • Ultraviolet (higher frequency than blue) - UV light is invisible.

    • X-rays and gamma rays (higher frequency and energy).

    • Infrared (lower frequency than red) - Can be felt as warmth.

    • Microwaves, radio frequencies, etc.

  • Function of Color Perception:

    • Vital in daily life (e.g., food selection, safety signals, art appreciation).

    • Hypothetical scenario: Color vision impact on apple picking if reduced like in dogs, cows, and cats.

Evolutionary Aspect of Color Perception

  • Color vision in primates evolved to aid in food gathering and survival (e.g., identifying ripe fruits).

  • Color influences our behavior and decision-making (e.g., navigating maps).

Visual Illusions and Clever Perception

  • Examples of color illusions:

    • Identically colored shapes perceived differently (e.g., gray vs. blue).

    • Challenges perceptions with different color mixes.

  • Learning Objective: Understand why perception does not always align with physical reality.

Light: White Light and Prisms

  • White Light:

    • A mixture of all visible light frequencies.

    • A prism can separate white light into a spectrum (rainbow) by bending light differently based on frequency.

    • Rainbows form due to white light from the sun being refracted in raindrops.

Retina and Cone Types in Color Perception

  • Overview of the retina structure: three layers including photoreceptors, bipolar cells, and ganglion cells.

    • Photoreceptors: Rods and three types of cones.

  • Types of Cones:

    • S cones (short wavelength sensitive)

    • M cones (medium wavelength sensitive)

    • L cones (long wavelength sensitive)

  • The ganglion cell types relevant to color perception: midget, parasol, and bistratified ganglion cells connecting respectively to parvocellular and magnocellular cells in the LGN (lateral geniculate nucleus).

Pathways of Color Processing

  • Three Main Pathways:

    • Parvocellular System:

    • Small cell bodies; 80% of all ganglion cells.

    • High spatial detail, primarily processes M and L cones (ignores S cones).

    • Magnocellular System:

    • Large cells; 10% of ganglion cells.

    • Less spatial resolution but more sensitivity and contrast detection; color blind.

    • Koni Cellular System:

    • Small by stratified cells; 8-10% of ganglion cells.

    • Specialized for blue and red-green difference detection.

  • Visual Resolution:

    • Midget ganglion cells specialize in small areas for high-resolution perception.

    • Parasol ganglion cells cover larger receptive fields with less resolution.

    • Bistratified ganglion cells enhance blue-yellow color discrimination.

Mechanism of Color Perception

  • Reflectance and Color Creation:

    • Example of red objects: Reflect red light strongly, appearing red to the observer.

    • Different percepts depending on object reflectance and light source.

  • Sensitivity of Cones:

    • Peak sensitivities of the cones:

    • S cones: ~420 nm

    • M cones: ~530 nm

    • L cones: ~560 nm

  • Meaning of Trichromacy:

    • Three cones are fundamental; defines human color perception.

    • Loss of color specificity if fewer cone types exist.

Principle of Univariance

  • Univariance: A single type of cone cannot determine color and intensity simultaneously.

    • Example: Difficult to distinguish between a bright blue and a dim green using only one type of cone.

Color Mixing Mechanisms

  • Additive Color Mixing:

    • Combining light sources adds intensities together (e.g., red + green = yellow).

    • Visual experiences with color sources.

  • Subtractive Color Mixing:

    • Combining pigments reduces brightness (e.g., red and green paint = brown).

Color Blindness

  • Types of Color Blindness:

    • Generally dichromatic; can distinguish between blue and yellow, but difficulties with red and green.

    • Inherited conditions linked to X chromosome; more common in males (10%) than females (0.5%).

Color Constancy and Perception

  • Color Constancy: The ability to discern the color of an object irrespective of the light conditions under which it is viewed.

    • Our perception adjusts for ambient lighting to maintain consistent color recognition.

  • Visual System's Role: Adjusts for surrounding illumination and reflects back visual information to determine object color accurately.

Conclusion: Color and Perception

  • Color perception is complex, integrated, and deeply connected to visual processing and environmental factors.

  • Continued exploration and understanding can enhance experiences in daily activities and art.


Introduction to Color Perception

  • Welcome and course introduction

    • Instructor: Mark Scherer

    • Topic: Color Perception – an exploration of how our visual system interprets light to create the subjective experience of color.

    • Schedule: Two weeks of lectures (first this week, second next week), covering foundational concepts and advanced topics.

Overview of Color and Light

  • Definition of Color: Color is not an inherent property of objects but rather a perceptual experience, our brain's interpretation of light based on its physical properties, such as wavelength and intensity.

  • Physical Perspective of Light:

    • Light is a form of electromagnetic radiation, propagating as an electromagnetic wave.

    • Visible light is a small segment of the electromagnetic spectrum, consisting of a mixture of different electromagnetic wave frequencies ranging from approximately 400 to 715 nanometers (nm) in wavelength.

    • Colors Corresponding to Wavelengths:

      • Short wavelengths (around 400-450 nm) appear blue (e.g., indigo, violet).

      • Middle wavelengths (around 450-590 nm) appear green (e.g., 500-550 nm), yellow (e.g., 570-590 nm), and orange (e.g., 590-620 nm).

      • Long wavelengths (around 620-715 nm) appear red.

  • Electromagnetic Spectrum:

    • Includes frequencies beyond visible light, ranging from very long radio waves to very short gamma rays.

    • Ultraviolet (UV) light (higher frequency than blue): Invisible to humans, responsible for sunburns and can damage DNA.

    • X-rays and gamma rays (even higher frequency and energy): Used in medical imaging and radiation therapy.

    • Infrared (IR) light (lower frequency than red): Invisible to humans but can be felt as warmth; used in thermal imaging and remote controls.

    • Microwaves, radio frequencies, etc., are also part of this broad spectrum.

  • Function of Color Perception:

    • Vital in daily life: Plays a crucial role in object recognition, judging distances, mood, and various survival mechanisms.

      • Examples include food selection (identifying ripe fruits), safety signals (traffic lights, warning signs), art appreciation, and communicating emotions.

    • Hypothetical scenario: If color vision were reduced, like in many animals (dogs, cows, cats are often dichromatic or monochromatic), tasks such as distinguishing ripe apples from unripe ones or locating specific items in a cluttered environment would become significantly more challenging, impacting survival and efficiency.

Evolutionary Aspect of Color Perception
  • Color vision in primates, particularly trichromacy (three types of cones), evolved to provide a selective advantage, primarily aiding in food gathering and survival.

    • This allowed primates to better identify ripe, nutrient-rich fruits against background foliage, crucial for dietary success.

  • Color influences our behavior and decision-making beyond just identification, affecting emotions, cultural symbols, and practical tasks (e.g., distinguishing different routes on a map).

Visual Illusions and Clever Perception
  • Examples of color illusions: Demonstrate that our perception is not always a direct reflection of physical reality.

    • Identically colored shapes can be perceived differently depending on their surrounding context (e.g., a gray patch appearing blue due to surrounding yellow, or different shades of gray being perceived as distinct colors).

    • These illusions challenge our understanding of perception by showing how the brain actively constructs our visual experience rather than passively receiving data.

  • Learning Objective: To understand the complex processes by which perception is constructed and why it does not always align precisely with objective physical reality, highlighting the brain's role in interpreting sensory input.

Light: White Light and Prisms
  • White Light:

    • Defined as a mixture of all visible light frequencies (or wavelengths in the visible spectrum) in roughly equal proportions.

    • When white light passes through a prism, it undergoes dispersion. A prism can separate white light into its constituent spectral colors (a rainbow) because the refractive index of glass varies slightly with wavelength. Shorter wavelengths (blue/violet) are bent more than longer wavelengths (red), causing the light to spread out.

    • Rainbows form naturally due to white light from the sun being refracted, reflected, and then refracted again within millions of tiny raindrops, acting like miniature prisms.

Retina and Cone Types in Color Perception
  • Overview of the retina structure: The retina is a light-sensitive layer at the back of the eye, containing multiple layers of neurons.

    • It includes three main layers of cells involved in visual processing:

      • Photoreceptors: Rods and cones, which detect light.

      • Bipolar cells: Transmit signals from photoreceptors to ganglion cells.

      • Ganglion cells: Their axons form the optic nerve, sending visual information to the brain.

  • Photoreceptors: Specialized cells that convert light into electrical signals.

    • Rods: Highly sensitive to light, responsible for vision in low-light conditions (scotopic vision). They do not detect color.

    • Cones: Responsible for high-acuity vision and color perception in brighter light conditions (photopic vision). Humans typically have three types of cones.

  • Types of Cones (human trichromatic vision):

    • S cones (short wavelength sensitive): Primarily responsible for detecting blue light, with peak sensitivity around 420nm\approx 420 nm.

    • M cones (medium wavelength sensitive): Primarily responsible for detecting green light, with peak sensitivity around 530nm\approx 530 nm.

    • L cones (long wavelength sensitive): Primarily responsible for detecting red light, with peak sensitivity around 560nm\approx 560 nm.

  • The retina also contains various types of ganglion cells that process and transmit signals from cones and rods.

    • Midget ganglion cells: Receive input primarily from L and M cones, crucial for high spatial resolution and fine detail perception, projecting to the parvocellular layers of the LGN.

    • Parasol ganglion cells: Receive input from both rods and cones over a larger area, specializing in motion detection and contrast, projecting to the magnocellular layers of the LGN.

    • Bistratified ganglion cells: Specifically involved in processing S-cone input, contributing to blue-yellow color vision, projecting to the koniocellular layers of the LGN.

Pathways of Color Processing
  • Once signals leave the retina, they travel via the optic nerve to the Lateral Geniculate Nucleus (LGN) in the thalamus, where they are further processed along three main pathways:

  • Three Main Pathways originating from different ganglion cell types:

    • Parvocellular System (P-pathway):

      • Composed of small cell bodies (hence 'parvo'); constitutes about 80% of all ganglion cells.

      • Processes information primarily from midget ganglion cells, carrying high spatial detail and information about red-green color differences (processes M and L cones, largely ignores S cones).

      • Crucial for fine texture, shape, and detailed color perception.

    • Magnocellular System (M-pathway):

      • Composed of large cells (hence 'magno'); constitutes about 10% of ganglion cells.

      • Processes information from parasol ganglion cells, known for less spatial resolution but higher sensitivity to contrast, flicker, and motion. This pathway is effectively color-blind.

      • Important for detecting movement and large-scale patterns.

    • Koniocellular System (K-pathway):

      • Composed of small, by-stratified ganglion cells; constitutes about 8-10% of ganglion cells.

      • Specialized for blue-yellow color difference detection, primarily processing S-cone input.

      • Plays a distinct role in color perception, often thought to provide input to areas involved in less detailed, more global color perception.

  • Visual Resolution: Different ganglion cell types contribute to specific aspects of visual acuity.

    • Midget ganglion cells specialize in very small receptive fields (covering small areas of the retina), enabling high-resolution perception of fine details and precise color discrimination.

    • Parasol ganglion cells cover larger receptive fields with less spatial resolution but are highly sensitive to transient changes, making them excellent for detecting movement and overall contrast changes.

    • Bistratified ganglion cells specifically enhance blue-yellow color discrimination by comparing S-cone input to a combination of L and M cone inputs.

Mechanism of Color Perception
  • Reflectance and Color Creation:

    • The color an object appears is determined by which wavelengths of light it selectively absorbs and which it reflects. When white light (containing all visible wavelengths) hits an object, the object's surface properties dictate this absorption/reflection.

    • Example of red objects: A red apple appears red because its surface absorbs most of the blue and green wavelengths present in the ambient light and strongly reflects the red wavelengths. These reflected red wavelengths enter our eyes, exciting our L cones predominantly, leading to the perception of red.

    • Different percepts can arise depending on both the object's inherent reflectance properties and the spectral content of the light source illuminating it. An object that reflects red light under white light might appear black or dark under purely blue light because there are no red wavelengths to reflect.

  • Sensitivity of Cones:

    • Each cone type has a broad range of sensitivity but peaks at a specific wavelength:

      • S cones: Peak sensitivity around 420nm\approx 420 nm (blue).

      • M cones: Peak sensitivity around 530nm\approx 530 nm (green).

      • L cones: Peak sensitivity around 560nm\approx 560 nm (yellow-green, but contributes strongly to red perception due to relative excitation).

    • The relative activation of these three cone types at any given moment determines our final color percept. For example, yellow light strongly stimulates both M and L cones, while activating S cones very little.

  • Meaning of Trichromacy:

    • The presence of three distinct types of cones (S, M, L) is fundamental to human color perception, referred to as trichromacy.

    • This three-receptor system allows for the discrimination of a vast spectrum of colors, as the brain can interpret the unique ratio of excitation across all three cone types for any incoming light wavelength mixture.

    • Loss of one or more cone types (dichromacy or monochromacy) would result in a significant reduction in the range and quality of color perception, leading to less specific color differentiation.

Principle of Univariance
  • Univariance: This principle states that a single photoreceptor (rod or cone) cannot, by itself, distinguish between changes in intensity (brightness) and changes in wavelength (color) of light.

    • A single cone type, when absorbing light, only produces a signal indicating how many photons it has absorbed, not what wavelength those photons were. Thus, a strong signal from a dim light of its preferred wavelength could be indistinguishable from a weak signal from a bright light of a different, less preferred wavelength.

    • Example: It would be difficult to distinguish between a bright blue light and a dim green light using only one type of cone because both could elicit the same total number of photon absorptions, leading to an identical neural response. Our ability to perceive color relies on comparing the relative responses across multiple cone types.

Color Mixing Mechanisms
  • Additive Color Mixing:

    • This occurs when different colored light sources are combined. When light sources are added together, their wavelengths combine, and the resulting mixture appears brighter and lighter.

    • The primary colors for additive mixing are Red, Green, and Blue (RGB).

    • Combining all three additive primaries (Red light + Green light + Blue light) in equal intensity produces white light.

    • Examples: Theater stage lighting, computer screens, television displays, and smartphone screens use additive color mixing to produce a full range of colors.

    • Red light + Green light = Yellow light; Green light + Blue light = Cyan light; Red light + Blue light = Magenta light.

  • Subtractive Color Mixing:

    • This occurs when pigments or dyes are combined. Pigments work by absorbing certain wavelengths of light and reflecting others. When pigments are mixed, more wavelengths are absorbed, resulting in less light being reflected back to the eye, making the mixture appear darker and duller.

    • The primary colors for subtractive mixing are Cyan, Magenta, and Yellow (CMY), sometimes with Black (K) added (CMYK model).

    • Combining all three subtractive primaries (Cyan paint + Magenta paint + Yellow paint) theoretically produces black, as almost all light wavelengths are absorbed.

    • Examples: Painting, printing (e.g., inkjet printers), and dyeing fabrics use subtractive color mixing.

    • Cyan pigment + Magenta pigment = Blue; Magenta pigment + Yellow pigment = Red; Cyan pigment + Yellow pigment = Green.

Color Blindness
  • Types of Color Blindness (Color Vision Deficiency):

    • Most forms are generally dichromatic, meaning the individual lacks one of the three types of cones or has a cone type with an abnormal spectral sensitivity.

    • Common forms: Often involve difficulties distinguishing between red and green hues.

      • Protanopia: Absence of functional L cones (red cone deficiency). Individuals have difficulty distinguishing between red, orange, yellow, and green, which often appear brownish-yellow or gray. They also perceive red colors as less bright.

      • Deuteranopia: Absence of functional M cones (green cone deficiency). Individuals have difficulty distinguishing between red, orange, yellow, and green, which appear brownish-yellow or gray, similar to protanopia, but without the dimness of red.

      • Tritanopia: Absence of functional S cones (blue cone deficiency). This is much rarer and causes difficulty distinguishing between blue and yellow hues. Blues appear greenish, and yellows appear violet or light gray.

    • Achromatopsia: Complete color blindness, where individuals see only shades of gray. This is very rare and often accompanied by reduced visual acuity and sensitivity to light (photophobia).

    • Inheritance: The most common forms (protanopia and deuteranopia) are inherited conditions linked to the X chromosome, making them significantly more common in males (approximately 10%) than in females (approximately 0.5%). Females can be carriers of the gene without experiencing the deficiency themselves.

Color Constancy and Perception
  • Color Constancy: This is a remarkable ability of the visual system to perceive the stable, inherent color of an object despite changes in the spectral composition of the light source illuminating it (ambient lighting conditions).

    • For example, a red apple still appears red whether viewed under bright sunlight, dim incandescent light (which is richer in red/yellow wavelengths), or fluorescent light (which often has a bluish cast).

  • Visual System's Role: The brain does not simply register the raw light reflected from an object. Instead, it actively processes and adjusts for the surrounding illumination.

    • It achieves this by taking into account the average color of the light entering the eyes, using contextual cues from other objects in the scene, and applying sophisticated neural algorithms to reflect back visual information to determine the intrinsic object color accurately, thereby maintaining consistent color recognition.

    • This allows us to reliably identify objects regardless of the lighting environment, which is vital for navigation and interaction.

Conclusion: Color and Perception
  • Color perception is a complex, integrated process deeply connected to our visual processing pathways, evolutionary history, and environmental factors.

  • It is not merely a simple registration of light wavelengths but an active construction by the brain, leading to rich and sometimes surprising perceptual experiences.

  • Continued exploration and understanding of color perception can enhance our daily activities, appreciation of art, and overall interaction with the visual world, unveiling the intricate mechanisms of our brain. This field highlights the dynamic interplay between the physical world and our internal subjective experience.


Relative cone activation refers to the comparative responses across the three different types of cones (S, M, and L). Unlike absolute cone activation, which is an ambiguous signal from a single cone, relative activation involves the brain comparing the output from all three types of cones simultaneously. Our brain interprets the unique ratio of excitation across these multiple cone types for any incoming light wavelength mixture.

For example, when you see yellow light, it strongly stimulates both your M cones (green-sensitive) and L cones (red-sensitive), while activating your S cones (blue-sensitive) very little. This specific pattern of 'M high, L high, S low' is what your brain processes as yellow. Similarly, green light would produce a high M cone response, a moderate L cone response, and a low S cone response. Red light would yield a high L cone response, a moderate M cone response, and a low S cone response.

This comparison of responses among the S, M, and L cones is precisely how our visual system overcomes the limitation of univariance (where a single cone can't tell color from brightness). By integrating and comparing these relative signals, our brain can distinguish between a vast spectrum of colors and their intensities, creating our rich experience of color vision.

Trichromatic vision refers to the human ability to perceive color using three distinct types of cones in the retina: S cones (short wavelength sensitive, reacting to blue light), M cones (medium wavelength sensitive, reacting to green light), and L cones (long wavelength sensitive, reacting to red light). The presence of these three cone types is fundamental to human color perception, as our brain interprets the unique ratio of excitation across all three cone types to discriminate a vast spectrum of colors.

Trichromatic vision refers to the human ability to perceive color using three distinct types of cones in the retina: S cones (short wavelength sensitive, reacting to blue light), M cones (medium wavelength sensitive, reacting to green light), and L cones (long wavelength sensitive, reacting to red light). The presence of these three cone types is fundamental to human color perception, as our brain interprets the unique ratio of excitation across all three cone types to discriminate a vast spectrum of colors.