Human Capabilities and Information Processing in HCI
The Human User in Computer Systems
- The human is the user for whom computer systems are specifically designed.
- Human requirements must be the first priority because humans possess limited capacities for processing information.
- Understanding the human involves studying input-output channels (sensors and responders), memory functions, complex problem solving, skill acquisition, and the nature of human error.
- Interaction with the outside world occurs through the relay of information received (input) and sent (output).
- In HCI, the user receives information output by the computer and responds by providing input for the computer.
- The user’s output becomes the computer’s input, and the computer's output becomes the user's input.
- Human input occurs primarily through the five senses: sight, hearing, touch, taste, and smell.
- The central senses for HCI are sight, hearing, and touch.
- Human output occurs through motor control of effectors, including the limbs, fingers, eyes, head, and vocal system.
- Fingers serve the primary role in computer interaction for tasks such as typing or controlling a mouse.
Visual System and Perception
- Vision is the primary source of information for the average person and is a complex activity involving physical and perceptual limitations.
- Visual perception is divided into two stages: the physical reception of external stimuli and the processing/interpretation of those stimuli.
- The interpretive capabilities of visual processing allow the mind to construct full images even from incomplete information.
Anatomy of the Human Eye
- Vision begins with light reflected from objects, which is focused upside down on the retina at the back of the eye.
- The eye transforms light into electrical energy via receptors that pass signals to the brain.
- The cornea and lens at the front of the eye focus light to create a sharp image.
- The retina is the light-sensitive component containing two types of photoreceptors:
- Rods: These are highly sensitive to light, allowing vision under low illumination. They cannot resolve fine detail and are subject to light saturation.
- Cones: These are less sensitive to light than rods and can tolerate more light. They are sensitive to different wavelengths, enabling color vision.
- Temporary blindness when moving from a dark room to sunlight occurs because rods become saturated by sudden light, while cones remain temporarily suppressed by the rods.
Perceiving Size, Depth, and Distance
- The visual system identifies similar objects as having the same size regardless of their appearance as different sizes, which helps in judging distance.
- Size, depth, and relative distance are perceived through the visual angle.
- Visual angle is determined by drawing lines from the top and bottom of an object to a central point on the front of the eye.
- The angle is affected by the object's size and its distance from the eye.
- If two objects are at the same distance, the larger object has the larger visual angle.
- If two objects of the same size are at different distances, the farther one has a smaller visual angle.
- Visual angle indicates how much of the field of view an object occupies and is measured in degrees or minutes of arc:
- 1∘=60 minutes of arc.
- 1 minute of arc = 60 seconds of arc.
- Visual acuity is the ability to perceive fine detail. If a visual angle is too small, the object cannot be perceived.
- The Law of Size Constancy indicates that our perception of size relies on factors like depth perception.
Perceiving Brightness and Color
- Brightness is a subjective reaction to light levels, affected by luminance (the physical amount of light emitted by an object).
- Luminance depends on the light falling on a surface and the surface's reflective properties; it is measured using a photometer.
- Contrast is a function of the luminance of an object relative to the luminance of its background.
- The visual system compensates for brightness changes; in dim light, rods (which are sparse on the fovea) predominate, making objects less visible when fixated upon but more visible in peripheral vision.
- Visual acuity increases as luminance increases, though high luminance can cause flicker.
- The eye perceives rapidly flashing light as constantly on once the frequency is high enough.
- Color consists of three components:
- Hue: Determined by spectral wavelength (Blue=short, Green=medium, Red=long). The average person can discriminate approximately 150 different hues.
- Intensity: The brightness of the color.
- Saturation: The amount of whiteness in the color.
- Color vision is best in the fovea and worst in the periphery. Only 3%×10−2 to 4%×10−2 of the fovea contains blue-sensitive cones, making blue acuity lower.
Visual Processing Capabilities
- The system compensates for retinal image movement caused by the observer's motion or the object's motion, maintaining image stability.
- Color and brightness are perceived as constant despite fluctuating luminance.
- Human expectations are exploited to resolve visual ambiguity.
Auditory System
- Hearing conveys significant information about the environment, though it is often considered secondary to sight.
- Hearing begins with vibrations in the air (sound waves).
Anatomy of the Ear
- The Outer Ear: Includes the pinna (visible structure on the head) and the auditory canal. It protects the middle ear using wax (to block dust, dirt, and insects) and maintains constant temperature. It also amplifies certain sounds.
- The Middle Ear: A small cavity connected to the outer ear by the tympanic membrane (ear drum) and to the inner ear by the cochlea. It contains the ossicles (the body's smallest bones). The ear drum vibrates the ossicles, which concentrate and amplify vibrations to the denser cochlean liquid.
- The Inner Ear: Contains the cochlea filled with liquid. Vibrations cause cilia (hair cells) to bend, releasing chemical transmitters that create impulses in the auditory nerve.
Processing Sound
- Pitch: The frequency of the sound wave (low frequency=low pitch, high frequency=high pitch).
- Loudness: Proportional to the amplitude of the sound while frequency remains constant.
- Timbre: Relates to the type or quality of the sound (e.g., different instruments playing the same note).
- The system identifies sound location based on time differences between the sound reaching each ear and intensity reduction caused by the head reflecting sound waves.
- The auditory system filters sound, such as in the "cocktail party effect," where one can detect their own name across a noisy room.
- Differentiation fails if sounds are too loud or frequencies are too similar.
Haptic Perception (Touch)
- Touch provides vital environmental information (e.g., temperature) and acts as a warning system.
- In HCI, haptic feedback is crucial for tasks like feeling a button depress.
- Interfaces like Braille provide the primary source of information for users with impaired sight or hearing.
Receptors and Kinesthesis
- Touch is not localized; stimuli are received through the skin via three receptors:
- Thermoreceptors: Respond to heat and cold.
- Nociceptors: Respond to intense pressure, heat, and pain.
- Mechanoreceptors: Respond to pressure.
- Two types of mechanoreceptors:
- Rapidly adapting: Respond to immediate pressure (indentation) and react faster with increased pressure, but stop responding under continuous pressure.
- Slowly adapting: Respond to continuously applied pressure.
- Acuity varies across the body and is measured by the two-point threshold test.
- Kinesthesis is the awareness of the position of the body and limbs, sensed by joint receptors:
- Rapidly adapting: Respond to a limb moving in a particular direction.
- Slowly adapting: Respond to movement and static position.
- Positional: Respond only to static positions.
Movement and Motor Skill
- Movement time depends on physical factors like age and fitness.
- Reaction time depends on the sensory channel:
- Auditory signal: approximately 150ms.
- Visual signal: approximately 200ms.
- Pain signal: approximately 700ms.
- Combined signals result in the fastest response times.
- Fatigue increases reaction time; skill and practice reduce it.
- Accuracy: Faster reaction does not always mean lower accuracy. For skilled operators, speed can coexist with high accuracy; studies show faster keyboard operators may make 10 times fewer errors than slower ones.
Fitts' Law
- The time taken to hit a target on a screen (button, menu, icon) depends on target size and movement distance.
- Movement time=a+blog2(sizedistance+1)
- In this formula, a and b are constants determined empirically.
Human Memory Structures
- Memory stores factual knowledge, procedures, and past experiences (identity).
- The structure of memory includes sensory buffers, short-term (working) memory, and long-term memory.
Sensory Memory
- Acts as buffers for stimuli; each channel has its own store: Iconic (visual), Echoic (aural), and Haptic (touch).
- Information is constantly overwritten by new input.
- Echoic memory allows a brief "play-back" of sound, which is necessary to determine sound direction because information reaches each ear at different times.
Attention
- Attention is the concentration of the mind on one stimulus out of many competing stimuli.
- It acts as a filter, passing information from sensory memory to short-term memory.
- Selectivity is required because sensory and mental processes have limited capacity; without it, the system would suffer overload.
- Arousal, interest, and need govern the choice of stimuli to attend to.
Short-term Memory (STM)
- Functions as a "scratch-pad" for fleeting information.
- Access time is approximately 70ms.
- Decay is rapid, approximately 200ms.
- Capacity is limited: experimental data by Miller suggests people can remember 7±2 digits.
- Chunks are created subconsciously to optimize capacity; successful chunk formation is called closure.
- Interference or failure to achieve closure can lead to errors.
Long-term Memory (LTM)
- Designed for permanent storage via rehearsal from working memory. There is very little decay over time.
- Types of LTM:
- Episodic Memory: Stores events and experiences in serial form; used to reconstruct life events.
- Semantic Memory: A structured record of facts, concepts, and skills derived from episodic memory. It allows for relationships, access, and inference.
Semantic Models and Knowledge Representation
- Semantic Networks: Items are associated in classes and inherit attributes from parent classes.
- Frames: Data structures for complex objects/events. They use "slots" for attribute values:
- Fixed slots: Set attribute values.
- Default slots: Usual values that can be overridden.
- Variable slots: Filled during specific instances.
- Procedural knowledge can also be associated with slots.
- Scripts: Represent stereotypical information or default scenarios to interpret partial cues. Elements include:
- Entry conditions: Must be satisfied to activate the script.
- Result: Conditions true after termination.
- Props: Objects involved.
- Roles: Actions of participants.
- Scenes: Sequences of events.
- Tracks: Variations on the general pattern.
- Procedural Knowledge: Represented by production systems using condition-action rules stored in LTM. Input in STM matching a condition triggers the corresponding action.
Long-term Memory Processes
Storage and Learning
- Rehearsal (repeated exposure) transfers information from STM to LTM.
- Total Time Hypothesis (Ebbinghaus): The amount learned is directly proportional to time spent learning.
- Distribution of Practice Effect: Learning is more effective if distributed over time rather than concentrated.
- Meaningfulness: Information is easier to remember if it is meaningful. Bartlett found that people retelling stories from unfamiliar cultures would replace unfamiliar terms with meaningful ones from their own culture.
Forgetting and Retrieval
- Decay Theory: Information is lost over time. Ebbinghaus noted decay is logarithmic (rapid at first, then slower).
- Jost’s Law: If two memory traces are equally strong, the older one is more durable.
- Interference Theory:
- Retroactive Interference: New information causes the loss of old information (e.g., learning a new phone number makes it hard to remember the old one).
- Proactive Inhibition: Old memory traces interfere with new ones (e.g., driving to an old house instead of a new one).
- Emotional Factors: Highly emotive or positive information is generally easier to remember in the long term (e.g., nostalgia).
Thinking: Reasoning and Problem Solving
Reasoning
- Reasoning involves using knowledge to draw conclusions or infer new information.
- Deductive Reasoning: Derives logically necessary conclusions from premises (e.g., "If it is Friday then she goes to work. It is Friday. Therefore she goes to work"). The conclusion depends on logic, not necessarily external truth.
- Inductive Reasoning: Generalizing from seen cases to unseen cases (e.g., assuming all elephants have trunks because all observed elephants do). This is unreliable as it can be disproved by a single contradictory case but never fully proved.
- Abductive Reasoning: Reasoning from a fact to the action or state that caused it (e.g., inferring someone has been drinking because they are driving fast). This is unreliable as multiple causes may lead to the same observed fact.
Problem Solving
- The process of finding a solution to an unfamiliar task using existing knowledge.
- Gestalt Theory: Problem solving involves both reproductive (reuse of knowledge) and productive (insight and restructuring) processes. Reproduction can hinder solutions if a person "fixates" on known aspects and misses novel interpretations.
- Problem Space Theory (Newell and Simon): Views the mind as a limited information processor navigating a space of potential solutions.