Gaze Input

Gaze Pointing

  • Midas Touch

    • We don’t want to trigger input on everything we happen to look at

    • Gaze does not have an obvious ‘click’ method

  • Accuracy / Precision

    • Gaze fixations have natural jitter and eye tracking is not perfect

  • Expressiveness

    • We can quickly point our eyes at an object, but we cannot move or manipulate objects with gaze

Eye and Hand

  • Gaze selects, Touch manipulates

  • Gaze is faster and less effort

  • Touch is more expressive

Eye-Hand Coordination

  • Gaze guides action

  • The eyes naturally look at what we want to manipulate

Gaze Selects, Touch Manipulates

  • Gaze is faster and less effort

  • Touch is more expressive

Gaze Precedes Action

  • Gaze naturally precedes manual action

  • Gaze seamlessly extends the reach of the hands

Gaze and Pinch for Input in 3D

  • The hands do the work

  • Gaze selects the closest target

Rapid Switching

  • Complex tasks

  • Attention shifts between objects

Interacting Near and Far

  • Reach across wide ranges

  • Seamless from close up to distant

Eye-Hand Symbiosis

  • Multimodal input with eye and hands, combining relative strengths

    • Speed and reach of gaze

    • Accuracy and expressivity of the hands

  • Respecting natural eye-head coordination

    • Gaze precedes action

    • Careful design spatial-temporal conditions to trigger input

Comfortable Range

  • Eye Movement – align objects of interest over the fovea for a sufficient time to extract detail (~250ms)

  • Head Movement – extending visual range beyond comfortable eye-in-head rotation (~20 deg. visual angle from centre)

Gaze and Motion

  • In eye-tracking research, movement is treated as problem

    • Motion artefacts that interfere with detection of fixations

    • Goal - to have pure fixations as signal of attention

  • In natural gaze, the eyes respond to external motion

    • Smooth Pursuit Eye Movement (SPEM) enables us to focus on objects that are moving

    • Vergence Eye Movement enables us to focus on objects at different distances

    • Vestibulo-Ocular Reflex (VOR) stabilizes gaze when we move our head and body

Selection based on Gaze Pursuit

  • Implicit selection

  • Based on natural attention

  • No calibration procedure

Correlation as Selection Principle

  • Objects moving in display space

  • Eye movement tracked in its own space

  • Correlation over moving window

  • Based on natural smooth pursuit

  • Closed-loop gaze behaviour