A person using direct access selects a desired item on a display, either by using a body part (e.g. finger or toe), an instrument (e.g. stylus) or adaptive technology for cursor control (e.g. head tracking, eye tracking, or adapted joystick).
A person using indirect access is typically an individual who cannot control the muscles necessary for direct access, and uses one or more switches to make selections with a scanning interface.
Language refers to the vocabulary available on the tool, device, or software, and may include text, images, or a combination of both.
The representation of language in AAC technology is dependent on a person’s literacy skills and communication needs, and organized according to preferences, efficiency, or learning optimization.
Displays may be static (i.e. the screen remains constant regardless of user input).
Displays may be dynamic (i.e. screens change according to selections made by the user).
Output is the means by which the device or software produces a message that can be heard or read by the user and communication partners.
Output may include synthesized (computer-generated) or digitized (recorded) speech, text, or other visual representations of language, such as symbols.
Communication is a multimodal process for individuals with CCN.
Rely on a variety of different modes to communicate in their daily lives. Includes aided and unaided. People can integrate the use of multiple modes to communicate a single message. Ex. Shakes head + verbal approximation of 'no'. Ex. Sign more + point to picture. Can switch between modes given a context, partner, purpose of communication. Verbal speech with familiar people uses AAC for communication repair.
AAC users typically receive most input via spoken language. Augmented or supplemental input via AAC to augment and support understanding. Augmented/supplemental can be unaided or aided AAC. Mom shakes head no. Total communication (speech + signs combined input) improves comprehension (Wendt 2009). Speech + aided AAC. Aided AAC input, Aided Language stimulation, modeling enhances comprehension (specifically at single word level) (Allen, Schlosser, Brock, & Shane, 2017; O’Neill, Light, & Pope, 2018).
Symbol – is 'something that stands for or represents something else' (Vanderheiden & Yoder, 1986).
Referent – the 'something else' that a symbol represents is called its referent.
Iconicity – refers to the continuum that describes symbols by ease of recognition.
Transparent – At one end of this iconicity continuum are transparent symbols, which visually resemble their referents and thus are high in guessability.
Opaque – at the other end are opaque symbols, whose visual relationships to their referents are not obvious and may be quite arbitrary.
Translucent – In the middle of the iconicity continuum are translucent symbols, which are not readily guessable without additional information.
Aided: Symbols 'something that represents something else'. 'Something else' is the referent (what the symbol is referring to). Includes people, actions, objects, places, adjectives, questions, social words etc.
Iconicity: association between the symbol and its referent. Transparent → opaque. Transparent: you can look at the symbol and guess what it means even without a referent being there.
Visual Scene Displays (VSDs) represent people/actions etc. but embedded in context in which they occur.
Photo or video VSD. Many types of line drawings developed for Aided AAC, called symbol sets.
Must consider cultural and linguistic background during symbol selection.
Pictorial competence: ability to perceive, interpret, understand, and use pictures communicatively. In typically developing children: develops gradually over the first few years of life.
Presented in AAC as: Single letters, Words, Syllables (prefix/suffix), Sequences of commonly occurring letters (ch, th etc), Phrases, Sentences, Longer text.
Of all AAC options gives the most communicative power. Needs STRONG literacy skills.
Static displays: symbols do not change automatically. Provide a fixed set of symbols which are mechanically affixed to an underlying layer of plastic or paper material.
Until age 2 in typically developing children: children treat pictures like the objects they represent (try to grasp them because they think they ARE the referent).
Kiss photo (doesn’t know the photo isn’t really mom).
Age 3: children begin to understand that pictures are 2D and stand for objects or concepts (are symbols) and that referents can be depicted in multiple ways (color photo and black and white line drawing).
Think about how this applies to those with delayed communication development who hit this stage much later.
Implications for vocab selection and representation.
Traditional Orthography- Presented in AAC as:
Single letters
Words
Syllables (prefix/suffix)
Sequences of commonly occurring letters (ch, th etc)
Phrases
Sentences
Longer text
Of all AAC options gives the most communicative power.
Needs STRONG literacy skills.
Static displays: symbols do not change automatically. Provide a fixed set of symbols which are mechanically affixed to an underlying layer of plastic or paper material.
Non-electronic static display devices:
Paper communication boards and books
Oldest visual-symbol-based AAC devices
Advantages: low cost of materials, portability, durability, and reduced display preparation time. Many methods like this were used for the communication partner to interpret the message.
Dynamic displays: the language symbols change automatically as a normal part of operating the device.
Consider: cognitive load? Motor complexity?
Variety of vocab?
How do we organize, group and arrange the symbols? 2 main ways:
Grid Displays
Visual Scene Displays.
How do you search and select the symbols? Various ways in Grid Displays:
Schematic or Activity Organization
Taxonomic
Semantic-syntactic
Pragmatic organization dynamic displays (PODD)
Alphabetic
Chronological
Idiosyncratic.
Taxonomic Grid-Taxonomic categorization:
A page with all people vocabulary
A page with place vocabulary
A page with clothing
One with descriptive words, etc.
Advantages:
Taught in school
Typically acquired by age 6/7
Effective for those with use AAC to clarify specific words or messages to establish a topic.
Disadvantages:
Lots of navigation to switch displays
Less likely to be appropriate for those who rely on AAC for majority of their communication.
Semantic-syntactic grid display-Organized according to parts of speech:
Symbols mapped according to spoken word order and use
Intended to facilitate language learning.
Fitzgerald Key or modification:
Left to right into groups of WHO (agents) doing (actions) modifiers (adjectives) what (objects) where, when, etc.
Visual Scene Displays- Integrated scenes (photos):
Meaningful and motivating events within the individual’s life.
Organize vocabulary by activities, routines, events where the vocab is used.
Depict environmental and interactional context of an event.
Research support for usage of VSDs to support beginning communicators with developmental disabilities.
Research supports usage of VSDs for adults with significant language and cognitive limitations due to acquired conditions (Severe Aphasia, primary progressive aphasia, TBI).
Advantages for early symbolic communicators:
Capture the social interactions that are the context in which language is learned.
Reference familiar events/context for new vocab.
Preserve relationship between people and objects.
Limitations:
Support first words and early semantic relations.
Do not support advanced morphosyntax development.
Video VSDs- Capture visual context and activities as they occur:
Integrate AAC supports into the videos to facilitate communication.
Video models to support participation.
Decrease prompt reliance.
Unity: uses line drawings.
Minspeak/semantic compaction:
Apple icon has multiple meanings: Apple, food, fruit, eat, bite, hungry, etc.
Sequences of icons combined to store words based on multiple meanings.
LAMP:
ASD: increased symbolic communication post LAMP instruction, increase words (9-35) post 8 weeks.