David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE
description
Transcript of David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE
![Page 1: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/1.jpg)
Reducing the Cognitive/Linguistic Load of Persons with Aphasia and Traumatic
Brain Injury Who Rely on AAC
David Beukelman
University of Nebraska, Lincoln
With support from:
AAC-RERC/NIDRR/USDE
Technology Transfer Partner
Dynavox
![Page 2: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/2.jpg)
AAC: Augmentative and Alternative Communication
• A range of strategies to support communication for those with unmet communication needs
![Page 3: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/3.jpg)
Aphasia
• Language limitation due to damage language center in the left (usually) hemisphere – Range of symptoms– Range of severity– Range of recovery– 30% do not achieve full recovery– ??% with minimal functional verbal expression
![Page 4: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/4.jpg)
Traumatic Brain Injury
• Range of communication limitations– Motor speech– Cognitive/Linguistic– Combination
– Pattern of communication limitations changing as medical interventions improve.
– More combined communication limitations
![Page 5: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/5.jpg)
Intervention Strategies
• Restoration--restore verbal expression
• Compensation--provide alternatives to natural speech
• Combined--Integrate AAC and natural speech
![Page 6: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/6.jpg)
Cognitive/Linguistic Limitations Related to AAC
• Representation of Meaning
• Navigation through the AAC Interface
• Formulating Messages
• Organizing Content
![Page 7: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/7.jpg)
Aphasia: AAC Acceptance & Use
• Long history of low tech AAC use to support residual verbal expression– Communication books and boards– Drawing– Handwriting– Photography– Remnant books
![Page 8: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/8.jpg)
Aphasia: AAC Acceptance & Use
• High tech AAC use for specific tasks– Answering phone– Calling for help– Ordering in restaurants and stores– Giving speeches– Saying prayers– Engaging in scripted conversations
![Page 9: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/9.jpg)
Rationale for Using Visual Scene Displays (Aphasia)
• Make use of preserved skills of people with chronic aphasia– Visual-spatial processing– Retention of information about life
experiences (episodic information)– Retention of general world knowledge
![Page 10: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/10.jpg)
Strategy: To incorporate Contextually Relevant Visual Scenes
• Provide a way to represent meaning
• Support navigation within an AAC system
• Serve as a shared platform for co-constructing messages with listener(s)
• Establish a shared communication space
• Allow for integration with other types of communication supports
![Page 11: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/11.jpg)
Evaluating Images for Contextual Richness of a Visual Scene
Four criteria:– Environmental context (setting, people,
objects, and activities)– Interaction with people or the environment– Personal relevancy– Clarity regarding elements key to the implied
relationships
![Page 12: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/12.jpg)
Environment: HighInteraction: HighPersonal relevance: High Clarity: HighComment: Satisfies all the elements for being a good contextually-rich picture to support a story
![Page 13: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/13.jpg)
Environment: AbsentInteraction: Absent Personal relevance: High Clarity: HighComment: Typical portrait that does not convey any contextual or interaction information
![Page 14: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/14.jpg)
Environment: Absent
Interaction: Absent
Personal relevance: Absent
Clarity: High
Comment: Only serves to identify an
object; typical of pictures available in stimulus sets
![Page 15: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/15.jpg)
Environment:
Interaction:
Personal relevance:
Clarity:
![Page 16: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/16.jpg)
Environment:
Interaction:
Personal relevance:
Clarity:
![Page 17: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/17.jpg)
• Environment• Interaction• Personal relevance• Clarify
• Good scene?– 1a Yes– No
![Page 18: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/18.jpg)
• Environment• Interaction• Personal relevance• Clarify
• Good scene?– 1b Yes– No
![Page 19: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/19.jpg)
• Environment• Interaction• Personal relevance• Clarify
• Good scene?– 2a Yes– No
![Page 20: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/20.jpg)
• Environment• Interaction• Personal relevance• Clarify
• Good scene?– 2b Yes– No
![Page 21: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/21.jpg)
Low Tech Visual Scenes with Text Support
http:aac.unl.edu
![Page 22: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/22.jpg)
Visual Scene Display (VSD) for Aphasia and TBI
![Page 23: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/23.jpg)
VSD Navigational Strategies (High Tech)
Themes• Organizational strategy for • navigation
Color & CONTRAST• Learning • Memory• Pattern recognition• Organization
“Link Deeper”• Continue on same topic
![Page 24: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/24.jpg)
VSD
![Page 25: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/25.jpg)
Three Levels Content Management Strategies
• 1. People who rely on AAC
• 2. AAC Facilitator/General Clinician
• 3. AAC Specialists
![Page 26: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/26.jpg)
VSD with Content Management Functions For Facilitators
![Page 27: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/27.jpg)
VSD Features
• Drag and drop images from• Enter messages from onscreen keyboard• Hide and reveal buttons• Select from a range of templates• Navigate themes• Navigate deeper into themes• Enter content with requiring detailed
programming knowledge
![Page 28: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/28.jpg)
VSD Example
![Page 29: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/29.jpg)
VSD Example
![Page 30: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/30.jpg)
VSD Example
![Page 31: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/31.jpg)
Research Strategy
Case Reports and Small N Studies of Clinical Interventions with Current Technology
Experimental Studies PreferenceMessage representationNavigation of Interface
Usability Evaluations of Technology Revisions
![Page 32: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/32.jpg)
Aphasia: Participant 1
0
10
20
30
40
50
60
70
80
90
Per
cent
Tim
e U
sed VSD
Low Tech
Vocalizations
Gestures
Writing
Basic Needs New Information Social Closeness
![Page 33: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/33.jpg)
Participant 1
25 themes
105 pages
377 messages
185 pictures
![Page 34: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/34.jpg)
Aphasia: Participant 2
0
10
20
30
40
50
60
70
80
90
Perc
en
t Tim
e U
sed VSD
Low Tech
Vocalizations
Gestures
Writing
Basic Needs New Information Social Closeness
![Page 35: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/35.jpg)
Message Representation: Preference
– N = 8– Miechelle McKelvey Dissertation
Results Summary: Preference– Personally Relevant Pictures: 85%– Non-personally Relevant Pictures: 13%– Iconic Symbols: 3%
![Page 36: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/36.jpg)
Message Representation: Accuracy
– N = 8– Miechelle McKelvey Dissertation
Summary Results: AccuracyPersonally Relevant Pictures: 98%
– Non-personally Relevant Pictures: 55%– Iconic Symbols: 34%
![Page 37: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/37.jpg)
Learning New Themes
• Strategy:– Series of Small N Studies – Completed during field tests
• Conclusion: – Instruction/practice on FIRST THEME varied– Minimal instruction/practice on Subsequent
Themes after the FIRST THEME was mastered.
![Page 38: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/38.jpg)
Traumatic Brain Injury with Complex Communication Needs (N = 30)
• Summary from Fager et al. Survey (2006)• 32% used low-tech AAC
– Regained speech– Lack of Facilitator support– Lack of funding for high-tech AAC
• 68% used high-tech AAC– Of these, 87% used letter by letter spelling without message
retrieval– Minimal use of message retrieval strategies– Remainder used iconic symbols--
• TBI before learning to spell• Severe cognitive/language issues
![Page 39: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/39.jpg)
VSD with Onscreen Keyboard Option
VSD
to support episodic message retrieval
to support multiple themes
to support narrative organization
to supplement residual speech
Onscreen keyboard with speech synthesis output to support spelled messages
![Page 40: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/40.jpg)
VSD & Onscreen Keyboard with Speech Synthesis
![Page 41: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/41.jpg)
VSD for Severe Cognitive Conditions
• Subset of People with TBI are unable to communicate through speech and experience such severe cognitive limitations that spelling is not an option for some them.
• VSD appears to be an option provided that visual issues are managed with large pictures and print.
• Field Trials Ongoing
![Page 42: David Beukelman University of Nebraska, Lincoln With support from: AAC-RERC/NIDRR/USDE](https://reader033.fdocuments.us/reader033/viewer/2022061617/56815983550346895dc6c241/html5/thumbnails/42.jpg)
Acknowledgements
• AAC-RERC– Janice Light & Jeff Higginbotham
• University of Nebraska– Karen Hux, Aimee Dietz, Miechelle McKelvey, Kristy Weissling, Sarah Wallace
• Madonna Rehabilitation Hospital– Susan Fager
• Quality Living, Inc.– Liz Anderson