Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC...

79
Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART SAAC conference, Natal, Brazil 2004 www.Lburkhart.com

Transcript of Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC...

Page 1: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Designing Light-Tech & High Tech Dynamic auditory scanning

systems

GAYLE PORTERLINDA BURKHART

ISAAC conference, Natal, Brazil 2004

www.Lburkhart.com

Page 2: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Light tech Aided auditory scanning Partner assisted auditory scanning

Human voice “Smart partner” operating system

Not as rigid with timing Can interpret a broader range of

movements (learning movements) Partner skills to operate the system

Operational versus social speech

Vocabulary organization !

Page 3: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

High tech Aided auditory scanning Computer or dedicated communication

device Digitized or synthesized voice

Scanning voice versus speaking voice Can be confusing to “less involved” partners

Use different voices Use private and public speakers

More independent

“Computer” operating system Rigid with timing Accurate movements

Vocabulary organization !

Page 4: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Selection techniques 1 Movement to accept option

“Yes” – partner assisted auditory scanning Accurate movement with timing control to

access switch with automatic scanning

2 movements to reject & accept Differentiated “Yes” & “No” movements

generally increases partner’s confidence using scanning

? Increase activity & possible fatigue 2 switch scanning

Reduced timing & attention requirements Need to access to separate locations ? Increase activity & possible fatigue

Page 5: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Why use auditory scanning? Aim is the same as all AAC interventions

For the person to meet his/her varied communication requirements as intelligibly specifically efficiently independently in as socially valued a manner

as possible

Page 6: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Considerations for auditory scanning systems Choice of auditory or auditory +

visual system Cortical Vision Impairment

Operational considerations Social speech vs operational speech

• Selection set is transient

• Limited selection set presented at one time (auditory memory) Need multiple levels / branches

Page 7: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 8: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Auditory scanning activity display

Page 9: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Dynamic Auditory Scanning systems

Page 10: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Common issues using auditory scanning branching systems

Child and partner locating required vocabulary in branches

Layout instructions

Speed of communication (number of level changes required to communicate message)

Enabling quicker access to predictable messages

Enabling access to a wide vocabulary for spontaneous, unpredicted messages

Page 11: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Design strategies

To enable “automatic” level changes “go to page number” instructions Use of color & numbers on page tags

Organisation of dynamic display Placement of vocabulary Navigation

Page 12: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Organisation Dynamic displays Taxonomic - organised according to

categories

Schematic - organised according to events or activities

Topic - organised according to the topice.g.: I’m talking about my dog,

“I’m talking about pirates”, “I’m talking about school”.

Pragmatic - organised according to

communication function and

discourse requirements

Page 13: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Pragmatic organisation

Uses communication function and discourse requirements to structure the placement of vocabulary within the dynamic display.

Taxonomic, schematic, topic and anecdote organisations can all be used within a pragmatic organisation

Efficiency to meet communication requirements is the overriding factor determining the types of branches and the placement of specific vocabulary.

Page 14: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

The question

“What does the child need to say, when, to whom and how?”

raises many considerations for vocabulary placement

Vocabulary placement

Page 15: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Considerations for vocabulary placement

What functions may be expressed with this vocabulary?

Shop

- Request - “Let’s go to the shops”- Question – “Are we going to the shop?”- Relate information – “I went to the shop …….”- Tell a story – “We went to the shops ……..”- Pretend – “Let’s play shops”Etc. What type of branching organisation What type of branching organisation

suits each function?suits each function?

Page 16: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Pragmatic branch startersI like this I don't like this I think it’s .. (opinion)

Something's wrong I want something

I want to go somewhere Let’s do something

I'm telling you something I'm asking a question

I'm telling a story I have an idea

Do you want to hear a joke Let’s pretend

I’ve got something to show you I’ll tell you how to ....

Page 17: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Considerations for vocabulary placement

Time requirements for effective message transmission?

Priority continuum

Varies given message, function, environments, partners & individual requirements.

Consider discourse patterns of use

Some context dependent messages need to be said “quickly or not at all”.

Page 18: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Early learning auditory scanning book Partner instructions Visual symbols present

Opportunities to learn Point of focus (partner / child)

Early communication functions on separate pages

Introduction to lists within function Light tech

Partner scaffolds Active observation & interpretation of

movement Adapt timing

Reduced attention / skill needed for operation

Page 19: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Early learning auditory scanning book

Page 20: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 21: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 22: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 23: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 24: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 25: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 26: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 27: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 28: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 29: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 30: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 31: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 32: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Visual plus auditory scanning - May use light to highlight individual

pictographs

Page 33: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Auditory scanning chart

Page 34: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 35: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 36: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 37: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 38: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 39: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 40: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Expanding vocabulary

Expand range of communication functions Less predictable Require categories

Group interaction words – “quick chat”

Include anecdote strategies

Page 41: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 42: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 43: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .
Page 44: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Telling about group

I’ve got more to say

Go to p.7

Page 45: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Telling about group

I’m telling you something

Go to p.8

Page 46: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Telling about group

It’s about group

Go to p.8

Page 47: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Read group news

Page 48: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Granny had a birthday party

I’ve got more to say

Go to p 7

Page 49: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Granny had a birthday party

I’m telling you something

Go to p 8

Page 50: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Granny had a birthday party

It’s already happened

Go to p 9

Page 51: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Granny had a birthday party

people

Go to p 10

Page 52: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Granny had a birthday party

Granny

Go to categories p.9

“yes”

Page 53: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Granny had a birthday party

actions

Go to p.13

Page 54: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Granny had a birthday party

have (had)

Go to categories p.9

“yes”

Page 55: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Birthday

Go to categories p.9

“no”

party

Granny had a birthday party

Page 56: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Please put on a CD

I want something

Go to p. 11

Page 57: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Please put on a CD

music

Go to p. 11b

Page 58: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Please put on a CD

put on

a CD

Page 59: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Individual vocabulary placement

Page 60: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Individual vocabulary placement

Page 61: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Individual vocabulary placement

Page 62: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Individual vocabulary placement

Page 63: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Individual vocabulary placement

Page 64: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Operational commands

- Link pages To and from the front / main page

Need to be able to get to all pages from the front page and main navigation index

Need to be able to get back to main navigation index from all pages

To other “predictably” associated pages

Within a category or topic Turn the page / next page Go back / previous page Sub-category pages

Page 65: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Increasing linguistic complexity

Scaffolding Inclusion of more specific information Grammatically correct sentences

Uses conversational topic with pragmatic branch organisation Narrows options for auditory scanning whilst

allowing for broader vocabulary

Developed by Louise Dunne

Page 66: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

My class learned about the Federation of Aust.

I have a message about school

Go to page 4

Page 67: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

I’m telling you something

Go to page 4b

My class learned about the Federation of Aust.

Page 68: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Past tense

My whole class

learned about

Go to page 4c

My class learned about the Federation of Aust.

Page 69: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

The federation of

Australia

My class learned about the Federation of Aust.

Page 70: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Let’s work with James.

I have a message about school

Go to page 4

Page 71: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

I’ve got an idea.

Go to page 4g

Let’s work with James.

Page 72: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Let’s work with someone

Go to page 9b

Let’s work with James.

Page 73: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

…James

Let’s work with James.

Page 74: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

High tech dynamic displaysIssues & challenges for auditory scanning

Enough vocabulary/ message types to meet wide range of communication requirements

Limited number of options on a page with linear scanning

Absence of ‘co-construction’ from a communication partner in message formation Key words sentences expanded by partner

Voice output messages may not sound grammatically correct to the child

Louise Dunne 2001

Page 75: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Pragmatic organization for High Tech auditory scanning dynamic displays

Can use similar organizations to light tech displays Pragmatic branch starters Strategic clues such as “It’s already

happened”, “going to happen”.

However, computer technology only responds to it’s programming. Need to program extra pages and link buttons Operation and navigation buttons Scaffold language output Do tasks that partners do in light tech

systems

Page 76: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Other options

Combination direct access (eye, hand) to limited set of visual symbols with attached lists to use auditory scanning.

Auditory scanning groups of words

Page 77: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

References Ayton, T. and Porter, G. (1991) Working with visual

communication. in Bloomberg, K., and Johnson, H.,(eds), (1991) Communication Without Speech; A Guide for parents and teachers. Melbourne: Australian Council For Educational Research

Beukelman, D.R. & Mirenda, P. (1998) Augmentative and alternative communication. Management of severe communication disorders in children and adults. 2nd Edition. Baltimore: Paul H. Brookes Publishing Co.

Blackstone, S. (1994) Auditory scanning Augmentative Communication News 7(2), 6-7

Dunne, L. & Porter, G. (2001) Dynamic Displays: Low tech and High Tech. Pre-conference workshop AGOSCI conference Adelaide

Page 78: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Glennen, S.L. & De Coste, D.C. (1997) Handbook of augmentative and alternative communication San Diego, CA: Singular Publishing Group Inc.

Kraat, A. (1987) Communication interaction between aided and natural speakers: A state of the art report. (2nd Edition) Wisconsin- Madison: Trace R&D Center.

Light, J. (1989) Toward a Definition of Communicative Competence For Individuals Using Augmentative and Alternative Communication Systems. Augmentative and Alternative Communication Vol 5. No 2 pp 137- 144

Musselwhite, C. & Burkhart, L. (2002) Sequenced Social Scripts: Companion CD to Can we Chat? Co-Planned Sequenced Social Scripts

Page 79: Designing Light-Tech & High Tech Dynamic auditory scanning systems GAYLE PORTER LINDA BURKHART ISAAC conference, Natal, Brazil 2004 .

Porter, G. (2000) Ideas for the design of low- tech dynamic displays: User friendly, multi-level communication books. (printed in , Department of Education. (2001). Students with physical impairment: Augmentative and alternative communication. Brisbane, QLD: Author.)

Renner (2003) The development of communication with alternative means from Vygotsky’s cultural-historical perspective in von Tetzchner, S. & Grove, N. (eds) Augmentative and alternative communication: Developmental issues. London: Whurr Publishers Ltd.

Retherford, K.S. (1996) Normal communication acquisition: An animated database of behaviors. Eau Claire, WI: Thinking Publications

Smith, M.E. (1926) An investigation of the development of the sentence and the extent of vocabulary in young children. University of Iowa Studies in child welfare. 3, no. 5.