Communication Device for Communication Device for Handicapped KidsHandicapped Kids

Dec 05-08Dec 05-08Client Heartland Area AgencyClient Heartland Area Agency

Sue YoungSue Young Advisor Yao Ma Advisor Yao Ma

Alex LeithAlex LeithBrian GroveBrian GroveSteve PetersSteve PetersDec 6, 2005Dec 6, 2005

Presentation OutlinePresentation Outline Introductory MaterialIntroductory Material

DefinitionsDefinitions AcknowledgmentsAcknowledgments Problem StatementProblem Statement Operating EnvironmentOperating Environment Intended Users and UsesIntended Users and Uses Assumptions Assumptions LimitationsLimitations End Product and Other End Product and Other

DeliverablesDeliverables Design ApproachDesign Approach

Present AccomplishmentsPresent Accomplishments Approaches ConsideredApproaches Considered Project definition ActivitiesProject definition Activities

Design Approach (cont.)Design Approach (cont.) Research ActivitiesResearch Activities Design ActivitiesDesign Activities

Implementation ApproachImplementation Approach Implementation ActivitiesImplementation Activities Testing results and Testing results and

ModificationsModifications Resources and SchedulesResources and Schedules

Closing MaterialClosing Material Future work recommendationsFuture work recommendations Lessons Learned and risk Lessons Learned and risk

managementmanagement Project EvaluationProject Evaluation CommercializationCommercialization Closing SummaryClosing Summary

List of DefinitionsList of Definitions Amplifiers – This device will increase the volume Amplifiers – This device will increase the volume

of the message going to the speakerof the message going to the speaker Analog signal – Analog is a continuous signal Analog signal – Analog is a continuous signal

with no breaks in the waveformwith no breaks in the waveform Digital signal – Digital is an analog signal that is Digital signal – Digital is an analog signal that is

sampled at different times so the signal is sampled at different times so the signal is broken up into discrete samples broken up into discrete samples

D/A converter – Converts the digital output from D/A converter – Converts the digital output from the microcontroller to an analog outputthe microcontroller to an analog output

Filters – Filters will only allow the desired Filters – Filters will only allow the desired frequency to pass. frequency to pass.

Definitions (cont.)Definitions (cont.) LED’s – Light Emitting Diodes that light up when voltage LED’s – Light Emitting Diodes that light up when voltage

is applied across themis applied across them Level – Set of eight different recorded phrasesLevel – Set of eight different recorded phrases Memory – Refers to how long a message can be stored Memory – Refers to how long a message can be stored

into the microcontrollerinto the microcontroller Microcontroller – A device that acts as the brain behind Microcontroller – A device that acts as the brain behind

the end product the end product PWM – Pulse Width Modulation – Modulating an analog PWM – Pulse Width Modulation – Modulating an analog

signal into a series of pulses. The frequency and signal into a series of pulses. The frequency and amplitude of the pulses is constant. The width of the amplitude of the pulses is constant. The width of the pulses is determined by the amplitude of the input signal.pulses is determined by the amplitude of the input signal.

AcknowledgementsAcknowledgements

Faculty Advisor: Dr. Yao Ma for advice Faculty Advisor: Dr. Yao Ma for advice and ability to keep us on task.and ability to keep us on task.

Atmel for free components.Atmel for free components.

Jesse Macht for the donated caseJesse Macht for the donated case

Square D for the switchesSquare D for the switches

Problem StatementProblem Statement

Currently, disabled children have trouble Currently, disabled children have trouble communicating with caretakers about communicating with caretakers about basic needs. This project will create a basic needs. This project will create a device to aid these children in device to aid these children in communicating.communicating.

We will develop a recording play-back We will develop a recording play-back system to aid these children in system to aid these children in communicating with their care-givercommunicating with their care-giver

Operating EnvironmentOperating EnvironmentThe environment will be the home / school The environment will be the home / school

of a handicapped child.of a handicapped child.

The device will be subjected to physical The device will be subjected to physical stress (ie. being dropped) and must also stress (ie. being dropped) and must also be water resistant.be water resistant.

Intended Users and UsesIntended Users and UsesThe intended users are handicapped The intended users are handicapped

children and their care-giverschildren and their care-givers

There are differing levels of disabilities, so There are differing levels of disabilities, so there are multiple input methods for the there are multiple input methods for the handicapped childrenhandicapped children

Caretakers will record custom words or Caretakers will record custom words or phrases for later playbackphrases for later playback

AssumptionsAssumptions

It will only be used by one kid at a timeIt will only be used by one kid at a time The child will be able to physically use the deviceThe child will be able to physically use the device The caretaker will have a computer to print the The caretaker will have a computer to print the

different pictures used when they reprogram the different pictures used when they reprogram the devicedevice

The child can distinguish between the picturesThe child can distinguish between the pictures The end product will be used in a learning The end product will be used in a learning

environmentenvironment The product will operate on batteriesThe product will operate on batteries The end product will be programmable and will The end product will be programmable and will

play back messagesplay back messages

LimitationsLimitations The size is no bigger than 6” x 10” x 2”The size is no bigger than 6” x 10” x 2” The weight is no heavier than 5 lbsThe weight is no heavier than 5 lbs Battery power must last for at least 16 hoursBattery power must last for at least 16 hours Must be able to record messages for child to Must be able to record messages for child to

playbackplayback Each message will have a record time limit from Each message will have a record time limit from

one to five secondsone to five seconds The cost of the product will not be more than The cost of the product will not be more than

$150$150 Tests of the prototype will only be based on Tests of the prototype will only be based on

ease of setup and use ease of setup and use The product must withstand being droppedThe product must withstand being dropped

Communication DeviceCommunication Device

End Product and Other End Product and Other DeliverablesDeliverables

The end product will be a device that will have eight The end product will be a device that will have eight buttons that can hold recorded messagesbuttons that can hold recorded messages

There will be two switches one to control the levels There will be two switches one to control the levels and one to control the speed of the LED'and one to control the speed of the LED' S S

Other deliverables include a program to create Other deliverables include a program to create images on and single button accessoryimages on and single button accessory

A single button will be plugged into the product A single button will be plugged into the product when the child has limited range of motion and can when the child has limited range of motion and can not control the eight buttonsnot control the eight buttons

LED’s will light up a specific button for a small LED’s will light up a specific button for a small period of time and then move to the next button. period of time and then move to the next button. When the child recognizes the lit up button as the When the child recognizes the lit up button as the one they want, they press the single button and it one they want, they press the single button and it will playback the messagewill playback the message

Present AccomplishmentsPresent Accomplishments DocumentsDocuments Component SelectionComponent Selection Device DesignDevice Design

SoftwareSoftware HardwareHardware

Hardware TestingHardware Testing Microphone circuitMicrophone circuit Speaker circuitSpeaker circuit

Image SoftwareImage Software PCBPCB

Research ActivitiesResearch ActivitiesSimilar Device FunctionsSimilar Device FunctionsMicrocontrollerMicrocontrollerMemoryMemoryButtons and SwitchesButtons and SwitchesPCBPCBSoftware CompilerSoftware CompilerProgrammerProgrammerEmulatorEmulator

Approaches ConsideredApproaches Considered MicrocontrollersMicrocontrollers

MemoryMemoryExternalExternal InternalInternal

ADCADC ButtonsButtons

Push or SensorPush or Sensor WeightWeight SizeSize CostCost

Programming LanguageProgramming Language AsmAsm CC

Project Definition activitiesProject Definition activitiesMet with the ClientMet with the ClientDeveloped a general idea for deviceDeveloped a general idea for deviceResearched components for deviceResearched components for deviceDeveloped requirements and functionsDeveloped requirements and functionsFinalized the scope of the projectFinalized the scope of the project

Design ActivitiesDesign Activities Electrical power – Rechargeable batteries for the Electrical power – Rechargeable batteries for the

device will be used device will be used Size – The device must be portable Size – The device must be portable Weight – The device must be light enough to be Weight – The device must be light enough to be

transported from place to place by a small child.transported from place to place by a small child. Intended usage – One child at a time will be able Intended usage – One child at a time will be able

to physically use the device.to physically use the device. Software – The caretaker will have a computer Software – The caretaker will have a computer

to design and print the desired pictures used for to design and print the desired pictures used for the different programmed messages. The child the different programmed messages. The child will then be able to distinguish between the will then be able to distinguish between the pictures.pictures.

Design Activities (cont.)Design Activities (cont.)Programmable messages – Must be Programmable messages – Must be

able to be recorded and played back able to be recorded and played back easily.easily.

Cost – Must not exceed $150.00Cost – Must not exceed $150.00Time frame – The project will be Time frame – The project will be

completed by Dec. 2005.completed by Dec. 2005.Evaluation of device – Prototype will Evaluation of device – Prototype will

be tested on ease of setup and use.be tested on ease of setup and use.

Main Software FlowchartMain Software Flowchart

Essentially, the Essentially, the system will loop system will loop until a button is until a button is pressed, then a pressed, then a sound is recorded sound is recorded or played backor played back

Read / Write FlowchartsRead / Write Flowcharts

Algorithms were Algorithms were developed by developed by Atmel and then Atmel and then adapted to suit adapted to suit our needsour needs

Implementation ActivitiesImplementation Activities ImplementationImplementation

Microphone CircuitMicrophone Circuit Speaker Circuit Speaker Circuit PCBPCB Microcontroller SoftwareMicrocontroller Software

TestingTesting PSpicePSpice Used Sinusoid Used Sinusoid Listened to outputListened to output PCB and SoftwarePCB and Software

Changes made to designChanges made to design Filter Design for Speaker CircuitFilter Design for Speaker Circuit Unity gainsUnity gains Inverter array on the button outputsInverter array on the button outputs

Testing Results and ModificationsTesting Results and Modifications

Testing ResultsTesting Results Original Design was too quietOriginal Design was too quiet The power was too low to drive the SpeakerThe power was too low to drive the Speaker Microcontroller was unable to communicate with flash Microcontroller was unable to communicate with flash

memorymemory ModificationsModifications

Added another filter to increase the gain in the Added another filter to increase the gain in the speaker circuitspeaker circuit

Used unity gain amplifiers to increase the current to Used unity gain amplifiers to increase the current to speakerspeaker

Inverter array was added to the button outputs to Inverter array was added to the button outputs to make them work with the encodermake them work with the encoder

520.522.5359.529.587.520.5Totals 

202.58138.51632.57.5 Alex Leith

1857.5130.57.531.58 Brian Grove

133798.5623.55Steve Peters

TotalTask 5Task 4Task 3Task 2Task1Personal Name

ResourcesResourcesTask 1 – Problem DefinitionTask 2 – Identify Technology and SelectionTask 3 – DesignTask 4 – Prototype Implementation and TestingTask 5 – Demonstration

Personal Efforts

Resources Con’tResources Con’t

$5607.10$141.85Total 

$5465.25Subtotal 

$2126.25 Alex Leith

$1942.50 Brian Grove

$1396.50Steve Peters

   Labor at $10.50 per Hour:

$46.15$46.15Subtotal 

$10.00$10.00Print Poster

$3.15$3.15Packaging

$33.00$33.00Printed Circuit Board

   Services:

$95.70$95.70Subtotal

$0.00$0.00Poster

$0.00$0.00Batteries

$90.00$90.00Electronic Components

$5.70$5.70Microcontroller

   Parts and Materials:

With LaborW/O Labor Item Financial Resources

11stst Semester Schedule Semester Schedule

ID Task Name Start Finish DurationJan 2005 Feb 2005 Mar 2005 Apr 2005 May 2005

1/16 1/23 1/30 2/6 2/13 2/20 2/27 3/6 3/13 3/20 3/27 4/3 4/10 4/17 4/24 5/1 5/8 5/15 5/22

1

2

3

4

5

6

7

8

9

10

11

12

18d2/4/20051/18/2005Problem Definition

50d3/26/20052/5/2005Technology Considerations andSelections

30d3/6/20052/5/2005Identify possible technologies

35d3/21/20052/15/2005Research

18d3/26/20053/9/2005Technology selection

51d5/6/20053/17/2005Product design

27d4/12/20053/17/2005Design algorithms for software

40d4/25/20053/17/2005Design each module

36d5/6/20054/1/2005Design the integration of the parts

109d5/6/20051/18/2005Documentation

39d5/6/20053/29/2005Testing

108d8/21/20055/6/2005Summer Break

22ndnd Semester Schedule Semester ScheduleID Task Name Start Finish Duration

Aug 2005 Sep 2005 Oct 2005 Nov 2005 Dec 2005

8/7 8/14 8/21 8/28 9/4 9/11 9/18 9/25 10/2 10/9 10/16 10/23 10/30 11/6 11/13 11/20 11/27 12/4 12/11

1

2

3

4

5

6

7

8

9

10

11

12

13

105d12/4/20058/22/2005Documentation

91d11/20/20058/22/2005Testing

108d8/21/20055/6/2005Summer Break

91d11/20/20058/22/2005Prototype implementation and testing

6d8/27/20058/22/2005Prototype limitations

47d10/13/20058/28/2005Build the modules

47d10/13/20058/28/2005Program the device

38d11/20/200510/14/2005Integrate the components

21d12/11/200511/21/2005Device Demonstration

14d12/4/200511/21/2005Demonstration Planning

1d12/5/200512/5/2005Faculty advisor demonstration

3d12/8/200512/6/2005Client demonstration

3d12/11/200512/9/2005Industrial Review Panel Demonstration

Future Work RecommendationsFuture Work RecommendationsBattery charging circuitBattery charging circuitLCD touch screenLCD touch screenWireless connectionWireless connectionMicrocontroller to memory communicationMicrocontroller to memory communicationSpeed controlSpeed controlReliability of physical connectionsReliability of physical connections

Lessons Learned and Risk Lessons Learned and Risk ManagementManagement

Backup your data often into a source Backup your data often into a source repositoryrepository

Order PDIP for prototype testing Order PDIP for prototype testing Make sure you fully research software and Make sure you fully research software and

components before working to avoid components before working to avoid duplication of work by othersduplication of work by others

Loss of team memberLoss of team memberOrder parts as soon as possibleOrder parts as soon as possible

Project EvaluationProject EvaluationWould have been easier if we had a full Would have been easier if we had a full

teamteamPeripheral components and features work Peripheral components and features work

except for the memoryexcept for the memoryBelow budget of $150Below budget of $150

CommercializationCommercialization

The purpose of creating the The purpose of creating the communication device is for use by communication device is for use by Heartland Area Education Agency and at Heartland Area Education Agency and at this time there are no plans of this time there are no plans of commercialization.commercialization.

Closing SummaryClosing SummaryThanks to everyone who gave their Thanks to everyone who gave their

support.support.We hope that we have laid the ground We hope that we have laid the ground

work for a device to make life easier for work for a device to make life easier for handicapped children.handicapped children.