Objects Interaction and Source Code Week 2. OBJECT ORIENTATION BASICS REVIEW.
Smart Objects for Human Computer Interaction, Experimental Study
-
Upload
jeroen-doggen -
Category
Technology
-
view
667 -
download
0
Transcript of Smart Objects for Human Computer Interaction, Experimental Study
![Page 1: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/1.jpg)
Smart Objects for Human Computer
Interaction, Experimental Study
Doggen, J.*; Neefs, J.; Brands, E.; Peeters, T.;Bracke, J.; Smets, M.; Van der Schueren, F.
March 22, 2012
![Page 2: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/2.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
2/29
![Page 3: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/3.jpg)
Arduino based Smart Objects
I We developed a wireless sensormodule based on the Arduinodevelopment board.
I We use the “smart dice” tocontrol computer applications.
I This basic concept can beadapted to implement varioussensor based applications.
3/29
![Page 4: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/4.jpg)
Arduino based Smart Objects
I We developed a wireless sensormodule based on the Arduinodevelopment board.
I We use the “smart dice” tocontrol computer applications.
I This basic concept can beadapted to implement varioussensor based applications.
3/29
![Page 5: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/5.jpg)
Arduino based Smart Objects
I We developed a wireless sensormodule based on the Arduinodevelopment board.
I We use the “smart dice” tocontrol computer applications.
I This basic concept can beadapted to implement varioussensor based applications.
3/29
![Page 6: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/6.jpg)
Wireless Sensor Networks & Smart Objects
I A wireless sensor network is a set of small autonomous sensornodes which cooperate to solve a common application usingsome kind of perception of physical parameters1.
I Smart objects sense their environment and communicate toincrease sensing efficiency and enable new ways of end-userinteraction.
1An FDL’ed Textbook on Sensor Networks, Thomas Haenselmann.4/29
![Page 7: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/7.jpg)
Wireless Sensor Networks & Smart Objects
I A wireless sensor network is a set of small autonomous sensornodes which cooperate to solve a common application usingsome kind of perception of physical parameters1.
I Smart objects sense their environment and communicate toincrease sensing efficiency and enable new ways of end-userinteraction.
1An FDL’ed Textbook on Sensor Networks, Thomas Haenselmann.4/29
![Page 8: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/8.jpg)
Arduino Development Platform
I The Arduino development platformallow designers to develop electronicprototypes.
I The platform has gained increasedpopularity over the last years.
I The open-source community has70000 registered users and anabundance of user submittedlibraries.
I Ease of use is the main selling point.
5/29
![Page 9: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/9.jpg)
Arduino Development Platform
I The Arduino development platformallow designers to develop electronicprototypes.
I The platform has gained increasedpopularity over the last years.
I The open-source community has70000 registered users and anabundance of user submittedlibraries.
I Ease of use is the main selling point.
5/29
![Page 10: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/10.jpg)
Arduino Development Platform
I The Arduino development platformallow designers to develop electronicprototypes.
I The platform has gained increasedpopularity over the last years.
I The open-source community has70000 registered users and anabundance of user submittedlibraries.
I Ease of use is the main selling point.
5/29
![Page 11: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/11.jpg)
Arduino Development Platform
I The Arduino development platformallow designers to develop electronicprototypes.
I The platform has gained increasedpopularity over the last years.
I The open-source community has70000 registered users and anabundance of user submittedlibraries.
I Ease of use is the main selling point.
5/29
![Page 12: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/12.jpg)
Arduino based Smart Objects
I We built a WSN using theArduino platform to developa smart object.
I A “smart dice” to controlcomputer applications.
I The dice can be replaced byany object, e.g. a kids’ toy
6/29
![Page 13: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/13.jpg)
Arduino based Smart Objects
7/29
![Page 14: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/14.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
8/29
![Page 15: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/15.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
9/29
![Page 16: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/16.jpg)
System Architecture
10/29
![Page 17: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/17.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
11/29
![Page 18: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/18.jpg)
Hardware Specifications
I Seeeduino development boardI Digi XBee wireless interfaceI Freescale Semiconductor MMA7361 analog accelerometerI InvenSense ITG-3200 digital gyroscopeI Sharp GP2Y0A21YK infra-red distance sensor
12/29
![Page 19: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/19.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
13/29
![Page 20: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/20.jpg)
Arduino Libraries
I Arduino software libraries make it straightforward for anyone tostart embedded development.
I Used Arduino librariesI ITG-3200 Gyro library
I Developed Arduino librariesI Sharp GP2Y0A21YK infra-red distance sensorI MMA7361 accelerometerI Signal filtering
I XNA library to connect the module to C# applications
14/29
![Page 21: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/21.jpg)
Arduino Libraries
I Arduino software libraries make it straightforward for anyone tostart embedded development.
I Used Arduino librariesI ITG-3200 Gyro library
I Developed Arduino librariesI Sharp GP2Y0A21YK infra-red distance sensorI MMA7361 accelerometerI Signal filtering
I XNA library to connect the module to C# applications
14/29
![Page 22: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/22.jpg)
Arduino Libraries
I Arduino software libraries make it straightforward for anyone tostart embedded development.
I Used Arduino librariesI ITG-3200 Gyro library
I Developed Arduino librariesI Sharp GP2Y0A21YK infra-red distance sensorI MMA7361 accelerometerI Signal filtering
I XNA library to connect the module to C# applications
14/29
![Page 23: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/23.jpg)
Arduino Libraries
I Arduino software libraries make it straightforward for anyone tostart embedded development.
I Used Arduino librariesI ITG-3200 Gyro library
I Developed Arduino librariesI Sharp GP2Y0A21YK infra-red distance sensorI MMA7361 accelerometerI Signal filtering
I XNA library to connect the module to C# applications
14/29
![Page 24: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/24.jpg)
Arduino Library Example
1. Include header files
2. Initialise objects and variables
3. setup → configuration
4. loop → start example program
15/29
![Page 25: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/25.jpg)
Arduino Library Example
1. Include header files
2. Initialise objects and variables
3. setup → configuration
4. loop → start example program
15/29
![Page 26: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/26.jpg)
Arduino Library Example
1. Include header files
2. Initialise objects and variables
3. setup → configuration
4. loop → start example program
15/29
![Page 27: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/27.jpg)
Arduino Library Example
1. Include header files
2. Initialise objects and variables
3. setup → configuration
4. loop → start example program
15/29
![Page 28: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/28.jpg)
Arduino libraries: usage statistics
I MMA7361 accelerometer library2
I Sharp GP2Y0A21YK infrared distance sensor library3
I Total downloads: both ± 320
2http://code.google.com/p/mma7361-library3http://code.google.com/p/gp2y0a21yk-library/
16/29
![Page 29: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/29.jpg)
Arduino libraries: usage statistics
I MMA7361 accelerometer library2
I Sharp GP2Y0A21YK infrared distance sensor library3
I Total downloads: both ± 320
2http://code.google.com/p/mma7361-library3http://code.google.com/p/gp2y0a21yk-library/
16/29
![Page 30: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/30.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
17/29
![Page 31: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/31.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
18/29
![Page 32: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/32.jpg)
Signal Filtering
I Many analog sensors have signal differences between individualsensors.
I Calibration and signal filtering is needed to compensate forthese undesirable effects.
I We implemented three simple software based filters:
I variable-length weighted moving average filterI Bessel low-pass filterI Chebychev low-pass filter
I The signal filtering library is available online4.
4http://code.google.com/p/arduino-signal-filtering-library
19/29
![Page 33: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/33.jpg)
Signal Filtering
I Many analog sensors have signal differences between individualsensors.
I Calibration and signal filtering is needed to compensate forthese undesirable effects.
I We implemented three simple software based filters:I variable-length weighted moving average filterI Bessel low-pass filterI Chebychev low-pass filter
I The signal filtering library is available online4.
4http://code.google.com/p/arduino-signal-filtering-library
19/29
![Page 34: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/34.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
20/29
![Page 35: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/35.jpg)
Software Tools
I SerialMonitor: log and analyse sensor data
I SerialForwarder: forward serial data over a TCP/IP socket
21/29
![Page 36: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/36.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
22/29
![Page 37: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/37.jpg)
Demo Applications
I Flight simulator: sensor actsas a joystick
I Pac-man clone: sensorgenerates arrow inputs
23/29
![Page 38: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/38.jpg)
Demo Applications
I 2-D platform game:I Left/right: tilt
detectionI Jump: upward
movement
24/29
![Page 39: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/39.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
25/29
![Page 40: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/40.jpg)
Future Work
I Use mixed RF technologiesI Support the more power efficient nRF24
wireless technology
I Minimise energy consumptionI Use the module for various student
projects:
I Development of embedded softwareI Printed circuit board designI Signal processing applications
I Projects
I Development of a city monitoringapplication
I Cooperation with product developmentdepartment: prototyping
26/29
![Page 41: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/41.jpg)
Future Work
I Use mixed RF technologiesI Support the more power efficient nRF24
wireless technology
I Minimise energy consumption
I Use the module for various studentprojects:
I Development of embedded softwareI Printed circuit board designI Signal processing applications
I Projects
I Development of a city monitoringapplication
I Cooperation with product developmentdepartment: prototyping
26/29
![Page 42: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/42.jpg)
Future Work
I Use mixed RF technologiesI Support the more power efficient nRF24
wireless technology
I Minimise energy consumptionI Use the module for various student
projects:I Development of embedded softwareI Printed circuit board designI Signal processing applications
I Projects
I Development of a city monitoringapplication
I Cooperation with product developmentdepartment: prototyping
26/29
![Page 43: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/43.jpg)
Future Work
I Use mixed RF technologiesI Support the more power efficient nRF24
wireless technology
I Minimise energy consumptionI Use the module for various student
projects:I Development of embedded softwareI Printed circuit board designI Signal processing applications
I ProjectsI Development of a city monitoring
applicationI Cooperation with product development
department: prototyping
26/29
![Page 44: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/44.jpg)
Outline
Introduction and Problem Statement
System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries
ApplicationsSignal FilteringSoftware ToolsDemo Applications
Future Work
Conclusion
27/29
![Page 45: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/45.jpg)
Conclusion
I We developed an Arduino based “smart cube”, equipped withvarious sensors.
I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.
I The system and its derivatives are being used for studentprojects.
I We plan to cooperate with third parties by developing similarmodules:
I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.
28/29
![Page 46: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/46.jpg)
Conclusion
I We developed an Arduino based “smart cube”, equipped withvarious sensors.
I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.
I The system and its derivatives are being used for studentprojects.
I We plan to cooperate with third parties by developing similarmodules:
I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.
28/29
![Page 47: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/47.jpg)
Conclusion
I We developed an Arduino based “smart cube”, equipped withvarious sensors.
I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.
I The system and its derivatives are being used for studentprojects.
I We plan to cooperate with third parties by developing similarmodules:
I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.
28/29
![Page 48: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/48.jpg)
Conclusion
I We developed an Arduino based “smart cube”, equipped withvarious sensors.
I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.
I The system and its derivatives are being used for studentprojects.
I We plan to cooperate with third parties by developing similarmodules:
I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.
28/29
![Page 49: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/49.jpg)
Conclusion
I We developed an Arduino based “smart cube”, equipped withvarious sensors.
I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.
I The system and its derivatives are being used for studentprojects.
I We plan to cooperate with third parties by developing similarmodules:
I Evaluation of the feasibility of industrial applications.
I Prototyping tool for product development purposes.
28/29
![Page 50: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/50.jpg)
Conclusion
I We developed an Arduino based “smart cube”, equipped withvarious sensors.
I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.
I The system and its derivatives are being used for studentprojects.
I We plan to cooperate with third parties by developing similarmodules:
I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.
28/29
![Page 51: Smart Objects for Human Computer Interaction, Experimental Study](https://reader036.fdocuments.us/reader036/viewer/2022081403/554a23b4b4c9051b578b46e5/html5/thumbnails/51.jpg)
Questions & Answers
29/29