Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based...
Transcript of Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based...
![Page 1: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/1.jpg)
Electrical and Computer Engineering
Mid-year Design ReviewTeam 14: SumoRoll
Meng Ling Shi, Xi Kun Zou, HongGao Chen,
Linghang Zeng, and Sana Gilani
Team Advisor: Prof. Janaswamy
![Page 2: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/2.jpg)
2Electrical and Computer Engineering
Meet the Team
Xi Kun Zou
(CSE)
HongGao
Chen (EE)
Linghang
Zeng (ME)
MengLing Shi
(CSE)
Sana Gilani
(EE)
![Page 3: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/3.jpg)
3Electrical and Computer Engineering
Problem Statement
▪ Create an interactive experience for our players using Motion technology
▪ Motion Technology that connects to a physical, mechanical object▪ Intuitive▪ More versatile compared to a remote control▪ More enjoyable experiences versus remote control for gaming▪ More exercise chances versus remote control▪ Possibilities of using gesture-based control to operate
transportation vehicles (e.g., a wheel chair)
![Page 4: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/4.jpg)
4Electrical and Computer Engineering
Project Overview
▪ 2 player game▪ Objective of the game is to use your hand motions to control a
gyrosphere, which will be used to attack other player’s gyrosphere. ▪ Whoever knocks the other players gyrosphere out of arena, wins▪ Two Leap Motion Controllers tracks each player’s hand gesture
which gets decoded into motion commands by a custom designed microcontroller and sent via a transmitter to the receiver inside the Gyrosphere
![Page 5: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/5.jpg)
5Electrical and Computer Engineering
System Requirements
1. Gyrosphere will be able to move forward, backward, left, right, and spin.2. Gyrosphere will be able to stop right after stop button3. Gyrosphere should respond to User commands quickly4. Two Gyrosphere signals will not interfere with each other5. Gyrospheres will be able to endure collisions of same mass with pedestrian speed6. Gyrosphere should be portable7. We want the entire system to be able to run for at least 30 mins
![Page 6: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/6.jpg)
6Electrical and Computer Engineering
System Specifications1. Speed of Gyrosphere: pedestrian speed ~2mph2. Material of Gyrosphere: Elastic coating on the outside of shell to protect and buffer against collisions3. Final Weight
• Gyrosphere: < 2 lbs• Leap Motion Technology: ~1lb
4. Overall Size• Leap Motion Controller: ~typical cell phone• Gyrosphere (Diameter): ~typical tennis ball.
5. Power Supply• Gyrosphere: Rechargeable battery and last minimum of 30 mins• Leap Motion Controller: Stable power source
6. Low delay : <0.25 second latency7. Non-interference wireless connection8. Motor :~1000 rpm for small wheels
9. Range of Gesturing: ~2 ft above Leap 10. Arena: ~10ft2
![Page 7: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/7.jpg)
7Electrical and Computer Engineering
Block DiagramGyrosphere Processing Unit
Touchless User Interface
Power
SupplyMotor
Wheels
Outer
Shell
Tx/Rx:
Receiver Leap Motion
Controller
TX/RX:
Transmitter
Gesture
Translation
Hand
Tracking
Outer Shell
Protection
Microcontroller
USB
Port
![Page 8: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/8.jpg)
8Electrical and Computer Engineering
System Topology
Arena
![Page 9: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/9.jpg)
9Electrical and Computer Engineering
MDR Deliverables● We want to be able to have motion recognition coded and one leap
motion controller that we have purchased and have it connect to a
mechanical output (not necessarily the gyrosphere, perhaps a RC
car). We plan to use open-source code to start developing our
gesture recognition code.
● Will test signal transmission and motors using Arduino and be able
to send Signals via bluetooth to control the set of motors. We plan
to use existing motors from M5, as well as Arduinos from M5 to do
our testing
● Design outer and inner structure of gyrosphere, ready to 3D print.
![Page 10: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/10.jpg)
10Electrical and Computer Engineering
Motion Tracking: Joe and MenglingTwo Leap Motion Controller:
Range: An 2 ft radius obtuse half-sphere above the device
Field of view: about 150 degrees
Tracking Speed: about 100 FPS
Transmission: USB 3.0 ~640 MBps
Overall:
Accurate
Quick (Sensor to PC)
Problem: loss of tracking occasionally
![Page 11: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/11.jpg)
11Electrical and Computer Engineering
Open Source Projects:
Cat Explorer
Paint
Sphero Project
![Page 12: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/12.jpg)
12Electrical and Computer Engineering
Controlling Sphero with Node.js and LeapMotion
Bluetooth connection
Node.js and Javascripts
Mac or Windows
Open source on github
Sphero Dev App - Ios/Android/PC
![Page 13: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/13.jpg)
13Electrical and Computer Engineering
Controlling the Sphero via Bluetooth and App
![Page 14: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/14.jpg)
14Electrical and Computer Engineering
Controlling 2 DC Motors via Bluetooth
![Page 15: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/15.jpg)
15Electrical and Computer Engineering
Bluetooth Module HC-05
▪ Serial Bluetooth module for Arduino
and other microcontrollers
▪ Operating Voltage: 3.6V to 6V
(Typically +5V)
▪ Range: ~100m
▪ Works with Serial communication
(USART) and TTL compatible
▪ Uses Frequency-Hopping Spread
spectrum (FHSS)
![Page 16: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/16.jpg)
16Electrical and Computer Engineering
L293D Motor Driver
▪ Enable- The Switch & Speed
▪ Input- Direction
3
4
6
8
9
11*Corresponding Arduino
pin connection
![Page 17: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/17.jpg)
17Electrical and Computer Engineering
Structural Design
▪ 3D printing shell, base▪ Purchase Rubber wheels▪ Leap Motion Controller▪ Switch - On/Off the device▪ Inner structure is non-rolling
![Page 18: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/18.jpg)
18Electrical and Computer Engineering
Inner Structure of Gyrosphere (Top View)
▪ The whole structure is 4x4x4 cubic inches
▪ Each plane is 4x4x.25 cubic inches
▪ There is hole on the top and center level for wire connection
▪ It will use screw to connect all planes
![Page 19: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/19.jpg)
19Electrical and Computer Engineering
Inner Structure of Gyrosphere (Bottom View)
▪ Three level of the structure
▪ Top level-for control system
▪ Second level-driving system
▪ Lowest level-power supplies, center of mass
![Page 20: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/20.jpg)
20Electrical and Computer Engineering
Team Roles: Gantt Chart
![Page 21: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/21.jpg)
21Electrical and Computer Engineering
CDR Deliverables
▪ One fully constructed gyrosphere that would be able to receive and execute simple hand gesture commands via Leap Motion Controller
▪ Failsafe will be tested and implemented
(Gyrosphere should stop when loses connection)
![Page 22: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/22.jpg)
22Electrical and Computer Engineering
Demo
![Page 23: Mid-year Design Review - UMass Amherst Presentation.pdf · Possibilities of using gesture-based control to operate transportation vehicles (e.g., a wheel chair) Electrical and Computer](https://reader036.fdocuments.us/reader036/viewer/2022081400/605c3184e2dbe975342c2f41/html5/thumbnails/23.jpg)
23Electrical and Computer Engineering
Thank you!
Questions?