Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball...

44
Project Team: Kamyar Javanmardi James Fong Anthony Nguyen Nielven Jay Olis Haptic Feedback Gaming System: Project Presentation ENSC 305/440 Simon Fraser University December 08, 2014

Transcript of Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball...

Page 1: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Team: Kamyar Javanmardi James Fong Anthony Nguyen Nielven Jay Olis

Haptic Feedback Gaming System:

Project Presentation

ENSC 305/440 Simon Fraser University December 08, 2014

Page 2: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Contents

• Motivation • Project Overview

• Company • Market • Competition • Financing • Schedule

• System Design • Overview • RFID System • CPU Module • Feedback System • Vest Enclosure

2

• Product Plan • Lessons Learned • Future Plans

• Conclusion • References

Page 3: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Motivation

3

• Video game popularity • First Person Shooter (FPS) genre

Page 4: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Motivation

4

Paintball

• Realistic

• Expensive

• Too messy

Laser Tag

• Inexpensive

• Unrealistic

• FPS team-activity popularity

Page 5: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Motivation

• Build upon action oriented gaming • First Person Shooter (FPS) games

• Combine best aspects of Paintball and Laser Tag

• Popularity of foam-dart guns

• Radio Frequency Identification (RFID) technology

• Improve gaming realism

• Haptic Feedback Gaming System (HFGS)

5

Page 6: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Motivation

• Our project is to build a HFGS • “360° Nexus-Series Haptic-System” (360-NS-HS)

6

Page 7: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Motivation

7

Nexus Haptic Series System

player awareness of their environment

Use of RFID system Feedback stimulant for wearer

360 ͦ

Page 8: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Motivation

•Users shoot each other with darts • Physical and visual feedback employed

• Simulate modern FPS game into a real-life counterpart

•Promote • Active lifestyle

• Social Skills

• Strategic thinking

8

Page 9: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Overview

9

Page 10: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Overview

Company

Market

Competition

Financing

Schedule

10

Who we are • RealSim Tech

• Combination of Realistic and Simulation

• Development: • gaming systems that provide heightened

gameplay “realism” • technology that advances gaming systems

Page 11: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Overview

Kamyar Javanmardi (CEO)

• Chief-Editor of documents

• Enclosure system development and support

Anthony Nguyen (CFO)

• Finance Management and Sourcing

• Feedback system development

Nielven Jay Olis (CTO)

• Product Design and Integration

• RFID System development

James Fong (COO)

• Operations Management

• Hardware Programming

Company

Market

Competition

Financing

Schedule

11

Page 12: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Overview

• Video game industry

Company

Market

Competition

Financing

Schedule

12

• $21.53B spent in

2013

• > 50% units sold are action/strategy oriented games

Page 13: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Overview

• Paintball enthusiasts

• New competition to boost market

Company

Market

Competition

Financing

Schedule

13

Page 14: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Overview

• Paintball • Liquid Ammunition/Airsoft guns • Limited venue • Expensive

• Laser Tag • Infrared technology (IR) • Recreational Centers • Lack of physical feedback

Company

Market

Competition

Financing

Schedule

14

Page 15: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Overview

Company

Market

Competition

Financing

Schedule

15

• Projected vs Actual cost

• Low Frequency RFID system Equipment Estimated

Cost

Actual

Cost

Comments

Parallax RFID Readers x 2 $120 $105.13

Parallax RFID Transponder Tags $30 $37.35

Arduino Microcontroller $50 $77.41 Purchased Mega 2560 in place

of Uno

Vibration Motors $50 $28.80

LED strips $30 $0 Chose cost effective design

Vest + paddings $50 $52.49

Foam blaster + ammunition $30 $16.79

Enclosures (LEDs, Arduino,

circuit) $30 $45.33

Miscellaneous

(wires/protoboard,

electronic/non electronic

components, adapters) $50 $65.98

Contingency $80 -

Total cost $520 $429.28

Page 16: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Overview

Company

Market

Competition

Financing

Schedule

16

• LEDs • Cheaper design, same effectiveness

• Microcontroller • Switched to Mega for extra serial ports

• Shipped components • Purchased extra

• Enclosures

• Pricey

• Overall, below projected budget

Page 17: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Project Overview

Company

Market

Competition

Financing

Schedule

17

Project Planning and Schedule

Page 18: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

18

Page 19: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

• Signal processing behaviour set by user

• Input: Darts embedded with RFID-Tags

• Output: Haptic and Visual Feedback Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

19

High-Level System Diagram

Page 20: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

20

RFID System

• Radio Frequency Identification

• Form of auto-identification

• Typical Uses • Animal tracking

• Inventory

• Access control

Page 21: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

• Prototype uses Low-Frequency (125-kHz) RFID System

• Low read time (~0.5 s)

• High-Frequency RFID system would enable faster read times (~0.125 s)

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

21

Page 22: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

• Foam-dart embedded with RFID Tags

• 12.4 mm diameter

• Tip lined with Velcro

• Multiple RFID readers for multiple targets

• Susceptible to reader collision

*Solution: Alternate reader enable states.

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

22

Page 23: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Microcontroller

• “Brain” of the entire system

• Arduino Mega 2560

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

23

Page 24: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Arduino Mega 2560

• Controls the flow between the RFID system input and Feedback system output

• Multiple serial port

• Utilize Arduino open source software

• Powered by 9V battery

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

24

Page 25: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Software

• Workflow

• Two game modes

• Game Mode 1 (1 health)

• Game Mode 2 (3 health)

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

25

Page 26: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Workflow

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

26

Page 27: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Game Mode Algorithm

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

27

Page 28: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Game Mode Algorithm cont’d

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

28

Page 29: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Game Mode Algorithm cont’d

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

29

Page 30: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Toggle Switch and Reset Button

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

30

Page 31: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

• Haptic Feedback System

• Vibration Motors • Front & Back

• Response to tagged dart Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

31

Vibration motor circuit

Page 32: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

• Visual Feedback System

• LEDs acts as health meter

• Visual feedback for non-wearer Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

32

LED circuit schematic

Page 33: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

• Switching Circuit • Motors & LEDs powered by 4 AA

batteries • Control signals to Arduino

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

33

Page 34: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

34

• System components enclosed

• Integrated and Assembled onto vest

Full Prototype Model of 360-NS-HS

Page 35: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

35

Page 36: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

System Design

Overview

RFID System

CPU Module

Feedback System

Vest Enclosure

36

Page 37: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Product Plans

37

Page 38: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Product Plans

• Reader read-speed hinders performance of the HFGS

• Reader interferences poses challenge of having multiple readers

• Limits target options

• More research

• Project & time management

• Prepare for the worst

Lessons Learned

Future Plans

38

Page 39: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Product Plans

• Innovate technology:

• Address issues of performance limitations of the HFGS

• Add upon the HFGS

• Custom helmet for HS

• More targets

• Custom dart-gun

• 3-D haptic feedback

Lessons Learned

Future Plans

39

Page 40: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Conclusion

• Created a Haptic Feedback Gaming System • Integration of RFID, Microcontroller, and Feedback system to create

a realistic tactical experience.

• Learning achievements

• RFID technology • How to integrate various systems • Proper documentation writing • Team dynamics • Having fun while building project

40

Page 41: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Acknowledgements

• Dr. Andrew Rawicz

• Steve Whitmore

• Jamal Bahari

• Lukas-Karim Mehri

• Mona Rahbar

• Fred Heep

• Engineering Student Society Endowment Fund

41

Page 42: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

References [1] 12.4 mm Round RFID Tag. (2014). [image] Available at: http://www.parallax.com/product/28445 [Accessed 8 Dec. 2014].

[2] 2014 Essential Facts About the Computer and Video Game Industry. (2014). 1st ed. [ebook] entertainment software association, pp.10,13. Available at: http://www.theesa.com/wp-content/uploads/2014/10/ESA_EF_2014.pdf [Accessed 8 Dec. 2014].

[3] After paintball The Big Bang Theory. (n.d.). [image] Available at: http://www.fanpop.com/clubs/the-big-bang-theory/images/27901106/title/after- paintball-photo [Accessed 8 Dec. 2014].

[4] Arduino Mega 2560. (2014). [image] Available at: http://arduino.cc/en/Main/arduinoBoardMega [Accessed 8 Dec. 2014].

[5] Counter Strike - Global Offensive. (2014). [image] Available at: http://cdn.hifipanda.com/51a48bbf21a4c46405.jpg [Accessed 8 Dec. 2014].

42

Page 43: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

References [6] Greater NY's Laser Tag Rankings. (2013). [image] Available at: http://www.barneystinsonblog.com/greater-nys-laser-tag-rankings/ [Accessed 8 Dec. 2014].

[7] RFID Card Reader – Serial. (2014). [image] Available at: http://www.parallax.com/product/28140 [Accessed 8 Dec. 2014].

[8] Statista, (2014). Paintball: number of participants U.S. 2013 | Statistic. [online] Available at: http://www.statista.com/statistics/191920/participants-in-paintball-in-the-us-since- 2006/ [Accessed 8 Dec. 2014].

43

Page 44: Haptic Feedback Gaming System - Simon Fraser Universitywhitmore/courses/ensc305/... · •Paintball •Liquid Ammunition/Airsoft guns •Limited venue •Expensive •Laser Tag •Infrared

Questions

44