College of Technology, VNU, Ha Noi

2

I. IntroductionII. System

I. OverviewII. Techniques

III. ImplementationIV. Conclusion

CONTENT

College of Technology, VNU, Ha Noi

3

I. Introduction

College of Technology, VNU, Ha Noi

Typical Human – Computer Interaction (HCI)

4

High accuracy

High performance

Illness-causes

Repetitive

+-

College of Technology, VNU, Ha Noi

5

Gestures

Digitalize

Computer Commands

Gestures-Based HCI

College of Technology, VNU, Ha Noi

Horse Archery

6

+

-

College of Technology, VNU, Ha Noi

Horse Archery

7

Hand gestures-> Bow Controlling

Body vibration-> Horse speed

College of Technology, VNU, Ha Noi

8

• A 3D FPS Game. The character is an horsed-archer• Using Gestures Based HCI:

• Hand gestures control the archer’s actions• Body vibration defines horse speed

• A real sporty game: player takes real exercise while playing game

Horse Archery

College of Technology, VNU, Ha Noi

9

II. System

College of Technology, VNU, Ha Noi

10

GamePlayer

LCD/Projector Screen

Camera 01

System Overview

Cam

era

02

VibrationSensor

College of Technology, VNU, Ha Noi

11

Using Gestures Based HCI:1. Hand gestures control the archer’s actions:

drawing bow, aiming, shooting,…2. Body vibration defines horse speed

Horse Archery System Techniques

College of Technology, VNU, Ha Noi

12

1. Hand Gestures Tracker

Using Infrared (IR) Signal

IR Camera Computer System

Camera captures LEDs’ signal

IR LEDs

College of Technology, VNU, Ha Noi

13

Infrared LEDs are attached to Gloves

Attached LEDs’ positions changeaccording to the movement of the

player’s hands.

By tracking the LEDs’ signal, computerrecognize these movements and create

appropriate commands

College of Technology, VNU, Ha Noi

14

Advantages:

Good performanceHigh resolution

Built-in Bluetooth connection

IR CAM

Infrared Camera in useNintendo Wiimote

College of Technology, VNU, Ha Noi

15

2. Body Vibration Tracker

GamePlayerAttached to the Player

VibrationSensor

Computer System

College of Technology, VNU, Ha Noi

16

III. Implementation

College of Technology, VNU, Ha Noi

17

• Programming Language: C#• Framework: Microsoft XNA 3.0• IDE: Microsoft Express C# 2008• Library:

• WiimoteLibBrian Peek - http://www.brianpeek.com/blog/pages/wiimotelib.aspx

• HeightmapCollisionPipelineMicrosoft XNA Community Game Platform - http://creators.xna.com

• 3D Billboard ParticlesNemo Kradhttp://xna-uk.net/blogs/randomchaos/archive/2008/04/01/3d-billboard-particles-tutorial-vi.aspx

Implementation

College of Technology, VNU, Ha Noi

18

Screenshots

College of Technology, VNU, Ha Noi

19

Screenshots

College of Technology, VNU, Ha Noi

20

IV. Conclusion

College of Technology, VNU, Ha Noi

21

Discussion

• Advantages:• A new way to play computer games• Interesting and funny to play• An attractive way to take exercise and reduce stress

• Disadvantages:• Limitations in current hardware implementation

College of Technology, VNU, Ha Noi

22

Future Developments

• Develop Multi-players game mode• Extend the system to play other sporty games• Improve the accuracy of current Horse Archery implementation

College of Technology, VNU, Ha Noi

23College of Technology, VNU, Ha Noi