Hand gesture-based interactive puppetry system to assist ...
hand gesture based interactive photo silder
-
Upload
sampada-muley -
Category
Engineering
-
view
263 -
download
1
Transcript of hand gesture based interactive photo silder
CSMSSCHH.Shahu College of Engineering
Department of Electronics and Communication Engineering,Aurangabad.
Seminar On
HAND GESTURE BASED INTERACTIVE PHOTO SLIDER
Presented By Guided By Sampada S Muley Prof. A.M Rawate
For the Degree ofMaster of Engineering
(Electronics and Telecommunication Engineering)
Dr. BABASAHEB AMBEDKAR MARATHWADA UNIVERSITY,AURANGABAD (M.S.)
OVERVIEWWhat is gesture?TypesObjectivesIntroductionHistoryCSLand preprocessingStages of gestureBlock diagramAdvantages, DisadvantageConclusion
2
What is gesture????
Gesture –any “moment’’.
Gesture is a form of non-verbal communication in which visible bodily actions communication particular message, either in place or speech or together and in parallel words.
Gestures can originate from any bodily motion or state but commonly originate from the face or hand.
3
Types of gesture
Dynamic- This gesture change over a period of time .ex A waving hand means “goodbye”.
Static- This gesture is in stable period of time. ex A stop hand. Gesture to Gesture recognition
This involves: 1) A posture: A static configuration without the movement of
the body part. 2) A gesture: A dynamic movement of the body part.
4
Objective
Provide the physically challenged users a better way to interact with the computers.
Provide a more natural Human Computer Interface. Helpful for handicap people. Interfacing user with software. Direction as well as count both will be responsible for the
hardware control.
5
Introduction
Two common technologies for hand gesture recognitionglove-based method• Using special glove-based device to extract hand
posture• Annoying
vision-based method• 3D hand/arm modeling• Appearance modeling
6
History
The hand gesture recognition is developed by many scienst in different field.Tin H -Hand tracking and recognize MAL (Myanmar Alphabets Language)William F -First Implementation of gesture recognition and real time. Manar M.- Developed ArSL(Arabic sign language)
7
CSL and Pre-processing
CSL is the abbreviation for Chinese Sign Language.
30 letters in CSL alphabet Objects in recognition.
8
Pre-processing hand gesture recognition
Detection of Hand Gesture Regions
Aim to fix on the valid frames and locate the hand region from the rest of the image.
Low time consuming fast processing rate real time speed
Detect skin region from the rest of the image by using color. Each color has three components RGB.
9
Three Stages Of Hand gesture
10
Inputs Devices
The ability to track person’s movement and some variation within tool and environment
Wired gloves-To detect the hand moments,postion n rotation (5- 10 degree).
Depth aware camera-Useful to detect the hand in short range (approximate a 3D representation ).
Single camera –Normal camera.
11
Block diagram
12
Gesture approaches and algorithm
Hand Gesture Technology
A Vision Based approaches: Instrumented Glove approaches
Colored Markers approaches
13
Appearance-based models
Skeletal-based algorithms
3-D Model Based Approaches
14
15
30 different gestures, 120 samples/gesture36*36 pixels3600 training samples vs. d = 1296Difficult to describe the data distributionReduce the dimensionality of hand gesture images
16
Based on the representation by skin pixels can be detected and form a binary image sequence M’(x,y,t) – region maskAnother binary image sequence M’’(x,y,t) which reflects the motion information is produced between every consecutive pair of intensity images – motion mask
Transformed the detection results into gray-scale images with 36*36 pixels.
Advantages
Able to understand people better.
Comm. Is able to carry out in an emergency.
Used for handicap people.
The system is connected in simple and active way.
Easy to used, no need to use special hardware.
System is fast, modular.
17
Disadvantages
High cost
Some assumption was made for the system like:-
o Input image include.o Many hand can perform the device.o Gesture are made with right hand only.o The arm must be vertical.o The palm is facing towards the camera.
18
conclusion
The most important of this hand gesture based in input modes is that using this method.
The user can interact with the application from a distance without using the keyboard or mouse
And in future scope we can design a framework through a application domain.
Also the framework may be useful for controlling different types of games which can be control by the hand gesture recognition
19
THANK YOU
20