Connect with your
description
Transcript of Connect with your
![Page 1: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/1.jpg)
Connect with your
![Page 2: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/2.jpg)
![Page 3: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/3.jpg)
![Page 4: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/4.jpg)
![Page 5: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/5.jpg)
![Page 6: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/6.jpg)
![Page 7: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/7.jpg)
![Page 8: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/8.jpg)
![Page 9: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/9.jpg)
![Page 10: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/10.jpg)
Wow!
![Page 11: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/11.jpg)
Motorized TiltRGB Camera
3D Depth SensorsMicrophone Array
![Page 12: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/12.jpg)
openkinect.orgwww.openni.org
kinectforwindows.org
![Page 13: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/13.jpg)
Kinect for Windows
![Page 14: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/14.jpg)
That’s not USB
You’ll need this
Xbox Kinect
![Page 15: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/15.jpg)
What you Need
SDK
![Page 16: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/16.jpg)
Demo 0Hello Tilt
![Page 17: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/17.jpg)
BGR32 Formatwidth in pixels
heig
ht in
pixe
ls
Stride = Bytes Per Row
= bytes per pixel * width = 4 * width
4 Bytes Per pixel
Byte Array:
![Page 18: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/18.jpg)
Demo 1Hello Colorful World
![Page 19: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/19.jpg)
Depth data500mm 500mm500mm 500mm
2000mm2030mm2010mm2000mm
500mm500mm500mm2500mm
![Page 20: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/20.jpg)
Depth dataMax resolution for raw depth data is 640 x 480
2 bytes per pixel of depth data (short)11011110 pixel pixel pixel
00001 1110101000000 1110101000001
depthInMM = pixel >> DepthImageFrame.PlayerIndexBitmaskWidth
000 000 000
![Page 21: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/21.jpg)
Demo 2Depth
![Page 22: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/22.jpg)
Depth + Player Data500mm 500mm500mm 500mm
2000mm2030mm2010mm2000mm
500mm500mm500mm2500mm
player 1
player 1
player 1 player 1player 1
player 1 player 1
SkeletonStream.Enable();
var player = pixel & DepthImageFrame.PlayerIndexBitmask; 11011110
00001010
![Page 23: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/23.jpg)
Demo 3Depth + Player Data
![Page 24: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/24.jpg)
Skeletal Tracking
![Page 25: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/25.jpg)
skeletonFrame.Skeletons where skeleton.TrackingState == SkeletonTrackingState.Tracked
skeletonFrame.Skeletons
from skeleton in skeletonFrame.Skeletons where skeleton.TrackingState == SkeletonTrackingState.PositionOnly
![Page 26: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/26.jpg)
hand_left
wrist_leftelbow_left
shoulder_left
hand_right
wrist_rightelbow_right
shoulder_right
hip_left
head
hip_right
knee_left knee_right
ankle_rightankle_leftfoot_left foot_right
hip center
spine
shoulder_center
Skeleton.Joints[JointType]Joint.Position (X,Y,Z) Skeletons are mirroredX, Y, Z in metersOrigin(0,0,0) = center of camera.
+Z is out +X is to the right+Y is up
![Page 27: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/27.jpg)
Demo 3Skeletal Tracking
![Page 28: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/28.jpg)
Composites
+Color +
![Page 29: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/29.jpg)
CompositesColor
Color
+
+
+
MapDepthFrameToColorFrameMapDepthToColorImagePoint
MapDepthToSkeletonPoint
MapSkeletonPointToColor
MapSkeletonPointToDepth
![Page 30: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/30.jpg)
Demo 4Green Screen
![Page 31: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/31.jpg)
Kinect Audio
![Page 32: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/32.jpg)
![Page 33: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/33.jpg)
Echo Cancellation
![Page 34: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/34.jpg)
Echo CancellationEchoCancellationMode: None, CancellationOnly, CancellationAndSuppression
int EchoCancellationSpeakerIndex: Index of speaker to cancel
![Page 35: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/35.jpg)
Noise Suppression
![Page 36: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/36.jpg)
Noise Supressionbool NoiseSuppression – true, false
![Page 37: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/37.jpg)
Automatic Gain Control
![Page 38: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/38.jpg)
Automatic Gain Control
bool AutomaticGainControl – true, false
![Page 39: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/39.jpg)
Beam Forming
![Page 40: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/40.jpg)
Beam Forming-0.875 radians-50 degrees
0.875 radians 50 degrees
.0175 radians 10 degrees
![Page 41: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/41.jpg)
Demo 5Speech Recognition
![Page 42: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/42.jpg)
Audio @!%!#!! Gotchas
Use Microsoft.Speech not System.Speech
Must run in an MTAAEC SystemModes crash if no speaker output.
Must plug Kinect into Wall
DevicePairGuid / Qualitymetrics = crashShould run in ThreadMode Priority Highest?
![Page 43: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/43.jpg)
Demo 6Beam Forming
![Page 44: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/44.jpg)
Kinect SDK 1.5!Seated Skeletal TrackingFace Tracking Joint
Rotation
Kinect Studio
![Page 45: Connect with your](https://reader035.fdocuments.us/reader035/viewer/2022062218/568165b7550346895dd8b52f/html5/thumbnails/45.jpg)
Creative Commons Acknowledgments• Flickr by Ian Lewis• Flickr by major nelson• Flickr by markodesign• Flickr by stephantom• Flickr by Abstract Machine• Flickr By Aixo.co.kr• Flickr By Andresmh• Flickr by Antony Bennison• Flickr by Ars Electronica• Flickr By bm.iphone• Flickr by campuspartymexico• Flickr by Chris Jagers• Flickr By ci_polla Paola Sucato• Flickr by creepyhalloweenimages• Flickr by cvander• Flickr by IMAL.org• Flickr by Institut Douglas• Flickr by Joshua and AmberFlickr by Logon Sakai• Flickr by openexhibits• Flickr by Paul_Clarke
• Flickr by petyr.rahl• Flickr by pt• Flickr by Stilldavid• Flickr by y3rdua• Flickr by yesyesnono• Flickr by yum9me• Flickr by Jeff Howard• Flickr by jhscreenwm• Flickr by Kyle McDonald• Flickr by Morten Rand-Hendriksen• Flickr by Stuart Herbert• Flickr by Visiophone• Flickr by orkomedix• Michael Zöllner and Stephan Huber at the University of Konstanz• Openclip by J_Alves• Openclip by jetxee• Openclip by molumen• Openclip by shokunin• Openclip by Jhnri• Openclip by Machovka• Adafruit image of Hector Martin
Thanks!!