Kinecting people

14
KINECTING PEOPLE Евгений Жарков Silverlight MVP

TAGS:

description

IT-JAM 2011 presentation

Transcript of Kinecting people

Page 1: Kinecting people

KINECTING PEOPLEЕвгений ЖарковSilverlight MVP

Page 2: Kinecting people

Немного фактов

• Продано более 10 млн. устройств• 77 игр (анонсировано: 45;

в продаже: 32)• Бесплатная Windows SDK• Коммерческая лицензия в разработке

Page 3: Kinecting people

СпецификацияSensor item Specification range

Viewing angle 43° vertical by 57° horizontal field of view

Mechanized tilt range (vertical)

±28°

Frame rate (depth and color stream)

30 frames per second (FPS)

Resolution, depth stream QVGA (320 × 240)

Resolution, color stream VGA (640 × 480)

Audio format 16-kHz, 16-bit mono pulse code modulation (PCM)

Audio input characteristics

A four-microphone array with 24-bit analog-to-digital converter (ADC) and Kinect-resident signal processing such as acoustic echo cancellation and noise suppression

Page 4: Kinecting people

Архитектура

Page 5: Kinecting people

Архитектура

Video Components Audio Components

Windows components

1

2

35

4

Kernel-mode drivers for Kinect for Windows

DMO codec for mic array

Applications

Kinect for Windows SDK

User-created components

USB Hub

Windows Core Audio and Speech APIs

Device setup

Audio stream controlVideo stream control

WinUSB device stack USBAudio audio stackWinUSB camera stack

Motor Audio mic arrayCameras

NUI APIA/V capture and transcodingMedia Foundation | DirectShow

User Mode

Kernel Mode

Kinect sensor

Hardware

Device access

Page 6: Kinecting people

Kine

ct S

DK

Raw sensor streams

Skeletal tracking

Advanced audio capabilities

Support C++, C# and VB

Page 7: Kinecting people

Пространства имен

Microsoft.Research.Kinect.Nui

Microsoft.Research.Kinect.Audio

Page 8: Kinecting people

Пространства имен

Camera

Device

ImageFrame

ImageStream

ImageViewArea

Joint

JointsCollection

PlanarImage

Runtime

SkeletonData

SkeletonEngine

SkeletonFrame

ImageFrameReadyEventArgs

SkeletonFrameReadyEventArgs

TransformSmoothParameters

Vector

Page 9: Kinecting people

Узлы скелета

Page 10: Kinecting people

Узлы скелета

Page 11: Kinecting people

Фреймворки и компоненты

• CL NUI• NeoAxis• ofxKinect• OpenKinect• OpenNI• KinMob• InfoStrat Motion Framework (MotionFx)• Kinect WPF• Kinected Framework

Page 12: Kinecting people

Проекты

• Virtual Dressing• Light Saber• Kinect Paint• Incredible Hulk• JediBot• Kinductor• Kinect Controlled Quadrotor

Page 13: Kinecting people

Демо

Page 14: Kinecting people

Евгений Жарков[email protected]

@2j2e

Слушай подкаст2Гига

Вопросы?

Слушай подкастWP7Rocks