Controlando o windows like a boss com o Intel Perceptual SDK

31
André Carlucci Controlando o Windows like a boss com o Intel RealSense SDK

description

Aprenda como controlar o Windows programaticamente com o Perceptual SDK, adicionando um controle natural e intuitivo a qualquer aplicação de sua máquina.

Transcript of Controlando o windows like a boss com o Intel Perceptual SDK

Page 1: Controlando o windows like a boss com o Intel Perceptual SDK

André Carlucci

Controlando o Windows like a boss com o Intel RealSense SDK

Page 2: Controlando o windows like a boss com o Intel Perceptual SDK

André Carlucci

Controlando o Windows like a boss com o Intel Perceptual Computing SDK

Page 3: Controlando o windows like a boss com o Intel Perceptual SDK
Page 4: Controlando o windows like a boss com o Intel Perceptual SDK
Page 5: Controlando o windows like a boss com o Intel Perceptual SDK
Page 6: Controlando o windows like a boss com o Intel Perceptual SDK

Intel 3d Camera

30fps 720p Camera60fps IR 320x240Dual-array Mic

Page 7: Controlando o windows like a boss com o Intel Perceptual SDK

Intel Software Day 2013…

Page 8: Controlando o windows like a boss com o Intel Perceptual SDK

WPF App SignalR Javascript

Page 9: Controlando o windows like a boss com o Intel Perceptual SDK

WPF App SignalR Javascript

Page 10: Controlando o windows like a boss com o Intel Perceptual SDK

WPF App SignalRChrome Plugin

Page 11: Controlando o windows like a boss com o Intel Perceptual SDK

WPF App

Control Windows!

Page 12: Controlando o windows like a boss com o Intel Perceptual SDK

One app to rule them all!

Page 13: Controlando o windows like a boss com o Intel Perceptual SDK

SharpPerceptual

https://github.com/andrecarlucci/SharpPerceptual

Install-Package SharpPerceptual

Page 14: Controlando o windows like a boss com o Intel Perceptual SDK

SharpPerceptual

var cam = new Camera();cam.Start();cam.LeftHand.Visible += () => {

Console.WriteLine("Hello");}cam.RightHand.Moved += m => {

Console.WriteLine("-> x:{0} y:{1}", m.X, m.Y);}

Page 15: Controlando o windows like a boss com o Intel Perceptual SDK

SharpPerceptual

var gesture = new CustomGesture(camera.RightHand);gesture.AddMovement(Movement.Forward(10, 500));gesture.GestureDetected += () => {

Console.WriteLine("Punch!");}

Page 16: Controlando o windows like a boss com o Intel Perceptual SDK

DEMO! 2048

Page 17: Controlando o windows like a boss com o Intel Perceptual SDK

Windows API

Base Services

kernel32.dll

Advanced Services

advapi32.dll

Graphicswin32k.sys

User Interfaceuser32.dll

Common Dialog

comdlg32.dll

Common Control

commctrl.dll

Windows Shell

shell32.dll

Network Services

netapi32.dll

Page 18: Controlando o windows like a boss com o Intel Perceptual SDK

P/Invoke!

Marshaling service

managed unmanaged

Page 19: Controlando o windows like a boss com o Intel Perceptual SDK

P/Invoke!

1. Encontra a dll2. Carrega na memória (caso não esteja)3. Encontra o endereço da função e envia os

argumentos4. Trasfere o controle para função

Page 20: Controlando o windows like a boss com o Intel Perceptual SDK

P/Invoke!

[DllImport("user32.dll")]public static extern int SetCursorPos(int x, int y);

Page 21: Controlando o windows like a boss com o Intel Perceptual SDK

MrWindows

https://github.com/andrecarlucci/MrWindows

Install-Package MrWindows

Page 22: Controlando o windows like a boss com o Intel Perceptual SDK

MrWindows

var win = new Windows();win.Keyboard.TypeTogether(VirtualKey.Control,

VirtualKey.Alt, VirtualKey.Delete);

win.Mouse.MouseLeftClick();

Page 23: Controlando o windows like a boss com o Intel Perceptual SDK

DEMO!

Page 24: Controlando o windows like a boss com o Intel Perceptual SDK

The Lock Screen

Page 25: Controlando o windows like a boss com o Intel Perceptual SDK

Windows Credential Provider

• Customiza o logon no Windows• Entrou no lugar do GINA (Graphical

Identification and Authentication)• C++

Page 26: Controlando o windows like a boss com o Intel Perceptual SDK

pGina

http://pgina.org/

Page 27: Controlando o windows like a boss com o Intel Perceptual SDK

pGina Architecture

Page 28: Controlando o windows like a boss com o Intel Perceptual SDK

Mas e o Trello?

Page 29: Controlando o windows like a boss com o Intel Perceptual SDK

Perguntas?

André [email protected]

Page 30: Controlando o windows like a boss com o Intel Perceptual SDK

Próximas palestras

• 14:05 - Intel RealSense SDK  Felipe Pedroso 

• 14:55 - Utilizando o padrão MVVM em Universal Apps - Ricardo Dorta

• 16:10 - Tecnologia de Games 3D em Windows Fabrício Catae

Page 31: Controlando o windows like a boss com o Intel Perceptual SDK

Obrigado!

André [email protected]