BriefCam– The Video Synopsis Company -...

16
BriefCam – The Video Synopsis Company ISC West, April 2017 Extracting Actionable Data from Video Extracting Actionable Data from Video Extracting Actionable Data from Video Extracting Actionable Data from Video Surveillance Surveillance Surveillance Surveillance- - - DNN & GPU DNN & GPU DNN & GPU DNN & GPU

Transcript of BriefCam– The Video Synopsis Company -...

Page 1: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

BriefCam – The Video Synopsis Company

ISC West, April 2017

Extracting Actionable Data from Video Extracting Actionable Data from Video Extracting Actionable Data from Video Extracting Actionable Data from Video

SurveillanceSurveillanceSurveillanceSurveillance---- DNN & GPUDNN & GPUDNN & GPUDNN & GPU

Page 2: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable
Page 3: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

Input Video Processing Storage

Interactive Applications

Big Data

Page 4: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

Object Classifier – combining machine vision (appearance) and machine learning (classification)

Behavior – object movements with related metadata (direction, speed, path…)

Statistics – group metadata – agg. & analysis (average, irregular)

Adding new use cases

✓✓✓✓

✓✓✓✓

✓✓✓✓

New Use Cases

Page 5: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

Object Track

Rich Metadata

- Woman

- Bicycle

- White

- Black

- 15 km/h

Full Scene Coverage

Page 6: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable
Page 7: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

7

Events from different times presented simultaneously

Click back to view events in original video

Original video: 30 minutesOriginal video: 30 minutes Video Synopsis: 53 secondsVideo Synopsis: 53 seconds

Page 8: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

Search Alerts Insights

LE

ENT

SMB

Home

Page 9: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable
Page 10: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

Environment NVIDIA GPU

Cloud Tesla K80 (AWS P2)

Server Tesla P4

Workstation/Laptop GTX 1080 Ti

Edge Device Jetson TX

Page 11: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

New Capabilities Benefits

Faster/Cheaper, cost effective processing

Proactive use

Data aggregation => insights

Multi camera search

Rich metadataClassifications (inc’ car type, model, etc)

Attributes => clothing, expressions, gestures

Improved scene coverage

Crowd

Queue

Night scene

Page 12: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

GPU Cons Tips & Tricks

GPUs on servers expensive• CPU fallback for specific deployments

• Reach high and consistent GPU utilization

Difficult to reach high utilization

• CPU – GPU transfer (latency and

throughput)

• Many operations on small images

• Powerful DNNs to offload traditional algorithms

• Batch processing

• Parallel computations (pipelines & buffers)

Limited memory

• Unfortunately, often a tradeoff with parallel

computations

• Use spatial and temporal resolutions (pyramid)

GPU virtualization is difficult • Consider using on-demand cloud instances

Page 13: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable

Any questions?

For more information:

www.briefcam.com

BriefCam – The Video Synopsis Company

PROPRIETARY & CONFIDENTIAL

Amit Gavish

Page 14: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable
Page 15: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable
Page 16: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable