NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel...

31
1 Ankit Patel - [email protected] Prerna Dogra - [email protected] NVIDIA DESIGNWORKS

Transcript of NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel...

Page 1: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

1

Ankit Patel - [email protected] Prerna Dogra - [email protected]

NVIDIA DESIGNWORKS

Page 2: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

2

Autonomous Driving Deep Learning Visual Effects Virtual Desktops Gaming Product Design

Visual Computing is our singular mission

Page 3: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

3

https://developer.nvidia.com/designworks

RENDERING

Multi-Display Capture SDK Warp and Blend

GPUDirect for Video Video Codec SDK

Iray SDK OptiX SDK MDL SDK vMaterialsNV Pro Pipeline

GVDB Voxels VXGI GRID SW MGMT SDK NVAPI/NVWMI

PhysX

PHYSICS

VOXELS VIDEO MANAGEMENT

DISPLAY

Page 4: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

4 NVIDIA GPU

GRAPHICS DRIVER

Iray

OptiXPhysXNvPro

Pipeline

VXGI

GVDB

Video Codec

GPU Direct for Video MDL

Mosaic

Warp and Blend

CaptureGRID

Management

NVAPI

vMaterials

Application Partners

End-Users (Designers, Artists, Scientists)

Tools and technologies for Professional Visualization Application Developers

CUDA DRIVER

NVWMI

Page 5: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

5

RENDERING

Page 6: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

6

IRAY SDK

developer.nvidia.com/iray-sdk

• Use Case: physically based rendering for product design

• Unprecedented visual quality and fidelity; enabling fluid and interactive product design flow

Rendering by simulating the physical behavior of lights and materials

Iray 2017

Page 7: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

7

MDL SDKMaterial Definition Language for seamless and quick integration of physically based materials into renderers

developer.nvidia.com/mdl-sdk

MDL support in Iray for Maya

Physically based Materials

MDL SDK 2017

• Use Case: physically based rendering for product design

• Enables designers and artists to understand how materials impact product design

Page 8: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

8

vMaterialsLibrary with hundreds of ready to use real world materials

Collection of MDL materials

vMaterials for Product Design

• Use Case: physically based rendering for product design

• Library of verified materials for customers to use with MDL enabled renderers

developer.nvidia.com/vmaterials

Page 9: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

9

OPTIX RAY-TRACING ENGINE

• Use Case: Ray tracing for design, defense, and audio synthesis applications

• OptiX does the “heavy lifting” of ray tracing: traversal, intersection, acceleration, allowing you to concentrate on rendering technique

developer.nvidia.com/optix

Rendered with Iray powered by OptiX

CUDA accelerated framework for high performance programmable ray-tracing

OptiX in Pixar’s Lighting tool

OptiX 4.1

Page 10: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

10

NVIDIA Pro Pipeline

Matryoshka IRay Realtime Scene RenderingCrash Simulation Scene - ESI group

Example high performance rendering pipeline

• Use Case: OpenGL or Vulkan viewport rendering

• Modularized architecture for reuse in custom rendering pipelines

• Open-Source project lead by NVIDIA

developer.nvidia.com/nvidia-pro-pipeline

Page 11: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

11

VOXELS

Page 12: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

12

VXGIAn implementation of a global illumination algorithm known as Voxel Cone Tracing

Scene View and Voxel Opacity Model ViewScene with Global Illumination - realism of rendered images

• Use Case: Professional Rendering applications with heavy geometry

• Adding Global illumination to your scene improves the realism of rendered images

• Reduces Content creation time

Page 13: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

13

GVDB VOXELS SDKFramework for simulation, compute and rendering of sparse voxels on the GPU

Motion Pictures Scientific Simulation

3D PrintingProcess Engineering

NEW

• Use Case: Process Engineering, 3D Printing, Motion Pictures and Scientific simulations

• Inspired by Academy Award-winning OpenVDB library, GPU accelerated Voxel computing.

• The finished part has a specific shape, while the internal voronoi can vary in cell density

Page 14: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

14 3.2 lbs

5.3 lbs

Page 15: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

15

Page 16: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

16

PHYSICS

Page 17: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

17

PHYSX SDK

developer.nvidia.com/physx-sdk

Model demonstrating PhysX Clothing

Engine to generate realistic Physical effects with HW accelerated physics simulation

• Use Case: Real-time product design investigation

• Scalable, multi-platform solution supporting wide range of devices

• Enabled Haptic Feedback for OPTIS’S Virtual build process simulator, Dental training simulation systems – understand difference between collision with a tooh or the gum.

Page 18: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

18

VIDEO

Page 19: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

19

VIDEO CODEC SDK

GAME STREAMING (GEFORCE Now) – ULTRA LOW LATENCYInteractive, single frame latency, 4K, HDR

GPU VIRTUALIZATION – QUALITY & RELIABILITYCapture + encode, low-latency, multiple display, lossless

VIDEO TRANSCODING – PERFORMANCE/WATTCodecs, resolution, quality, bitrate, Live, broadcast

VIRTUAL REALITY – ACCURACYVideo frame interpolation(ASW), Camera stitching, Computer Vision applications

API for GPU-accelerated Video Encode and Decode

developer.nvidia.com/video-codec-sdk

NVIDIA Video Codec SDK as used in VMware Horizon running on NVIDIA GRID

Video Codec SDK 8.0

Page 20: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

20

CPU

NVDEC NVENC

CUDA Cores

Buffer

Decode HW* Encode HW*

Formats:• H.264• H.265

Bit depth:• 8 bit• 10 bit

Color**• YUV 4:4:4• YUV 4:2:0• Lossless

Resolution• Up to 8K***

Formats:• MPEG-2• VC1• VP8• VP9• H.264• H.265

Bit depth:• 8 bit• 10 bit• 12 bit

Color**• YUV 4:2:0• YUV 4:4:4• Lossless

Resolution• Up to 8K***

* See support diagram for previous NVIDIA HW generations** 4:2:2 is not natively supported on HW*** Support is codec dependent

VIDEO CODEC SDK

Page 21: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

21

GPUDIRECT FOR VIDEO

• For IO board manufacturers who write device drivers

• Stream video in and out of GPU memory at sub-frame transfer times

• OpenGL, DirectX and CUDA on Windows or Linux

Transfer video in and out of GPU memory

developer.nvidia.com/gpudirectforvideo Comparison of systems with and without GPUDirect for Video

Page 22: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

22

DISPLAY

Page 23: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

23

MOSAIC

• Use Case: Create a stereoscopic 3D CAVE, build an expansive digital signage wall

• Connect up to 16 displays from a single workstation

Multi-display scaling and synchronization

developer.nvidia.com/capture-sdk

Bezel CorrectionSeamless Image

Projector Overlap Desktop Management

Page 24: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

24

CAPTURE SDK

• Use Cases: Streaming, Remoting and broadcasting applications

• Enables developers to easily and efficiently capture and optionally encode display content or application’s graphics context

• Capture up to 8K resolution

High quality low latency capture

VMware Horizon Blast uses NVIDIA Capture SDK to increase number of users per server through improved latency, reduced bandwidth and lower CPU utilization.

developer.nvidia.com/capture-sdk

Image Courtesy Accuweather.

Page 25: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

25

WARP AND BLENDFramework that allows display applications to combine multiple projectors to one single display.

developer.nvidia.com/warp-and-blend

Simulator environment with large curved front displaysImage courtesy of Joachim Tesch. Max Planck Institute for Biological

Cybernetics.

• Use Case: Immersive VR, multi-projection display walls, simulator environment for interactive presentations, projection mapping onto scale physical models

• Adjust geometry and intensity for multi-projector systems

• Minimal performance delay to display pipeline compared to external boxes using FPGAs

Page 26: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

26

MANAGEMENT

Page 27: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

27

NVIDIA WMI SDKRemotely control NVIDIA Quadro, GRID and NVS GPUs.

developer.nvidia.com/nvwmi-sdk

Remote administration and configuration of NVIDIA professional GPUs in Windows machines (virtual or physical) on corporate networks

• For Windows IT admins to remotely perform administrative tasks.

○ Configure GPU settings

○ Retrieving GPU information

○ Perform automated tasks

Page 28: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

28

GRID SW MANAGEMENT SDKBuild monitoring and management solutions optimized for NVIDIA GRID

developer.nvidia.com/grid-software-management-sdk

Available on compatible NVIDIA GRID-certified servers with Tesla M6, M10, or M60

Platforms:

• Real-time vGPU utilization data

• Manage the lifecycle of a VDI deployment

• Monitor the performance of GPU-accelerated VDI environments

Page 29: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

29

ADDITIONAL SDKs

developer.nvidia.com/vrworks developer.nvidia.com/gameworks

Cutting-edge technology for game developmentAmazing virtual reality experiences

Page 30: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

30

DESIGNWORKS - GTC 2017S7454 - NVIDIA ADVANCED RENDERINGS7236 - RAYTRACING INTERIORS FOR STILLS AND VR WITHIN MINUTES WITH IRAY INTERACTIVES7357 - WARPING & BLENDING FOR MULTI-DISPLAY SYSTEM USING NVIDIA DESIGNWORKSS7352 - SEE THE BIG PICTURE: HOW TO BUILD LARGE DISPLAY WALLS USING NVIDIA DESIGNWORKS APIS/TOOLSS7455 - INTRODUCTION TO THE NVIDIA OPTIX RAY TRACING ENGINES7583 - HOMEBYME: HOW IRAY, VCA, DEEP LEARNING AND VR HELPS YOU EXPERIENCE YOUR NEW APARTMENT BEFORE IT IS BUILTS7453 - NVIDIA ADVANCED RENDERING PRODUCTS FOR END USERSS7194 - LIGHT BAKING WITH IRAYS7440 - CREATE HIGH-QUALITY MATERIALS FROM SCANS WITH MDL AND SUBSTANCES7810 - ACCELERATION OF MULTI-OBJECT DETECTION AND CLASSIFICATION TRAINING PROCESS WITH NVIDIA IRAY SDK (PRESENTED BY SAP)S7328 - THE NVIDIA IRAY LIGHT TRANSPORT SIMULATION AND RENDERING SYSTEML7109 - NVIDIA GRID DEPLOYMENTS7756 - INDUSTRIAL-GRADE HAPTICS WITH HAPTX AND PHYSXS7424 - INTRODUCTION AND TECHNIQUES WITH NVIDIA GVDB VOXELSS7425 - 3D PRINTING WITH NVIDIA GVDB VOXELSS7111 - NVIDIA VIDEO TECHNOLOGIES AND SDK: OVERVIEW AND LATEST UPDATES

Page 31: NVIDIA DESIGNWORKSon-demand.gputechconf.com › gtc › ... › S7773-ankit-patel... · Ankit Patel - ankitp@nvidia.com Prerna Dogra - pdogra@nvidia.com ... End-Users (Designers,

31

QUESTIONS?