GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex...
Transcript of GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex...
Saurabh Jain
GIVING 5G NETWORKS THE EDGE IN SMART CITIES
2
AI AT THE EDGE IS A BIG OPPORTUNITY
5GIOT AI
3
5G CLOUD-NATIVE MOBILE EDGE RUNS MANY WORKLOADS
VNF
5G vRAN
CLOUD NATIVE
AI
AR/VR
Gaming
OFF THE SHELF SERVERS
WITH GPUS (COTS)
4
MANAGEMENTCLOUD NATIVE SECURITY
Continuous improvement and deployment
from cloud/data center to edge
Software and model deployment,
management and orchestration at scale
Enforce trust for every element
of the stack
CLOUD
DATA CENTER EDGE
CLOUD
EDGE
DATA CENTER
CLOUD DATA CENTER EDGE
THE CHALLENGE WITH AI AT THE EDGE
5
NVIDIA EGX PLATFORM
APPLICATION FRAMEWORKS AND SDKs
NVIDIA EGX STACK
NGC SOFTWARE ECOSYSTEM PARTNER
Kubernetes Containers CUDA-X IoT Runtime
NVIDIA EGX SERVER
GPU | AI | STORAGE NETWORKING | SECURITY
6
IOT SENSORS AND PIXELS TO INSIGHTS FOR EFFICIENCY
Access Control Public Transit Industrial Inspection Traffic Engineering
Retail Analytics Logistics Critical Infrastructure Public Safety
7
8
METROPOLIS FOR SMART CITIES
NVIDIA EDGE STACK
Kubernetes Containers CUDA-X IoT Runtime
METROPOLIS EGX APPLICATION FRAMEWORK
Sensor/Camera
Management
& Aggregation
Deepstream
RT AnalyticsSmart Indexing
& StorageRules
Engine
Visualization
Toolkit
NVIDIA EGX SERVER
GPU | AI | STORAGE NETWORKING | SECURITY
SOFTWARE APPLICATIONS
9
CERTIFIED APPLICATIONS
Software Vendors EGX Servers NVIDIA Profiling Tools Application Certification
System Sizing Guide
NGC Ready Application Helm and Docker
Performance & Utilization Data
10
AVAILABLE ON NGC
11
APPLICATION EXAMPLES FOR EDGE DEPLOYMENT
Self check-out in retailBusiness intelligence
Operations and logistics
12
NVIDIA METROPOLIS ISV PARTNERS
13
START DEPLOYING WITH NVIDIA EGX AND METROPOLIS
EXPLORE METROPOLIS | EXPLORE EGX | METROPOLIS SOFTWARE PARTNERS
14
15
SENSORS TO INSIGHT WITH EDGE AI
16
LEGACY APPROACH TO WIRELESSDedicated hardware for every function
DEDICATED FIXED-FUNCTION SYSTEMS
4G RAN
17
18
NVIDIA EGX BENEFITS
Largest domain of AI models
High throughput & low latency
One architecture scalable from device to cloud
NVIDIA is the Industry’s Most
Advanced AI Computing Platform
Hardware & software optimized for AI, storage, networking & security
Easy development & deployment of AI at edge
Optimized AI frameworks in NGC
NVIDIA EGX is AI-Optimized
for Industry Use Cases
Support for every platform — VMW, RH, NTNX, Azure, AWS, GCP
Rich 3rd party ISV ecosystem
Rich OEM & integrator ecosystem
NVIDIA is an
Open Platform
Every cloud
Hybrid cloud
Every system maker
Edge-to-data center-to-cloud
NVIDIA has a Pervasive
AI Platform
End-to-end, from development to deployment, from tools to experts
NVIDIA Research
DLI to reskill talent
SA & DevTech to co-engineer
NVIDIA has
Deep AI Expertise
Expertise in large verticals — M&E, healthcare, retail, manufacturing, transportation, & more
BD, SA, DevRel, DevTech, Research in every region
NVIDIA has Global Reach
and Support
19
Restarts containers that fail, replaces
and reschedules when nodes die
Scale your application up and down
with a simple command, with a UI, or
automatically based on usage.
Kubernetes builds upon 15 years of
experience of running production
workloads at Google, combined with
best-of-breed ideas and practices
from the community
AUTO SCALINGSELF-HEALING INDUSTRY STANDARD
Kubernetes for Cloud Native
20
Simplifies Deployments
• Easily deploy complex applications in one step
• Simple rollbacks
- Shareable through a local or cloud registry
Templated for Scalability
- Deploy many copies of an application without conflicts
- Deploy to multiple locations with a single command
Consistent CI/CD Integration
• Helm charts easily set up consistent environments for CI/CD pipelines
NGC HELM: ACCELERATING DEPLOYMENTS
Helm Registry
- Publish or share helm charts privately for inclusion in CI/CD
Curated ISV Software
• Readily deploy secured, GPU-optimized AI software
21
THE MOST POWERFUL TECHNOLOGY FORCE OF OUR TIME
AI COMPUTING
AI CLOUD
AI EDGE
AI ROBOTICS
22
AI COMPUTING
AI CLOUD
AI EDGE
AI ROBOTICS
23NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE.
METROPOLIS VIRTUAL PLATFORM
GPU SERVER
METROPOLIS APPLICATION FRAMEWORKAPPLIC
ATIO
NS
WIDE RANGE OF INDUSTRIES & USE-CASES
NVDOCKER KUBERNETES DEEPSTREAM CUDAVIDEO STREAM
MANAGEMENTMETADATA HUB
Frictionless
access controlSecuring
infrastructure Smart parkingLoss
prevention &
checkout
Crowd
analytics &
management
Operations and
logistics
Intelligent
traffic systems
24
Metropolis egx open Ai city platform
NVIDIA EDGE STACK
Kubernetes Containers CUDA-X IoT Runtime
METROPOLIS EGX APPLICATION FRAMEWORK
GPU | AI | STORAGE | NETWORKING | SECURITY
NVIDIA EGX EDGE COMPUTING PLATFORM
Sensor/Camera
Management
& Aggregation
Deepstream
RT AnalyticsSmart Indexing
& StorageRules
Engine
Visualization
Toolkit
25
CLOUD-NATIVE INSTALLATIONS
BIGDATA
NVIDIA DGX/HGX
NVIDIA EGX
METROPOLIS
NGC
RAPIDS
NVIDIA DGX/HGX MELLANOX
CUML
CUGRAPH
CUDNN
GPU DIRECT
CUIO
CUDF
NVIDIA AI
DEPLOY
MANAGE
IOT
26
Metropolis egx open Ai city platform
NVIDIA EDGE STACK
Kubernetes Containers CUDA-X IoT Runtime
METROPOLIS EGX APPLICATION FRAMEWORK
Sensor/Camera
Management
& Aggregation
Deepstream
RT AnalyticsSmart Indexing
& StorageRules
Engine
Visualization
Toolkit
NVIDIA EGX SERVER
GPU | AI | STORAGE NETWORKING | SECURITY
27
$2T 1B+ 250M 30MMarket Sensors &
CamerasHours Spent Reviewing
Video Every YearEdge Appliances Sold Every Year
SMART city OPPORTUNITY