Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and...
Transcript of Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and...
![Page 1: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/1.jpg)
1
NVIDIA and
Big Data
Steve Scott
CTO Tesla, NVIDIA
SOS17
March 27, 2013
![Page 2: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/2.jpg)
2
&&
![Page 3: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/3.jpg)
3
GPUs and Big Data Today
Accelerating the Cloud + Mobile transformation
Computational acceleration for Big Data
Visualization
![Page 4: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/4.jpg)
4
World Moving Increasingly to Mobile + Cloud
NVIDIA GRID™ NVIDIA Tegra™
![Page 5: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/5.jpg)
5
GPU Accelerators For Big Data Analytics
Analyzing Twitter
Shazam
Audio Search Visual Search Real-time
Video Delivery
![Page 6: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/6.jpg)
6
2007 2008 2009 2010 2011 2012
500
400
300
200
100
0
Millions
SalesForce.com: Analyzing Twitter Real-Time
500 Million Tweets per Day • SFDC one of 6 companies to
get full Twitter firehose
• Realtime monitoring using
keyword boolen expressions
• Customers may track many
thousands of conversations
in multiple languages
![Page 7: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/7.jpg)
7
• Acoustic fingerprint
generated on phone, 2KB
file sent to Shazam
• Matching done on
hundreds of GPUs
Shazam: Massive Audio Searches
2011
100M Users
# of recordings 10M
300M Users >10M tags/day
# of recordings 27M
2012 User Inquiries averaged per Month
![Page 8: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/8.jpg)
8
Cortexica: Enabling Visual Shopping
Tesla®
Real-time
Visual Search Take a Photo
1000 key points per photo
Database: 1M+ Apparel
Results in seconds
Now think video…
![Page 9: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/9.jpg)
9
38M mobile
consumers monthly 12M+ live video streams
during Hurricane Sandy
Elemental: Managing Live Video Streams
Rescale to every screen size
& resolution in real-time
Also used for other live events (e.g.: Olympics)
![Page 10: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/10.jpg)
10
NVIDIA indeX - Scalable Big Data Visualization
infinite
dimensional
eXplorer
![Page 11: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/11.jpg)
11
NVIDIA indeX
• Graphics infrastructure which can be
integrated with ISV applications or other viz
tools to deliver a scalable and interactive
visualization solution
• C++ library
• Extensible via user-defined functions
• Volumetric ray tracing, iso-surfaces
• Large display device rendering (Quad HD)
• Visualizes combinations of volumetric and
surface data accurately and at high visual
quality
![Page 12: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/12.jpg)
12
NVIDIA indeX
• Enables comprehensive visual insight
into complex data models by providing
feature extraction, data analysis, and
attribute generation
• Interactive 3D navigation on O(TB)
datasets
• Cloud-based GPU rendering for data
sharing to support collaborative analysis
• H.264 streaming output
• Multiple independent cameras for
remote teams on shared data
![Page 13: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/13.jpg)
13
GPUs Today
Computational acceleration for Big Data
Visualization
Accelerating the Cloud + Mobile transformation
GPUs Tomorrow
Converged architecture for Big Data and Compute
![Page 14: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/14.jpg)
14
Echelon Compute Node & System
GPUs Today:
• Lots of on-node bandwidth and
latency tolerance
• Excellent at single-node Big Graph
problems today (“Medium Graph”?)
• E.g.: Breadth First Search (BFS)
and Maximal Independent Set (MIS)
• Excellent parallel speedup using
asymptotically efficient algorithms
Long Term Vision: Converged Compute/Data Architecture
GPUs Tomorrow:
• Extend single node characteristics to
whole machine
• Global address space
• Aggressive and configurable
memory hierarchy & interconnect
• Sophisticated/lightweight
synchronization
System Interconnect
NoC
C0 C7
SM0
LO
C 0
LO
C 7
L20
256KB
L21023
256KB MC NIC
DRAM
Stacks
DRAM
DIMMs
NV
RAM
Node 0: 16 TF, 2 TB/s, 512+ GB
Cabinet 0: 4 PF, 128 TB Cabinet N-1
System (up to 1 EF)
SM255
![Page 15: Steve Scott CTO Tesla, NVIDIA SOS17 March 27, 2013 · • E.g.: Breadth First Search (BFS) and Maximal Independent Set (MIS) • Excellent parallel speedup using asymptotically efficient](https://reader034.fdocuments.us/reader034/viewer/2022042413/5f2dc9db7c274957f425620c/html5/thumbnails/15.jpg)
15
Thank You