Real-Time Geospatial Intelligence at Scale
-
Upload
memsql -
Category
Data & Analytics
-
view
237 -
download
2
Transcript of Real-Time Geospatial Intelligence at Scale
FileNewTemplate
Real-Time Geospatial Intelligence at Scale
1
Mike KilrainPresident, MemSQL USG
2
We live in an on-demand economy
3
Consumers are now conditionedto instant services4
Data scientists need to carry the world forward5
Too often stuck with batch processing and slow ETL6
Slow LoadingSlow QueriesNo ConcurrencyOn-going Data Processing Barriers
7
There isa shift underwaythe move to real time
8
INTRODUCING MEMSQL 5
The Real-Time Database Platform for Transactions and Analyticsmemsql.com/download
10MemSQL is Designed for Modern WorkloadsScalable SQLIn-Memory and Solid-StateDistributedDatacenter or CloudMulti-modeOLTP, OLAP, HTAPMulti-modelANSI SQLKey-valueDocument/JSONGeospatialIn-Memory rowstoreSolid-state columnstoreStream directly to rowstore or columnstoreDistributed query optimizer and executionScale-out on commodity hardware
Deploy on-premisesCloud agnosticAmazonMicrosoftGoogleDigital OceanSimpleReal-TimeAffordableFlexible
SSD
10
11
Real-time dashboards are just thefirst step
12
Streamliner
real-time pipelines andpredictive analytics
13
Spark MLlib Predictive ModelRaw Sensor 1 + Predictive Score 1Real-Time Scoring for Predictive Applications
IDS1S2P1P21
Real-Time Inputs
Apache Spark
STREAMLINER
Business Logic14
HadoopApache Spark
STREAMLINERExtending Hadoop to Real-Time Processing15
Putting Streamliner to work for IoT applications
16
Internet-of-Things simulation depicting health of wind turbines globally.
7 machines - AWS C4-2X large instances, at $0.311 per hour per machine, annual cost ~ $19,000.
MemSQL PowerStream17
Sensors
Wind TurbineWind FarmMemSQL PowerStream197,000 wind turbines around the world18
1 to 2 million data points per secondwith MemSQL Streamliner19
Apache Spark
STREAMLINERData Producers(simulating sensor activity)PowerStream User InterfaceMemSQL PowerStream Architecture
20
21
22
Real-time Business Intelligence dashboard
Simulated pickup/drop-off data streamed into MemSQL as rides completeTaxiStats
23
Real-time data on pickups by ZIP codeTotal ride volumeRides by time of dayZoomData Dashboard
24
Get the blueprint25
THANK YOU