Basho pres
-
Upload
frank-wu -
Category
Technology
-
view
387 -
download
5
Transcript of Basho pres
All built their own Databases because no commercial database
could meet their requirements
In the beginning…
• Reliable Cloud and Customer-Facing Services
• Horizontal not Vertical scale
• Never Lose Data and Never Return an Error
• Rapid App and Feature Development
• Geo Data Locality
• Operational Simplicity
Today Enterprises Want The Same
These Leaders are DisruptingTheir Markets
Customer Centric IT
On-DemandForecasting
Smart Water
Meters
Public-as-a-Service
IT Platform-as-a-Service
Real-Time Advertising
Mobile Payments
Multi-CloudManagement
WorkforceCollaboration
Flash Retail
We are Entering an Era ofFlexible Architectures
49%Concerned about
High Velocity
Type of Data
66%Feel BI gives them an
advantage
Use of Data
156%More likely to invest
in Distributed NoSQL
Data Technology
Base: 603 business intelligence, data management, and governance decision-makers, comparing those with 15% more annual growth (N = 55); Source: Forrsights Strategy Spotlight: Business Intelligence and Big Data, Q4 2012
Top Performers Strategic Technology Investments
We are Rethinking Downtime:Resiliency, not RecoveryBulletproofing the Customer Experience
RecoveryImplies downtime and that systems must first suffer an outage before they can resume normal operations
ResiliencyRefers to the ability of a business to spring back from a disruption to its operations with an outage
Reactive Proactive
90% of the World’s data created in the last two
years
By 2017, only 1% of all data generated will require a relational data model
We are Addressing MassiveData Explosion
Basho: Inspired by Amazon
Amazon Dynamo PaperOctober 2007
Enabled tens of millions of simultaneous users on the World’s most popular
e-commerce site
SQL
The Answer
Or Something Like That
NoSQL is a bad name –SQL was never the problem
Rather, NoSQL is..
..a response to changing business priorities and new challenges
..a reboot of database architectures that were developed before the Internet existed
SQL
Developer-Oriented
Scale-Out Distributed
NoSQL Flavors
Intro to
Incremental scalability Predictable low latency
Flexible storageGlobal data locality
Built-In Replication
Operational Simplicity
Masterless
• Deployed as a Cluster of Nodes
KEY VALUE
KEY VALUE
KEY VALUEb
uck
et
• Key/value pairs stored in buckets• Any data type, objects are stored as
binaries
Object/key Operations
node
node node
node
node
Basic Concepts
• Consistent Hashing and Replicas
• Virtual Nodes
• Vector Clocks
• Gossiping
• Read Repair / Active Anti-Entropy
• Hinted Handoff
• Erlang/OTP
Under the Hood
Multi-Datacenter Replication
Business Goals
• Disaster Avoidance
• Data Locality
• Regulatory Compliance
• Analytics and Reporting
• Other Secondary Workloads
• Cloud Bursting
Cloud Mobile Social
Data Center
#2
Data Center #3
Data Center
#1
Multi-Data Center Replication
Applications, Users and Machines Generate Data
Riak Stores and Manages Data Efficiently and Effectively
• Key/Value Store
• Full-Text Search and Support for Secondary Indexes
•Distributed MapReduce
• Advanced Multi-Datacenter Replication
• Easy-to-interface via HTTP or Protocol Buffers
• Large library of drivers and class libraries
• Bitcask, LevelDB and in-memory storage engines
• RiakControl, Riaknostic and Basho Bench Tools
Riak Key FeaturesRiak Clients
(Ruby, Java, Node.js, PHP, .NET, etc)
Webmachine(HTTP)
Protocol Buffers(Binary, Persistent Connect)
MDC Replication* Riak Enterprise Only
Riak SNMP / JMX* Riak Enterprise Only
Riak Key-Value Store
Riak Search
(Distributed, Full-Text)
Riak Pipe Distributed MapReduce
Riak Core(Ring Management, Partitioning, Anti-Entropy,
Replication, Version Control)
Pluggable Storage Backends
Bitcask LevelDB
Ria
k C
ontr
ol
+Extras Secondary Indexes, Full-Text Search, MR…
+Multi-Tenant Object StorageSimple, Available Cloud Storage Software
Enterprise
Open SourceDistributed Database
CommercialDistributed Database
Open-Source Cloud Storage Platform
• Always-available, scalable, ops-friendly NoSQL database
• Over 35,000 downloads per month
• Thousands of users worldwide
• Version 1.0 unveiled September 2011
• Adds multi-data center replication & Basho 24x7 support
• Over 30% of the Fortune 50
• Enables Secondary Search and MapReduce Clusters
• Version 1.4 in May 2013
• Expands with multi-tenancy, large object support, metering and Amazon S3 API
• Enables public and private cloud storage
• Software released to open source on March 20th
• RiakCS Enterprise commercial version
Product Availability
Instant Scale
Low Latency
Breaking News >>Traffic on CNN.com Doubles Every Two Minutes
Angry Birds Toons• Orchestrating and registering
push notifications• RedBird Riak Cluster
The Croods• Rovio Account – Storing Fan
profiles and related information• Game State Storage – Storing
game states• Payment Transactions• YellowBird and FatBird Riak
Clusters
Global Session Store
Account Profiles
“Viral” Success
3TB+ New/day
3rd Party API Integration
Recommendations Engine
Product Configurator
Common Medical Card
“In short: using Riak to insure high data availability helps avoid health risks and
in the worst case, patient death.”
Prescribe-to-Payment
Drug Allergies
“In short: using Riak to insure high data availability helps avoid health risks and
in the worst case, patient death.”
“In short: using Riak to insure high data availability helps avoid health risks and
in the worst case, patient death.”
Integrated Customer Platform
Catastrophe Ready Scale
Customer HR Attachments
Private, Secure “Dropbox”
35,000 Users
AT&T Add-ons• Dev APIs• IRSCP• Model Driven
Management• Capacity
Mgmt driven by Application SLAs• Configuration
Monitoring
Public Cloud
S3 Public Cloud Storage
Amazon Economics
@basho