Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
-
Upload
severalnines -
Category
Internet
-
view
151 -
download
1
Transcript of Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Copyright 2017 Severalnines AB
An Overview of Ops Manager & ClusterControl
24th October 2017
Ruairí Newman, Senior Support Engineer, SeveralninesTyler Duzan, Product Manager, Percona
Presenters
[email protected] [email protected]
How to Manage MongoDB & Percona Server for MongoDB
Copyright 2017 Severalnines AB
I'm Jean-Jérôme from the Severalnines Team and I'm your host for today's webinar!
Feel free to ask any questions in the Questions section of this application or via the Chat box.
You can also contact me directly via the chat box or via email: [email protected] during or after the webinar.
Your host & some logistics
Copyright 2017 Severalnines AB
Copyright 2017 Severalnines AB
About Severalnines and ClusterControl
Copyright 2017 Severalnines AB
What We Do
Manage Scale
Monitor Deploy
Copyright 2017 Severalnines AB
ClusterControl Automation & Management
Management● Multi-Cluster / Multi-DC
● Automate Repair &
Recovery
● Database Upgrades
● Backups
● Configuration Management
● Database Cloning
● One-Click Scaling
Deployment● Deploy a Cluster in Minutes
● On-Premises or in the Cloud (AWS)
Monitoring● Systems View with 1sec Resolution
● DB / OS stats & Performance Advisors
● Configurable Dashboards
● Query Analyzer
● Real-time / historical
Copyright 2017 Severalnines AB
Supported Databases
Copyright 2012 Severalnines ABCopyright 2012 Severalnines AB
Our Customers
Copyright 2017 Severalnines AB
An Overview of Ops Manager & ClusterControl
24th October 2017
Ruairí Newman, Senior Support Engineer, SeveralninesPresenter
MongoDB: How to Automate and Manage Operations
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
High-Level Feature Comparison
ClusterControl Ops Manager
Deploy Replica Set, Sharded Cluster Yes Yes
Metrics Monitored Host metrics, MongoDB Metrics Host metrics, MongoDB Metrics
Custom Dashboards Yes, plus “Advisors” Yes
Cloud/IaaS Provider Integration AWS S3 (for Backups)* AWS S3 (for Backups)
Consistent Backups (Sharded) Yes Yes
User & Group Mgmt, LDAP Yes Yes
Secure Installation Default Supported
Auto Recovery Explicit No
Scriptable Command Line Yes No
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
Installation:● Ops Manager
○ Downloadable from mongodb.com○ Enterprise MongoDB Subscription○ MongoDB Licences for for servers required to support Ops Manager○ Production vs Test deployment
● ClusterControl○ Downloadable from severalnines.com--install-cc script○ Installs required open source dependencies○ Community edition, Advanced, and Enterprise
Installation Requirements:● Ops Manager
○ Production○ “Test”
● ClusterControl
The Basics - Getting Started
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
Standard Installation of MongoDB Ops Manager
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
Highly Available Ops Manager Architecture
In this scenario, a highly available Ops Manager requires 8 physical servers, not including the HTTP load balancer.
Apart from the HTTP Services, the solution requires 3 MongoDB replica sets of 3 data nodes each;
One each for the Application Database, and the Backup Blockstore Databases #1 & #2.
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
ClusterControl uses a single MySQL / MariaDB database server, to which its core services connect to store and retrieve data.
Redundancy can be achieved through deploying a database snapshot on a second node, and installing the ClusterControl applications.
With a HTTP proxy in front, requests can be directed to the live node. ClusterControl services such as auto-recovery should be stopped on the second node to avoid complications.
ClusterControl Architecture
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
Installation
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
❏ EC2 instances
❏ 4 x “t2.small” CentOS 7.3 EC2 instances: 1 for ClusterControl, 3 for a
MongoDB Replica Set deployment
❏ Obtain and install ClusterControl installation script from severalnines.com
❏ Deploy a 3-node MongoDB Replica Set
❏ Review key functionality
Installation of ClusterControl
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
Installation of Ops Manager “Test”
❏ EC2 instances
❏ 1 x “t2.large” CentOS 7.3 EC2 instance for Ops Manager “test” install
❏ 3 x “t2.small” CentOS 7.3 EC2 instances for 3-Node MongoDB Replica Set
❏ Obtain and install MongoDB installation RPM
❏ Deploy a 3-node MongoDB Replica Set
❏ Review key functionality
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
Integrations
❏ ClusterControl integrations
❏ PagerDuty, VictorOps, Ops Genie, Telegram, Slack
❏ Webhooks
❏ Ops Manager Integrations
❏ New Relic, PagerDuty, Flowdock, Hipchat Slack
❏ Webhooks
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
s9s – The Command Line Interface
❏ Fully Scriptable Command Line interface
❏ Basic Monitoring: status of Nodes and Clusters
❏ Create, Stop, Start Clusters
❏ Add, Remove, Restart Nodes
❏ Create & Manage database users, load balancers, backups
❏ RPC API
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
Percona Server for MongoDB
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
● First GA release in December 2015● Maintains drop-in compatibility with upstream● Focused on performance and stability improvements layered on
top of MongoDB Community Edition● Provides a place to develop new storage engines and capabilities● Implements many MongoDB Enterprise features in an open-source
release● Expedited bug fixes for Percona Support customers and these fixes
are shared with the community
What is Percona Server for MongoDB
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
What is Percona Server for MongoDB
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
● Enhanced Security Capabilities○ Auditing○ Log Redaction○ LDAP Authentication
● New Storage Engines○ Percona Memory Engine (compatible with Memory Engine in MongoDB EE)○ MongoRocks is integrated
● Native Hot Backup Capability○ Supports both MongoRocks and Wired Tiger storage engines
● Integration with Percona Toolkit and Percona Monitoring and Management (PMM) for query performance analytics and troubleshooting
● Enhanced Query Profiling
Percona Server vs MongoDB Community Edition
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
● Added to Percona Server for MongoDB in partnership with Facebook● Based on the open-source RocksDB library derived from LevelDB● Uses LSM-trees instead of B-trees for indexes, optimizes for write-heavy
workloads● Has native support for Snappy, LZ4, and Zlib compression● LSM-Trees are append-only, so are fast regardless of disk size or available
space.● Writes go to Memtables first before being flushed to disk, reads are
serviced from memory if possible● Compared to Wired Tiger, MongoRocks uses less disk space, maintains
higher insert rates, and has better response times.
MongoRocks: RocksDB for MongoDB
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
● QAN for MongoDB was announced at Percona Live Europe in Dublin, September 2017
● Query Profiling in the upstream implementation can incur significant performance overhead
● Percona Server for MongoDB implements an optimized query profiler that supports setting rate limits
● For example to profile all operations only for queries which are slower than 200ms and every 100th fast query, you would do the following:
○ mongod --profile 2 --slowms 200 --rateLimit 100
● Integrates with Percona Toolkit using pt-mongodb-query-digest tool
Query Profiling and PMM
Copyright 2017 Severalnines ABCopyright 2017 Severalnines AB
● Severalnines ClusterControl meets and exceeds the capabilities of MongoDB Ops Manager
● Percona Server for MongoDB provides MongoDB Enterprise Edition features at no licensing cost, with additional storage engines and performance improvements
● With Percona Server for MongoDB and Severalnines ClusterControl together, you have the capabilities of MongoDB Enterprise Edition with Ops Manager at a reduced TCO while gaining additional features and capabilities
Percona Server for MongoDB + Severalnines ClusterControl
Copyright 2017 Severalnines AB
Copyright 2017 Severalnines AB
Q&A
Copyright 2017 Severalnines AB
● Download: ClusterControl ● White Paper: Bringing MongoDB to Production● Download: Percona Server for MongoDB
● The replay & slides of today’s webinar will be online within the next 48 hours
Some Resources
Copyright 2017 Severalnines AB
Thank You!