Couchbase Chennai meetup #3 What's new in Couchbase Server & Couchbase Mobile
-
Upload
karthik-babu-sekar -
Category
Technology
-
view
163 -
download
0
Transcript of Couchbase Chennai meetup #3 What's new in Couchbase Server & Couchbase Mobile
What is new in Couchbase Server 4.6 DP& Couchbase Mobile 1.3
Karthik Babu SekarSolutionsArchitect,WWFieldOperations@Couchbase
- LinkedIn - https://www.linkedin.com/in/karthikbabusekar- Twitter- https://twitter.com/SKBhere
- E-mail – [email protected]
Agenda
- History- Couchbase Defined- Journey.. So far- What’s new in Couchbase Server 4.0 ?- How about Couchbase Server 4.5 GA ?- What’s exciting in Couchbase Server 4.6 DP ?- What else is new ?- What about Couchbase Mobile 1.3 GA?
HistoryofCouchbase
CouchbaseDefined
First NoSQL Database to have a multi-model NoSQL Server & NoSQL Mobile Database Solution
Managed Cache Key-Value Store Document Database Embedded Database Sync Management
DevelopwithAgility
With Couchbase Server, you can Develop Applications with Agility. Here’s why:
Easier, Faster Development Flexible Data Modeling Powerful Querying
SQL Integration & Migration Big Data Integration Mobile / IoT
OperateatAnyScale
With Couchbase Server, you can deploy, manage, and scale apps without limits. Here’s why:
Elastic Scalability Consistent High Performance Always-on Availability
Multi-Data Center Deployment Simple, Powerful Administration Enterprise Grade Security
TheJourneythusFar
FocusedonTechnicalInnovation
CouchbaseServer1.8
HighScaleKey/ValueDatabase
CouchbaseMobile1.0OfflineDataAvailabilityAuto-synchronization
CouchbaseServer3.0
Mission-CriticalScale&PerformanceSimplifiedAdministrationImprovedHA/DR&Security
CouchbaseServer4.0SQL-likeQuerieswithNewSecondaryIndexing
Multi-DimensionalScalingArchitectureImprovedSecurity
CouchbaseServer2.0DocumentExtensions
NewXDCR
CouchbaseServer2.1EnhancedSecurity
HA/DR
CouchbaseServer2.2ImprovedXDCR
AdvancedStorageEngine
What’snewin4.0
▪ CouchbaseServer4.0– QueryandIndexing:• N1QLandNewGlobalSecondaryIndexing
– EnhancedClusterManagement• NewClusterZoneswithMulti-dimensionalScaling(MDS)
– EnhancedIntegrations• NewODBC/JDBCDriverswithconnectivitytoETLandBITools• NewNative,SparkStreaming,SparkSQLandKafkaIntegration
– EnhancedSecurity• AuditingandEnterpriseLDAPIntegration
– EnhancedHighAvailability• FasterXDCRandFilteringXDCR
CouchbaseServerArchitecture
Overview
Service-BasedArchitecture
Multi-Dimensional Scalability (MDS) – Optionally Scale each service independently:• Data• Index• Query
MDS is the architecture that enables independent
scaling of data, query, and indexing workloads while
being managed as one cluster.
©2015CouchbaseInc. 11
CouchbaseDataAccess
• Everything is built on top of Key Value
• A Document store is a special case of Key-Value
• Views provide aggregation and real-time analytics through incremental map-reduce
• Global Secondary Indexes provide low latency/high throughput indexes
• N1QL is a language that provides a powerful and expressive way of accessing documents
What’sNewin4.5GA
©2015CouchbaseInc. 13
Couchbase4.5- KeyFeatures
• Integratedqueryworkbenchwithauto-schemainference• ExtendedJOINsyntax• Integratedfull-textsearchqueries[preview]
EASIER,MOREEFFICIENTQUERYING
• EfficientRead/Writeofdatastructureswithsub-documentAPI• Fasterread-your-own-write(RYOW)consistencywithN1QLqueries
SIMPLER,MOREADVANCEDDATAACCESS
• FasterIndexingwithMemory-optimizedindexes• ArrayindexingforfasterN1QLqueriesonarraysinJSON• ImprovedindexwriteperformancewithForestDB’scircularwrites
FASTER,MOREPOWERFULINDEXING
• Role-based-accesscontrolforadministrators&X.509certificatesforencryptedcommunication• Queryprofilingandmonitoring• Fasterbackupandrestore
BETTER,MORECOMPREHENSIVEADMINISTRATION
©2015CouchbaseInc. 14
SimplifiedDevelopment
QueryWorkbenchwithAutoCompleteforN1QL
NewIntegratedN1QLQueryWorkbenchTool(QWT)
N1QLEditorwithAuto-Completion&QueryHistory
DataWindowwithVisualTable,TreeandJSONOutput
BucketAnalyzerwithSmartSchemaInference
AutomaticSchemaInferenceandAuto-Completion
▪ SmartSchemaInference:Automaticallyexaminessampleofdocumentsfrombucketsanddiscoversyourschema– DocumentTypeDistribution– ListofAttributes– DataTypesforAttributes
BucketAnalyzerinWebConsole CBQCommandlineShell
Auto-CompletewithQueryEditor
▪ Auto-CompletioninN1QLeditorprovides– MatchingN1QLKeywords– FieldNamesfromInferredSchema– Addbackquotesfornameswithhyphen
NewFlexibleJOINswithN1QL
7XfasterquerywithflexibleJOIN
Full-textSearchService[DeveloperPreview]
SearchtextdatainyourCouchbasedocuments▪ Powersearchboxesfordocumentcontents,websites,blogposts,Tweets,ticketingandcatalogapps
Full-textSearchService[DeveloperPreview]
▪ Benefits– Fullycapablesearchservice,integratedinCouchbase– ImmediatelyfamiliartousersofElasticsearch andSolr– Couchbaseadministrationandmanagement• Automaticallypartitioned,distributedandreplicated
– Noexternalsearchdependencies• Noneedtoprovisionhostsandinstallextrasoftware• Avoiddatatransfersetupandsyncmanagement
Full-textSearchService[DeveloperPreview]
▪ FullRangeofTextQueriesSupported– Basic• Match,MatchPhrase,Fuzzy,Prefix,Regexp,Wildcard,BooleanField
– Compound• QueryString,Boolean,Conjunction,Disjunction
– Range• DateRange,NumericRange
– SpecialPurpose• DocIDQuery,MatchAll,MatchNone,Phrase,Term
▪ Plusscoring(TF/IDF),boosting,fieldscoping,highlighting,andmore
©2015CouchbaseInc. 22
ImprovedPerformanceandScale
EfficientSub-DocumentOperations
DocumentMutations:• AtomicOperateonindividual
fields• Identicalsyntaxbehaviorto
regularbucketmethods(upsert,insert,get,replace)
• SupportforJSONfragments.• SupportforArrayswith
uniquenessguaranteesandordinalplacement(front/back)
FasterKeyBasedOperations!
10-14XFasterDocumentRead&UpdateOperation95%GetLatency 95%SetLatency
95%Get&SetLatencyMeasured(Msecs)onsingleINTfieldupdatewithsub-documentvsfull-documentcall
GlobalSecondaryIndexes
NewStorageOptionsforGlobalSecondaryIndex1. Memory-OptimizedGlobalSecondaryIndexes(MOI)
• OptimizedforMemory:smallmemoryfootprint,optimizedforlowestlatencyqueries• FasterIndexing:freshindexesunderheavymutationswithlockfreeindexmaintenance• PredictablelowlatencywithQueryandKeyBasedOperations,eveninpresenceoflarge
numberofindexes
1. StandardGlobalSecondaryIndexes• OptimizedforStorage+Memory:efficientspilltodiskwithForestDBasthestorage
engine• AdvancedIOPerformance: newcircularwritesthatminimizecompactionoverheadof
appendonlywrites
EfficientIOwithCircularWritesinStandardGSI
▪ ReducedDiskIORequirements– Append-OnlyWriteswithfrequentfullcompaction(Version4.1&Earlier)– Circular-ReuseWriteswithreducedfullcompactions(Newin4.5:)• Reusedorphanedblocksintheindexfile• Reducetheneedforfrequentfull-compactionsoftheindexfile
IndexMutation
Append-OnlyWriteCircularWrite
FileforGlobalSecondaryIndexes
IndexMutation
IndexMutation
ArrayIndexes-- FasterSearchforNestedData
▪ EfficientlyIndexArraysCREATE INDEX …
ON bucket(ARRAY i FOR i IN b END, a)
USING GSI;
▪ SampleQueriesSELECT * FROM default
WHERE ANY i IN b SATISFIES i<=1 END;
SELECT * FROM default X
UNNEST X.b Y
WHERE y<=1;
insertintodefault(key,value)values("1",
{"a":1,"b":[1,2],"c":{"ca":[1,2,3],"cb":4},"d":[
{"da":5,"db":6,“dc”:6.5},{"da":7,"db":8}],
"e":[{"ea":9,"eb":[10,11,12]},{"ea":13,"eb":[14,15,16]}],
"f":[[17,18],[19,20,21]]
});
EnterpriseBackupandRestore
>10xFasterBackups
▪ BetterDataProtectionwithEnterpriseBackupRestore– Scaletolargerdatasets– Fastbackupsandrestores– BetterConsistencyinbackupdata– Resilienttofailures/TopologyChanges
©2015CouchbaseInc. 29
SimplifiedSecurityCompliance
AdministrativeRoleBasedAccessControl
▪ AdministrativeRBACenablessegregationofadminduties▪ Administrativeuserscanbemappedtoout-of-the-boxroles▪ Separationofsecurityadministrationfromfulladministration▪ Rolespre-definedwithpermissionsforspecificresources
– FullAdmin– ClusterAdmin– BucketAdmin– ViewAdmin– XDCRAdmin
FullAdmin
ClusterAdminBucketAdminViewAdminXDCRAdmin
X.509Client-ServerCertificates▪ Bring-Your-OwnCertificateAuthority
– SupportforcommerciallyandinternallyissuedX.509certificates▪ StronglyCAtrustedon-the-wireencryptionforapplicationsandbetweendata-centers(XDCR)
▪ Simplifiedcertificatemanagementandrotation
Couchbase&Containers
▪ CouchbaseServeronDockerandOrchestrationTechnologies▪ OfficialDockerSupportwithMacOS,Ubuntuiscoming
PlatformasaService
CouchbaserunsonPaaSenvironments
CurrentFocus FuturePlan
What’sNewin4.6DP?
Disclaimer
Couchbase Server 4.6 is current a Developer Preview release and is intended for development purposes only.We consider Developer Preview releases to have some rough edges and bugs, and may change significantlybefore the final GA release. This release is not supported in production. The Developer Preview releasedoes not support upgrading from an earlier version of Couchbase Server.
©2016CouchbaseInc.
What exciting in 4.6 DP?
• Cross Datacenter Replication– Cross Datacenter Replication with Timestamp-based Conflict Resolution
• Security– Hardened Security with Pluggable Authentication Module
• New Functions in N1QL– N1QL introduces a number of new string and date functions in this release
• Full Text Search– Faster Full Text Indexing and Queries – Index Mapping & Sorting
• Tools– cbimport imports data from a CSV file or a JSON document, and cbexport exports data as a
JSON document
Mobile
Search
CacheOLAP
Data Warehouse
Hadoop
RDBMS
Whatelseisnew?
©2015CouchbaseInc. 38
Search
OLAP
Data Warehouse
Hadoop
{N1QL}
Whatelseisnew?
©2016CouchbaseInc.
Search
OLAP
Data Warehouse
Hadoop
{N1QL}
©2016CouchbaseInc.
OLAP
Data Warehouse
Hadoop
{N1QL}
©2016CouchbaseInc.
FULL TEXT SEARCH
Structured Query AND SearchOne platform.
|
Search Feelinglucky?
©2016CouchbaseInc.
OLAP
Data Warehouse
Hadoop
{N1QL}
©2016CouchbaseInc.
OLAP
Data Warehouse
Hadoop
{N1QL}
©2016CouchbaseInc.
Data Warehouse
Hadoop
{N1QL}
©2016CouchbaseInc.
Data Warehouse
Hadoop
{N1QL}
©2016CouchbaseInc.
INTRODUCING REALTIME ANALYTICS
You may also like these products
Thank you for your order!Order #: 3423943
Paid Partner Content
Operations & Analytics. One platform.
©2016CouchbaseInc.
Data Warehouse
Hadoop
THE PLATFORM FOR YOUR DIGITAL APPLICATIONS
©2016CouchbaseInc.
THE DATA PLATFORM FOR THE DIGITAL ECONOMY
UNIFIED ADMINISTRATION
UNIFIED PROGRAMMING INTERFACE
Data Query Index SearchMobileReplication Analytics
{N1QL}
©2016CouchbaseInc.
Why Couchbase Analytics ?
• Common data model: Couchbase Analytics natively supports the same rich, flexible-schema document data model used in Couchbase Server, rather than trying to force your data into an RDBMS model.
• Workload isolation: Operational query latency and throughput are protected from slow downs due to analytical query workload - without the complexity of operating a separate analytical database.
• High data freshness: Couchbase Analytics uses DCP, a fast memory-to-memory protocol that Couchbase Server nodes use to synchronize data among themselves. Because of this, analytics run on data that’s extremely current, without extract, transform, load (ETL) or other hassles and delays.
©2016CouchbaseInc.
What’s new in Couchbase Mobile 1.3 GA?Couchbase Mobile is the complete NoSQL database solution for all data storage, access, sync, and security across the entire application stack.
Support for OpenID Connect• Log in to Sync Gateway using a third-party identity provider• Authenticate users with providers that implement OpenID Connect (e.g. Google+, PayPal, Yahoo, Active Directory,
etc.)
Document Expiration (TTL)• Give documents in your local database an expiration time• Automatically clean up your database for short-lived documents
SG Replicate• Integrated support for Sync Gateway-to-Sync Gateway replication• Allows deployment configurations for tree and other non-star topologies
SGCollect Info• Get detailed statistics for Sync Gateway with the new command line utility called sgcollect_info
50
©2016CouchbaseInc. 51
Replication
SG-Replicate XDCR
• ReplicateviaREST/HTTP• Master/MasterorMaster/Slave• FineGrainDataReplicationvichannel(s)• ReplicationofflineforyearsisOK.
• ReplicateviaMemorytoMemory• Master/MasterorMaster/Slave• FullDataCopy/FilteredXDCR• ReplicationOfflineforfewdaysisOK.
Thankyou