MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released:...

35
17 June 2019 © MARKLOGIC CORPORATION Joey Khalid Director, Business Development, MuleSoft Vishnu Samavedula Senior Solution Engineer, MuleSoft Clay Redding Senior Principal Consultant, MarkLogic MuleSoft and MarkLogic: Making Simplified Data Integration Even Faster

Transcript of MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released:...

Page 1: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

17 June 2019© MARKLOGIC CORPORATION

Joey KhalidDirector, Business

Development, MuleSoft

Vishnu SamavedulaSenior Solution Engineer,

MuleSoft

Clay ReddingSenior Principal

Consultant, MarkLogic

MuleSoft and MarkLogic: Making Simplified Data Integration Even Faster

Page 2: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MarkLogic Data Hub Platform

Page 3: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MuleSoft Overview

Page 4: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MuleSoft + MarkLogicJoey KhalidDirector, Business Development

Vishnu SamavedulaSenior Solutions Engineer, Tech Partners

May 15, 2019

Page 5: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MuleSoft provides a

software platform that

enables organizations

to create a network of

applications, data, and

devices using APIs.

Page 6: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MuleSoft’s Mission

To help organizations change and innovate faster by making it easy to connect the world’s applications, data, and devices.

Page 7: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MuleSoft Customers

1,400 Customers

Page 8: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Customer Success PlatformFor the Fourth Industrial Revolution

#1B2C & B2B

Platform

Page 9: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

So what problemare we solving?

Page 10: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Data and business apps are increasingly distributed

Cloud

SaaS

Microservices

Big Data

Devices

IoT

APIs

Page 11: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Complexity Increases Rapidly

11

Each Project Just As Hard As The Last

Fragility And Paralysis Ensue

Traditional integration approaches make IT a bottleneck

Page 12: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

So how does MuleSoft solve this problem?

Page 13: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Mock and Build APIs

13

creating an enriched invoicing API product

creating an invoicing API product on SAP

Page 14: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Core capabilities into reusable building blocks

Compete by leveraging core competencies

Secure and governed access to core systems

Can be moved across environments without re-development work

APIs give you a standardized way to amplify your unified customer journey

API Contract

Logic

Connectivity

Core capabilities become reusable API building blocks

Page 15: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

API-led Connectivity: A Modern Approach to Integration

Common Initiatives:

Build a Customer 360

Modernize Legacy Systems

Create Omni Channel Experiences

Connect E-Commerce

Develop Mobile Apps

Page 16: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Anypoint Exchange - Reusable Assets

API Consumer ExperienceAnypoint Exchange (Public and Private)

Page 17: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

An Application Network emerges

Shipping& Fulfillment

Inventory

CustomerExperience

System connections & integrations

Page 18: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

APIs + Integration - Digital Transformation

Integration Platform

API LifecycleManagement

Easy toconsume

asset library

Page 19: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MuleSoft + MarkLogic = Better Together

Page 20: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MarkLogic Connector for Mule 4

● Provides easy integration to MarkLogic, delivering data movement and transformation

pipelines via MuleSoft Anypoint Studio

● Connector allows customers to leverage rich ecosystem of Anypoint Exchange connectors

for integrating data from many sources into MarkLogic

● Connector is built using MarkLogic’s Data Movement SDK, a Java library for efficiently

moving large amounts of data into, out of, or within a MarkLogic cluster

Page 21: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MarkLogic Connector for Mule 4

● 30 Day Free Trial of MuleSoft Anypoint Platform

● All connectors are viewable and most are downloadable at mulesoft.com/exchange

● Our tech partner program is open to all ISVs

● Check out the new MarkLogic connector for Mule 4

● If you have any questions, email [email protected]

Page 22: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Anypoint Studio: Easy to Configure a Mule flow

Page 23: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MuleSoft + MarkLogic Enables Customer 360

MarkLogic Data Hub for Provider 360

Page 24: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic
Page 25: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MarkLogic Connector for MuleSoft

Page 26: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MuleSoft Connectors are all Java-based, but with an “API First” RESTful mindset

The MarkLogic MuleSoft Connector uses Java Client API and Data Movement SDK

Release version 1.0.0 is available via the MuleSoft Anypoint Exchange:

- https://www.mulesoft.com/exchange/com.marklogic/marklogic-mule-connector/

MarkLogic Community GitHub:

- https://github.com/marklogic-community/marklogic-mule-connector

About the Connector

Page 27: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Release version 1.0.0 (Released: February 2019)

- Initial connector release, focused on importing data into MarkLogic from a MuleSoft Flow

- MuleSoft Certified, and available on the Anypoint Exchange

- Based on MarkLogic Java API 4.0.4

- importDocs (for writing JSON, XML, Text, or Binary to MarkLogic)

- getJobReport (for reporting DMSDK job outcomes)

- Support for digest and basic authentication only; no SSL support yet

MarkLogic MuleSoft connector roadmap

Page 28: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Release Version 1.1.0 (Anticipated release: late May 2019)

- Adds the ability to query and delete documents in MarkLogic; also adds SSL support

- Based on MarkLogic Java API 4.2.0

- deleteDocs (by Structured Query or CTS Query)

- queryDocs (by Structured Query or CTS Query)

- importDocs enhanced to support temporal collections, for bitemporal

- Support for SSL and certificate authentication

MarkLogic MuleSoft connector roadmap

Page 29: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Version 1.2.0: (Anticipated Release: August-October 2019)

- Submit your ideas!

- REST integration with Data Hub Framework for Orchestration

- Support for custom REST resource extensions

- Semantics support: RDF ingest and SPARQL query support

MarkLogic MuleSoft connector roadmap

Page 30: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Demo

Orchestrating an Employee 360 Data Hub Integration Using MuleSoft

Page 31: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Need to ingest Employee and Departmental history data from legacy RDBMS systems

Provide a single view of departmental history for any given employee

Allow for searchable access to the data

Allow for export of the data to Amazon S3, needed for downstream data extract requirements by our Benefits team

Provide support for graph-based views and querying of our departmental history data

Demonstrate the origins and lineage of the data after ingest

Our IT department triggers all data movement at every layer with MuleSoft and REST services

Our demo requirements

Page 32: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Built-in SearchMarkLogic REST API

Demo architecture

MarkLogic Data Hub

S3 Bucket for BenefitsAWS System

Semantics/SPARQLMarkLogic REST API

DepartmentsMySQL Tables

EmployeesMySQL Tables

Harmonization

Load as is

Page 33: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MarkLogic Data Hub PlatformMuleSoft

Triggers and orchestrates data movement at each

Data Hub phase

Page 34: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

MarkLogic has a Mulesoft certified connector, available in the MuleSoft exchange

MarkLogic customers can leverage the vast collection of MuleSoft connectors to extract data from data sources and business applications

This results in faster ingestion of data sources

MarkLogic will also leverage API management capabilities of MuleSoft, giving customers the ability to use MuleSoft to build MarkLogic applications

We’re making simplified data integration even simpler and faster

Takeaways

Page 35: MuleSoft and MarkLogic: Making Simplified Data Integration ... · Release version 1.0.0 (Released: February 2019)-Initial connector release, focused on importing data into MarkLogic

Questions?