SQL Server 2008 R2 and BizTalk Server

Enabling Informed Actions and Creating a Foundation for Agile Systems Master Data Management & Event Driven Processing

NameTitle

Microsoft Corporation

Business Demands Actionable Data

Actionable Data is

Intelligent

In Context

Complete

Accurate

Derived meanings from information

Real time delivery of relevant information when and where it is neededRelated

information reconciled into

single unified view

Complex and disparate data transformed,

cleansed and delivered

Data Quality is Key Requirement

System 1

Syed K. Rasheed

Male

1 Aug 1968

Married

Passport: 876313456

1 Main St,…

System 2

Syed Rasheed

M

1/8/68

M

DL: 554SKR888

Main St #1, …

System 3

S.K. Rasheed

Male

1/8/1968

M

SSN: 555121313

1 Main Street,…

System 4

Sadia Rasheed

F

July 15, 1975

Married

ID: C9988021

No 1, Main St.,...

• Are they the same person?• Are they related to other customers?•Which address is correct?

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

What is Master Data?

Types of Enterprise Data

Transactional Data

Describes Enterprise’s Activities

Master Data

Describes Enterprise Business Entities

Analytical Data

Describes Enterprise Performance

Master Data ISThe key facts describing your core business entities: customers,

partners, employee, products, etc.The high value information an organization uses repeatedly

across many business processes and applications

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

The Master Data ProblemIsn’t just a data problem … it’s a process and function problem

EXISTINGAPPLICATIONS

INFRASTRUCTURE

INVENTORY

SQL ServerWindows

CRM

Oracle DBUnix

OPERATIONS

DB2Z/OS

ERP FINANCE

SQL ServerWindows

OracleSolaris

OtherPartners &Customers

Sales forecasts

and reports

Sales force automation

Customer service

Operations

New product

idea portal

New product portfolio analysis

Financial reporting

New Regulatory compliance

portal

Compliance reports

Supply chain

integration

Trading partner portal

SymptomData is out-of-sync, incomplete, and inaccurate in your applications

Root CauseApplication functionality and business

processes are not designed to manage data for use beyond its own sphere, affecting data integrity, quality and

governance

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

What is Master Data Management?

• MDM is‒ An application for creating and maintaining an authoritative

view of master data including policies and procedures for access, update, modification, viewing between systems across the enterprise

• MDM Usage Style‒ Operational Use of MDM

‐ Use and Maintenance of Master Data occurs within Operational process/applications

‐ Master Data is consumed by other systems via real-time accessible SOA Services

‒ Analytical Use of MDM:‐ Integration with existing data warehouse & analytics

environment to provide master data‐ Inject insight from analytic systems into operational business

processes

Moving towards a Solution

Trusted Master Data

Cleanse

Govern

Integration Need• ERP/LOB Application Adapters• Reliable Messaging &

Notification• Process Orchestration• Data Mapping &

Transformations• Business Activity Monitoring

Data and Functionality unique to each

application

Data and functionality common to applications:

Customer, Account, Product

PeopleSoft

SAP

JDE

Mainframes

Custom

Oracle

Fuse Master Data with applications and

processes to drive broad data consistency and usage (actionable

Data)

Without integration of Master Data with OLTP applications, Master

Data Hub = YET ANOTHER SILO

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

Point-to-Point Integration Fails to Deliver Business Agility

• Point-to-Point‒ Complex Interface‒ Redundant Logic‒ Doesn’t Scale‒ Lacks Visibility

• Business Impact‒ Delays Response

to changing business needs

JD Edward

s

SAP

Custom Apps

AS/400

CICSMaster Data Hub

Dynamics

CRM/AX

OracleEBS

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

Agile MDM

PeopleSoft

SAP

JDE

Mainframes

Custom

Oracle

BizTalkServer

Application Integration

Master Data Hub

Business Activity Monitoring

New Master Data Synchronization

Master Data Publication

Data Synchronization

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

Adding Near real-time Reporting

PeopleSoft

SAP

JDE

Mainframes

Custom

Oracle

BizTalkServer

Application Integration

Operation Data Store (ODS)

Master Data Hub

Business Activity Monitoring

Near Real-time Reporting

New Master Data Synchronization

Master Data Publication

Near Real-time Transaction Trickle Feed

Data Synchronization

Master Reference

Actionable Data

is

Intelligent

In Context

Complete

Accurate

Enterprise MDM

PeopleSoft

SAP

JDE

Mainframes

Custom

Oracle

Biz

Talk

ES

B

Operation Data Store (ODS)

Master Data Hub

Enterprise Data

Warehouse(EDW)

Data Marts

Data Marts

Data Marts

Data Marts

Data Marts

SSIS (ETL)

Microsoft Business Intelligence

Business Activity Monitoring

Operational Reporting

Strategic Analysis

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

MDS + BizTalk enabler of actionable data

SQL Server MDS provides Data Cleansing + Governance

• Reduces data maintenance costs by preventing multiple processing in different systems.• Accelerates process execution by providing sophisticated data

synchronization mechanisms to connected applications • Ensures data consistency and accuracy thus reduces error-

processing costs due to inconsistent master data.• Improves corporate decision making in strategic sales and

purchasing by providing up-to-date information to all people.

BizTalk Server provides

Application Integration &

Process Automation

Integrate

Cleanse

Govern

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

SQL Server MDS Capabilities• Any Master Data Domain• Hierarchy & Attribute

Management• Versioning & Logging• Data Governance Portal• Data Quality Rules,

Notification, Validation• Data Level Security

BizTalk Server Capabilities• Enterprise Application

Integration• Application & B2B Adapters• Data Mapping &

Transformations• Durable Messaging &

Enterprise Service Bus• Process Orchestration Engine• Business Activity Monitoring• Business Rules Engine• Enterprise Single Sign-On

Integrate

Cleanse

Govern

REAL WORLDMASTER DATA MANAGEMENT

Actionable Data

is

Intelligent

In Context

Complete

Accurate

Business Demands Actionable Data

Actionable Data is

Intelligent

In Context

Complete

Accurate

Derived meanings from information

Real time delivery of relevant information when and where it is needed

Related information reconciled into single

unified view

Complex and disparate data transformed,

cleansed and delivered

A Different Way of Processing Data

• How many invalid credit card authorization were accepted yesterday?

Event Data Processing• When 3 authorizations for the

same credit card occur in any 60 second period, deny the request and require manual approval

Traditional Data Processing

Time

• Works in real time• Analyze by pattern within

time frames

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

Common Definitions

• Event‒ An event is a notable thing that happens inside or outside

your business. An event (business or system) may signify a problem or impending problem, an opportunity, a threshold, or a deviation

• Complex Event Processing‒ CEP deals with evaluating a confluence of events and then

take action‒ The events (notable or ordinary) may cross event types and

occur over a long period of time‒ The event correlation may be casual, temporal, or spatial‒ CEP is commonly used to detect and respond to business

anomalies, threats, and opportunities

Order Received

Reading from Sensor

Low Inventory

Stock Price Fluctuation

Temperature Change

Post Payment

Keycard Swiped

Flight Delay Radio Frequency IDFile Deleted

Click on Website

Actionable Data

is

Intelligent

In Context

Complete

Accurate

Scenario – Financial Industry

• Buy or sell a security at a certain price, or a certain time• Bond or CD matures, be notified to decide how to

reinvest• How would you implement this? Polling? Polling

interval•With Event Driven Approach, you could register for a

SELL event (or Price Event)

Actionable Data

is

Intelligent

In Context

Complete

Accurate

Scenario – Travel IndustryActionable Data

is

Intelligent

In Context

Complete

Accurate

• Flight delays or cancellations‒ Car Rental agencies, Hotels & Travel agencies need to be

notified or subscribe‒ Delayed flight means plane’s subsequent flights will be

delayed‒ Airport gate & ground crew are now available but another

needs to be reserved for later‒ Flight crew will be delayed for their connections & may

overrun their work limits for the day‒ New planes and/or crews may need to be allocated

• Try coding one central rescheduler with a whole bunch of if-statements

Event Driven Processing

Monitor

• From one or multiple streams

• All in real time-as the events occur

• Transform event data to the required format

• Events may be evaluated for notabilities by an event preprocessor (router, filter)

Process

• Events processed by engine based on event processing logic

• Comparisons, Calculations, Correlations, Aggregation, Temporal Operations – sliding window, hopping window etc.

Actionable Data

is

Intelligent

In Context

Complete

Accurate

Event Driven Processing

Devices, Sensors

Web Servers

Applications & DBs

Stock Tickers & News Feeds

Event Sources

CEP Engine

Standing Queries

INPU

T A

DA

PTER

S

OU

TPU

T A

DA

PTER

S

EVENTEVENT

EVENT

EVENT

EVENTEVENT

EVENT

EVENT

EVENT

Event Targets

Applications & DBs

Pagers & Monitoring Devices

KPI Dashboards, SharePoint UI

Trading Stations

IntegrateInformatio

n

AutomateProcesses

SimplifyManageme

ntOrchestration

Messaging / ESB

Business RulesBusiness Activity

MonitoringB2B Integration

Adapters

ESSO and UDDI

Monitor Process Act

Actionable Data

is

Intelligent

In Context

Complete

Accurate

Event Processing TechnologiesActionable Data

is

Intelligent

In Context

Complete

Accurate

• Technologies that can turn a stream of events into valuable and actionable information for business users:• SQL Server StreamInsight

‒ Extreme Performance event processing engine that monitor and analyze streams of real time events, including temporal correlations and detect notables events

• BizTalk Server‒ Automate the actions that the event processing produces as a

result

• BizTalk Business Activity Monitoring (BizTalk BAM)‒ Provide insight into the real time performance of the business‒ Complements SQL Server StreamInsight (CEP) and BizTalk Server

(BPA) as an business events dashboard

• BizTalk Business Rules Engine (BizTalk BRE)‒ Provide Event correlation and policy for cross node StreamInsight

Events‒ Automation of downstream decision management

Summary & Call to Action

• Microsoft Application Platform – SQL Server, BizTalk Server and Visual Studio – Enable you to address the most challenging business needs and

‒ Improve Business Agility With Actionable Data & Connected Systems

‒ Simplify Development And Management experiences

• Adopt, Upgrade, Deploy

Actionable Data

is

Intelligent

In Context

Complete

Accurate

Applications

Partners

Devices

EDI, AS/2, SWIFT, HL7, HIPAA…

SAP, PeopleSoft, OracleDynamics CRM,

SharePoint, Mainframe…

RFID

IntegrateInformation

AutomateProcesses

SimplifyManagement

Increase Business Agility

Drive Business Efficiency

Reuse ExistingIT Investments

Orchestration

Messaging / ESB

Business Rules

Business Activity Monitoring

B2B Integration

Adapters

Tool

sM

anagement

ESSO and UDDI

Business Process Automation & Integration Server

Q&A

What is Master Data and MDM?

• MD – Slowly changing reference data shared across systems• MDM – An application for creating and maintaining an

authoritative view of master data including policies and procedures for access, update, modification, viewing between systems across the enterprise• MDS – Microsoft’s Master Data Services platform shipping with KJ

26

People

• Customers

•Vendors

• Sales People

• Employees

• Partners

• Patients

Things

• Products

•Organizational units

•Recipes

• Parts

• Storage bin

•Documents

Places

• Stores

•Wells

• Power lines

•Geographical areas

Abstract

• Contacts

•Warrantees

• Time

•Metrics

Why do you need MDM?

ERP - USA

ERP - Europe

Data Warehouse or Analytic App

• Difficulty coordinating multiple systems – Operational MDM• Difficulty managing dimensions – Analytic

MDM• Or both – Enterprise MDM

• Operational• Europe keeps changing the color• New products never include the

French product name• I can’t pick the right Boeing

• Analytic• My sales reports are wrong• Analysts can’t maintain dimensions• Marketing can’t analyze by patch area

27

Agile Master Data Management

JD Edward

sService

SAPService

Custom Apps

Services

AS/400Service

s

CICS Service

Master Data Hub

MS CRM

Service

OracleService

BizTalk Server

Operational MDM:• Use and Maintenance of Master Data occurs within

Operational process/applications• Master Data is consumed by other systems via real-time

accessible SOA Services

Actionabl

e Data

is

Intelligent

In Context

Complete

Accurate

A not-for-profit, user-run association to enable the SQL Server community to connect, share, and learn

Get ongoing SQL Server learning from MVPs, top experts, and real-world users:

• Training webcasts, technical education, worldwide event info, and moreSign up for your FREE PASS membership today: www.sqlpass.org

• Go to local PASS Chapter meetings Visit the PASS Chapter booth to learn about upcoming local events, or visit www.sqlpass.org/PASSChapters

• No local Chapter? Start a Chapter with support and resources from PASS

www.sqlpass.org/getchapterinfo

• Attend PASS Summit 2010World's largest and best conference for SQL Server and BI technical education www.sqlpass.org/na2010 Follow / Join us online: Twitter @sqlpass #sqlpass, LinkedIn group, Facebook

group

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.

The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after

the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.