Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior...

24
Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior Program Manager Microsoft Corporation DBI310

Transcript of Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior...

Page 1: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDSMatt MassonSenior Program ManagerMicrosoft Corporation

Matthew RocheSenior Program ManagerMicrosoft Corporation

DBI310

Page 2: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

My Business Intelligence Project

One version of the truth!

Page 3: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

My Business Intelligence Project

70%

Page 4: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

It Can’t be That Bad… Or Can It?

Top Barrier for BI

Source: Information Week Reports, 2011

Page 5: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

And it’s Not Just About BI…

Top 3 impediments

Source: Information Week Reports, 2011

Page 6: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Curating Data with SQL Server 2012A full suite of tools for Enterprise Information Management (EIM)

Produce accurate, trustworthy data

Deliver credible, consistent data to the right users with end-

to-end data integration, cleansing & data management

Use SQL Server for all EIM needs

DATA QUALITY SERVICES

Knowledge-based Data Cleansing & Matching

Standalone & SSIS Integrated

MASTER DATA SERVICES

Excel UI to Manage Data & Dimensions

Rapid, Easy Data Loading

INTEGRATION SERVICES

Integrated Deployment & Management

Improved User Experience

Page 7: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Enterprise Information Management

Creating a Consolidated Customer Sales Report

Page 8: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Data is Rarely BI Ready

Page 9: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

The Technologies

Data Movement

SSIS

Spell Checking DQS

Reference Tables

MDS

Page 10: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Data Curation Process

CleanseMatchManageIntegrate and Automate

Page 11: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Using Data Quality Services

Knowledge

Discovery

Create Domains

Cleanse Data

Create Matching

Policy

Page 12: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Using Data Quality Services

Page 13: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

DQS Summary

Statistical and knowledge-based data correction

Common term correction using Term Based Relations

Reference Data Service (RDS) cleansing through Data Marketplace

Common examples include:Address cleansingPhone number verification

Page 14: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Using Master Data Services

Create Entities

Set Attributes

De-Duplicatio

n

Page 15: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Using Master Data Services

Page 16: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

MDS Summary

Quick and easy model creation in Excel – Democratizing master data management

Powerful MDM functionality, such as hierarchies, validation rules, and workflows

De-duplication and matching through integration with Data Quality Services

Page 17: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Summary and Closing

EIM helps address problems in many different contexts

BI is the obvious low hanging fruitOperational systems are also plagued by data problems

The SQL platform is about Managed Democratization

One version of the truthEmpowered business usersReduced IT involvement

It’s not an all or nothing solutionParts can be rolled out and integrated separately

Page 18: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Related Content

Breakout Sessions

Hands-on Labs

Related Certification Exam

Find Me Later At…

Breakthrough Insights: Credible, Consistent Data

Exam 70-463: Implementing a Data Warehouse with Microsoft SQL Server 2012

Breakthrough Insights: Credible, Consistent Data

Product Demo StationsDBI24-HOL: Exploring Microsoft SQL Server Integration Services

DBI322: Incremental ETL Using CDC for SQL and Oracle with SSIS 2012DBI329: Upgrading SSIS Packages to SQL Server 2012DBI207: BI Power Hour

Page 19: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Contact

Matt Masson

[email protected]

mattmasson.com

@mattmasson

Matthew Roche

[email protected] BI Polar

@SQLAllFather

Page 21: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Resources

Connect. Share. Discuss.

http://europe.msteched.com

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Resources for Developers

http://microsoft.com/msdn

Page 22: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

Evaluations

http://europe.msteched.com/sessions

Submit your evals online

Page 23: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS

PRESENTATION.

Page 24: Enterprise Information Management (EIM): Bringing Together SSIS, DQS, and MDS Matt Masson Senior Program Manager Microsoft Corporation Matthew Roche Senior.