Data Quality Management, microservices - SAP Store
Transcript of Data Quality Management, microservices - SAP Store
2© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
?
Bad data quality implications and root causey does your customer care?
Good data quality is a prerequisite
for operational and analytical
applications
Without data quality processes…
It is difficult to determine the right target
audience for marketing campaigns
Inaccurate information causes delayed
shipments and lower customer
satisfaction
Costs are high due to account
duplications, and response-rate is low
Reporting uses wrong data – this leads to
incorrect conclusions/decisions
Sales representatives cannot able
identify relevant accounts
Root Cause
Sources of Data Quality Problems
75%
75%
46%
40%
38%
26%
25%
20%
7%
Data entry by employees
Inconsistent definitions of common terms
Data migration or conversion projects
Mixed expectations by users
External data
Data entry by customers
System errors
Changes to source systems
Other
Based on 632 respondents who could select multiple answers. TDWI Research Survey 2006
3© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
SAP Data Quality Management,
microservices embeds data cleansing and
enrichment services within any business
process or application with a self-service,
right-sized consumption model. It is quickly
deployed on many SAP applications with pre-
built integration, eliminating operational
complexity and infrastructure costs.
SAP is the ONLY vendor offering industry
leading data quality solutions and
applications. This allows SAP to provide
seamless end-to-end solutions, all from one
vendor.
From the Leader in
Data Integration and Quality
5© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
What is SAP Data Quality Management, microservices?Data cleansing services in the Cloud
Customer / Partner
Applications
C4C SFSF
OtherS/4H
SCP
Cloud Applications
Suite S/4H HANAData
Services
On-Premise
Applications
SAP Data Quality
Management, microservices
Address Cleansing
Reverse/Geocoding
Other Services…
Application Service
Easy to Integrate RESTful services
with partner/customer applications,
includes integration w/ many SAP
applications
Consumption-based pricing
model, sold as a stand alone
service separate from SAP Cloud
Platform
Address cleansing/validation,
Geocoding, & Reverse
Geocoding REST Services powered
by SAP Cloud Platform
Global Solution supporting
Address cleansing in 240+
countries as well as high-quality
Geo capabilities in many Countries
Industry Leading Solution based
on 30+ years of SAP Data Quality
Management technology
1
2
3
4
5
SAP
Cloud Platform
6© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Benefits of Address Cleansing and Geolocation Services
Accurate Location Analytics
Correct, consistent and standardized location
information will ensure accurate location
analytics to make better business decisions.
https://www.ups.com/media/en/additional_charges_daily.pdf
Increased customer satisfaction
Ensure timely delivery of packages and
communications
Provide relevant communication based on
location intelligence
Reduced Unnecessary Costs
Reduce undeliverable package fees, returned
mail and possible government compliance fee’s
for incorrect employee address information.
7© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Simple example
Address1 Address2 City Region Postal Country
121 Trellis Ln <Blank> escondid California <Blank> USA
121 Trellis Lane <Blank> Escondido <Blank> 92026 USA
121 trelis Ln. <Blank> Escondido CA 92026 USA
Delivery address City State Zip Zip4 Longitude Latitude
121 Trellis Ln Escondido CA 92026 2078 -117.09002 33.14502399
121 Trellis Ln Escondido CA 92026 2078 -117.09002 33.14502399
121 Trellis Ln Escondido CA 92026 2078 -117.09002 33.14502399
SAP Data Quality Management, microservices
Address Cleansing
Geocoding & Reverse Geocoding
Other Services…
SAP
Cloud Platform
8© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
SAP solutions for Enterprise Information Management Information ready for action
Analytics
Big Data & IoT
Business
Processes
Compliance
Information Lifecycle
Management
Master Data
Management
Content
ManagementData
Discovery
Data
Integration
Data Quality
Management
GOVERN
9© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Data Quality solutions from SAP
Measure
Analyze
Parse
Standardize
Validate/
Correct
Enhance
Match
Consolidate
Data
Quality
SAP Data Services
SAP HANA,
smart data quality
Data Quality Management,
microservices
Information Steward
Agile Data Preparation
Continuous
Monitoring
10© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
SAP Cloud PlatformThe enterprise capabilities you need to succeed in the cloud
Business
Services
MobileSecurity Data &
Storage
Dev & Ops
User Experience Internet of ThingsIntegrationCollaboration Analytics
11© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Why address cleansing and validation?Does this look like a valid address?
6 St. Andrews Court
Thame OX9 3GG
12© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
What if we can …Identify, add missing elements, correct and normalize address data?
6 St. Andrews Court
Wellington St.
GB
Thame OX9 3WT
6 St. Andrews CourtBuilding Name
Street Name
PostcodeCity Name
Country
13© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Basic feature: Geocoding
Geocoding is the process of finding associated geographic coordinates (latitude/longitude) from
other geographic data such as street addresses or postal codes
Output
43.81162, -91.24488
Input
800 Main St, La Crosse, WI, 54601
Cascade Geo assignments:
Find the best coordinate for an address, in the following sequence:
3. Postcode /
Locality
Centroid
2. Primary
Number
Interpolated
1. Primary
Number Exact
(Parcel)
101 Main St
191 Main St
381 Main St
14© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Basic feature: Reverse geocoding
Reverse Geocoding is finding a street address from geographic coordinates
Output
800 Main St, La Crosse, WI, 54601, La Crosse Public Library, 0km
800-899 Main St, La Crosse, WI, 54601, 0.0009km
801 Main St, La Crosse, WI, 54601, 0.0032km
820 Main St, La Crosse, WI, 54601, 0.0314km
Input
43.81162, -91.24488
15© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
SAP Data Quality Management, microservices
Two components
1. “Web Service” API – HTTPS/JSON
2. Web-based user interface (optional, does not apply to reverse geocoding)
Customer
Applications
SAP Data Quality Management, microservices
Address Cleansing
Reverse/Geocoding
Other Services…
SAP
Cloud Platform
16© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Address cleansing maturity at SAP – Postal Certifications Proven and trusted solution (30+ years experience, Firstlogic/BusinessObjects technology)
SAP Data Quality Solutions have held major Postal Certifications since their inception
SAP is one of very few vendors that hold these 5 postal certifications
17© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Region/ Location Status
Ashburn, NA operational
Phoenix, NA operational
Amsterdam, EU operational
Rot, EU operational
Sydney, ANZ operational
Tokyo, APJ operational
Shanghai, APJ operational
Dubai, EMEA Q3/2017
Moscow, Asia Q3/2017
Toronto, NA Q3/2017
Sao Paulo, LATAM Q4/2017
AWS, EU operational
AWS, NA operational
Azure, NA (beta) operational
Phoenix
Toronto
Ashburn
Sao Paulo
Amsterdam
St. Leon-Rot
Moscow
Dubai
Sydney
Shanghai Tokyo
Frankfurt
US East US West
SAP DC operational
SAP DC planned
AWS CF
Azure CF
1 2
DQM, microservices only
available in St. Leon-Rot initially.
Inquire about other data centers.
SAP Cloud Platform Data Center Build-Out with
Data Quality Management, microservices current support
Disclaimer: Dates are subject to change and considerable delays
may be introduced due to unforeseen circumstances.
1) BETA , 2) planned innovations / future direction
Current Integration Scenarios SupportedSAP Data Services
SAP Hybris Cloud for Customer
SAP Business Suite and S/4HANA (On-premises and Private Cloud)
19© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Clean and Accurate Data at Point of EntryProvides Extended Data Quality Capabilities
Extend SAP Data Services
Common Use Scenarios
Simplify use of address cleansing/geocoding
Hybrid use of on-premises and DQM, microservices to
maximize value
Data Quality Firewall
Pre-built integrations with SAP Applications
Customer integrations with non-SAP Applications
Data Quality
Management,
microservices
Data Quality
Management,
microservices
Data
Services
Data Warehouse
SAP
Non-SAP
Cleansing
Cleansing
Cloud
Cloud
Cloud
Cloud
20© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
SAP Data Services
One Runtime Architecture & Services
Unified Metadata
ETL
Data Quality
Profiling
Text Analytics
One consistent UI
Data Quality Management, microservicesIntegration with SAP Data Services
Data Services 4.2 SP08
New data quality management,
microservices transform
Address cleansing & geolocation
services
Real-time and batch processing
Hybrid model also supported:
Combining on-premises
processing of some countries,
and processing others through
the microservices
Model
Run Configure
Map
SAP Data Quality
Management,
microservices
1. (Optionally) Model configuration
for use with Data Services2. Model dataflow to process data
through DQM, microservices
3. Execute data services jobCloud
21© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
New Data Services Data Store
Type “SAP DQM microservices”
Configure URL to DQM,
microservices for your specific
account
Configure other connection
information – authentication, proxy,
SSL, …
Data Quality Management, microservicesIntegration with SAP Data Services
New DQM,
microservices
transformation
22© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
SAP Hybris Cloud for Customer
With SAP Hybris Cloud for
Customer 1705 release we offer an
out of box integration with SAP
DQM, microservice
New action on accounts quick
create and detail view to validate /
standardize / geo-code addresses
SAP Data Quality Management,
microservices must be licensed to
enable capability
SAP Hybris Cloud for Customer Integration (NEW in 1705)
Addresses
SAP Hybris Cloud for
Customer
SAP Data Quality Management,
microservices (NEW!)
Cloud
23© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
SAP Hybris Cloud for Customer Integration (NEW in 1705)
Validated Address returned to fields
Incomplete Address entered
24© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Data Quality Management,
version for SAP (ABAP Add-on)
Create a real-time Data Quality
firewall to enable trusted data
from entry to reporting
ABAP Add-on included w/ Data
Quality Management,
microservices
Instant savings on business
and IT costs by:
Improving productivity through
use of native UI and data entry
validation
Reducing redundant work and
manual data cleansing
downstream
Data Quality Management, Integration with Business Suite and S/4HANA Embeddable natively into applications
SAP Data Services
SAP HANA, smart data
quality
SAP Data Quality Management,
microservices (NEW)
Cloud
SAP Business Suite
Applications Supported
Master Data
Governance
SAP S/4
(on premise)SAP ERP
SAP CRM
Business Address Services (Badi)
ABAP Add-on
25© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Example address cleansing from Business Suite and S/4HANA integration Automatically completes and corrects entries, then presents to user for approval
Incomplete Address
entered
Compared Original and Validated Addresses Validated Address returned to fields
26© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Example address cleansing from Business Suite and S/4HANA integration Presents Suggested Correct Addresses if input results an ambiguous match
Incomplete Address
entered
Primary Address
Suggestion (Street)
27© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Example address cleansing from Business Suite and S/4HANA integration Then presents the selection to the user for approval
Compared Original
and Validated
Addresses Validated Address
returned to fields
29© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Why SAP Data Quality Management, microservices?Simple consumption of core data quality services
Pre-built
Integrations
Simple
Consumption
Consumption-based
Licensing
SAP Data Quality Management, microservices embeds
data cleansing and enrichment services within any business
process or application with a self-service, right-sized
consumption model
Includes integrations with
many SAP Applications
Simple to consume via the
Cloud
Global solution
Trusted vendor with 30+ years
experience in address
cleansing and geocoding
Consumption-based pricing
30© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Summary
Benefits
Simple
Prebuilt Integrations
Consumption-based pricing
Mature Solution
Strong partnerships
Try for FREE on
SAP Cloud Platform,
developer edition
Generally Available NOW!
Customer / Partner
Applications
Suite S/4H HANAData
Services
On-premises
Applications
SAP Data Quality
Management, microservices
Address Cleansing
Reverse/Geocoding
Other Services…
SAP
Cloud Platform
C4C SFSF
OtherS/4H
SCP
Cloud Applications
31© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ
Contact your
SAP
Account
Executive
Get started with SAP Data Quality Management, microservices
Find out
more about
SAP Data Quality
Management,
microservices:
sap.com
Subscribe to the
EIM YouTube Channel
Try on SAP Cloud Platform,
developer edition
Read the Blog
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP or its affiliated
companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP or SAP affil iate company products and services are those that are
set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future developments, products,
and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason without notice. The
information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements,
and they should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate company)
in Germany and other countries. All other product and service names mentioned are the trademarks of their respective companies. See http://global.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.
© 2017 SAP SE or an SAP affiliate company. All rights reserved.