Database and Business Intelligence – Karen Hsu, Informatica
-
Upload
rinky25 -
Category
Technology
-
view
524 -
download
0
Transcript of Database and Business Intelligence – Karen Hsu, Informatica
1
xBRL US Pacific Rim WorkshopDatabase and Business Intelligence Workshop
Karen HsuDirector Product Marketing, Informatica
2
SWIFT
SEPA
xBRL
On-demand Integration Enterprise Data Integration B2B Data Integration
Data Quality Across the Whole Enterprise
Extend Data Transformation and ExchangeThe Informatica Economy Enabled Through Data
TraditionalEnterprise
On-demand Enterprise(SaaS)
Partner TradingEnterprise (B2B)
3
The Information PlatformTo Enable Business Imperatives
On-demand Integration Enterprise Data Integration B2B Data Integration
Data Quality Across the Whole Enterprise
Informatica On Demand
Improve Decisions &RegulatoryCompliance
ModernizeBusiness & Reduce IT
Costs
FacilitateMergers &
Acquisitions
Improve Customer Service &
Operational Efficiency
OutsourceNon-coreFunctions
IncreasePartner network
Efficiency
Access Discover Cleanse Integrate Deliver
Develop + Manage
Audit + Monitor + Report
Data QualityData Explorer
PowerCenter – Metadata ManagerPowerExchange
B2B Exchange B2B Exchange
4
Vision: Enterprise Wide Transformation
IDSCorporate DDA
GBS(Aries/6283)
SWIFT
GMX(router)
GMD
WTX
GF2
PaymentsTranslationDistribution
TreasuryTranslationDistribution
TradeTranslationDistribution
ACX
Data Express
SAG
ReceiptsTranslationDistribution
Enterprise Gateway
Electronic File Delivery
PEP+
GlobalAdvice
DRS
Check
DPS Sites
StandardRegister
ACS
US Lockbox(Multiple Sites)
Off-ShoreLockbox
RapidPay(Home Banking
Payment Consolidation)
ChicagoLockboxMerge
BAMTRAC
Asia ReceiptSystem
WINRNon-Financial
ReturnsPurchaseOrder
Tracking
Multibank
Message Based
SWIFT MT103
BatchCRF / PAYORD
NACHA
BAI
CREMUL, 823
MT103MT900MT910
820 or Fax Information
SLF–Single
Lockbox Format:
Merge ACH,Wire,
LockboxSEPF – Single Electronic
Payment Format
PO Data
Invoice Data
MT7xx’sLetter of Credit
Return ItemsMap to 827
BAI2 Multibank
FINSTA &BAI2
Enhanced
ePayable
X12.820
INFORM-Commercial(Repository)
INFORMCorporate
(Repository)
Bulk FX
SMS
DISC ARP
PoormanDouglas
IMPACS(DDA, SDA..)
PaymodeeCommerce Supported FormatsPayment Origination• Payment Origination w/Remittance Advice• BAFF – Bank of America Flat File (Proprietary)• UBAFF (International only)• X12 – 820 Payment Order / Remittance Advice• X12 – 835 Health Care Claim Payment / Advice• EDIFACT – PAYEXT, DIRDEB v96a• SAP IDOC – PAYEXT• TD-CPA (Canadian ACH Payments)
Payment Reporting• X12 – 821 Financial Information (Cks Paid)• X12 – 827 Financial Return Notice (US ACH only)• X12 – 828 Debit Authorization (Cks Issue)• EDIFACT – FINSTA Financial Statement
(Payments Issued)
Receipts Origination• BAI – LBX (1, 2 and ERP)• X12 – 820 Payment Order / Remittance Advice
(US LBX, ACH and Wire)• EDIFACT – DIRDEB• X12 – 810 (IPP – Invoice Presentment Payment)
Receipts Reporting• X12 – 823 Lockbox (US LBX, ACH, Wire and
International Receipts)• X12 – 835 Health Care Claim Payment / Advice• X12 – 827 Financial Return Notice (Check and
ACH Debits)• EDIFACT – CREMUL (International Receipts)• EDIFACT – FINSTA (International Receipts)
Treasury• X12 – 821 Financial Information Reporting (Prior• Day, Current Day reporting)• X12 – 822 Account Analysis (Formatted by APX
Weiland 822 Express Software)• BAI – Information Reporting• EDIFACT – FINSTA, Enhanced BAI2 (Prior Day,
Current Day Reporting)
Trade Purchase Order Origination• X12 – 850 Purchase Order• EDIFACT – DOCAPP (Documentary Credit
Application)• EDIFACT – ORDERS (PO Message)• EDITFACT – AUTHOR (Authorization message
in/out)• EDIFACT – DOCAMI (Documentary Credit
Amendment)
Trade Invoice Reporting• X12 – 810 Invoice (Triggers Payment When
Terms/ Conditions Met)• EDIFACT – INVOIC (Invoice message)• EDIFACT – DOCINF (Documentary Credit
Issuance)• EDIFACT – DEBMUL (multiple debit advice)
CIE
ECI EDTUP
ERPsTreasury
WorkstationsPayroll Other Apps Customer
eCommerce Systems Interface Diagram
eCommerce Systems
•100s of formats•Multiple interaction channels•1000s of combinations of formats, protocols, rules between channels•Lack of data and process standardization•Unable to support growth in volume
Typical Infrastructure Streamlined Processing
Payroll
PO Order
Tracking
REPORTING
EDIFACT
CUSTOMER
SWIFT
PARTNER
TRADE
PO
Reduce processing costs and costs of integrating data across product lines to target new or existing relationships
5
Accelerate Adoption of xBRL
• Reduce risk• Leverage existing expertise and infrastructure for lower TCO
• Pre-built transformations to industry standards
• Best-in-class transformation specification environment
• Accelerate xBRL usage from within to outside • Transform any file to and from xBRL
• Documents (excel, PDF, word)
• Proprietary, COBOL\PL1
• Complex positional and delimited files
• Industry standard interoperability (standard to standard, version to version, e.g SWIFT MT, MX, BAI)
• Ensure quality of data
• Manage and monitor data coming from sources and going to destinations
6
Before: Shenzen Stock ExchangeIssuers Stock Exchange Custodian\
BrokersFlat file
Flat file
Fax
SFTP
Flat fileFlat file
SMTP
Flat fileFlat file
PDFPDF
MT 564
Fax
PDFPDF
Flat fileFlat file
PDFPDF
Enterprise actions DB
SMTP
20+ IT personsfull time
Business user time lost in
error analysis
7
Shenzen Stock Exchange with Informatica
Issuers Stock Exchange Custodian\ Brokers
Flat fileFlat file
Fax
SFTP
Flat fileFlat file
SMTP
PDFPDF
MT 564
Flat fileFlat file
PDFPDF
Web Portal
SMTP
B2B Data Transformation Data Quality
Enterprise actions DB
B2B Data Exchange
Sources Data Feeds management Monitoring
8
Automatic extraction of Annual Report PDF to XML canonical format
Semi Annual report
9
• Best-of-breed transformation for unstructured (PDF) and financial reporting formats
• Leverage existing resources familiar with PowerCenter for end to end data integration
Accelerate time-to-market of credit ratings
KEY BUSINESS IMPERATIVE
B2B ADVANTAGE RESULTS/BENEFITS
• Enable customers to respond quickly to market changes
• Replace manual process of copying and pasting from PDF files to analytics application
• Replace hand coded excel extraction VB macros
THE CHALLENGE
• Need to analyze raw data coming from 10,000 different formats every month
• 40-80 people required per month to extract the data from these formats, delaying the publishing of securities ratings
• Eliminated need for 40-80 people every month to extract data with up front investment of 60 days
• Ability to support any new format or industry standard quickly
ref123
Large CreditRating Agency
10
B2B Data Exchange
Internal SystemsExternal sources
B2B Data Exchange
PowerCenter
Monitoring
Partner Management
Data Transformation
Adapters Quality Identity
Managed File Transfer
DataWarehouse
SWIFT
11
Business and IT CollaborationStep 1: Profile the Data with Informatica Data Explorer
Catalog of Issues
•Completeness
•Conformity
•Consistency
•Accuracy
•Duplicates
•Dependencies
• Cleansing specifications
• Transformation specifications
Profiles and tags anomalies with Informatica Data Explorer (IDE)
Reviews anomalies with Informatica Data Explorer (IDE)
SME
Developer
12
Data Quality Dimensions Framework
Completeness What data is missing or unusable?
Conformity What data is stored in a non-standard format?
Consistency What data values give conflicting information?
Accuracy What data is incorrect or out of date?
Duplicates What data records or attributes are repeated?
Integrity What data is missing or not referenced?
13
Finance Data - Example
COMPLETENESS
CONFORMITY
CONSISTENCY
DUPLICATION
INTEGRITY
ACCURACY
14
Business and IT CollaborationStep 2: Continued. Establish Metrics and Define Targets
Create scorecards (i) for the initial business case and (ii) as the basis for web based monitoring
Configures and deploys web based data quality reports for monitoring on an ongoing basis – using Informatica Reporting or a 3rd party reporting tool
SME
Developer
15
Business and IT CollaborationStep 3: Design and Implement Data Quality Rules
Assists with design of Data Quality rules in Informatica Data Quality (IDQ)
Creates Data Quality rules with Informatica Data Quality (IDQ)
SME
Developer
• Standardize values
• Correct missing or inaccurate data
• Enrich the data
• Identify and consolidate duplicate records
16
Sources Data
QualityChecks
Exception Management
Records that passed
DQ rules
Target
Cleansingand
MatchingRules Exceptions Data
Quality Assistant
High Quality DataLow
Quality Data
Exception Management process Step 4: Manage exceptions and consolidate
Browser based exception review and manual consolidation process
17
Business and IT CollaborationStep 5: Monitor Data Quality Versus Targets
• Informatica’s scorecarding and reporting also support monitoring of quality over time
• Companies can utilize Informatica’s toolset to perform the monitoring or utilize 3rd party reporting tool
Monitors the quality of data to determine if objectives are being met. Uses results to support root cause analysis
Review results to determine if rule enhancement is necessary as part of the automated data quality process
SME
Developer
18
Accelerate Adoption of xBRL
• Reduce risk• Leverage existing expertise and infrastructure for lower TCO
• Pre-built transformations to industry standards
• Best-in-class transformation specification environment
• Accelerate xBRL usage from within to outside • Transform any file to and from xBRL
• Documents (excel, PDF, word)
• Proprietary, COBOL\PL1
• Complex positional and delimited files
• Industry standard interoperability (standard to standard, version to version, e.g SWIFT MT, MX, BAI)
• Ensure quality of data
• Manage and monitor data coming from sources and going to destinations
19
Thank you