TMO Visio Integration Architect_Seattle IUG

7/31/2019 TMO Visio Integration Architect_Seattle IUG

1/22

ICC

EnhancementsInformatica

VISO Architect

Sean Hickey

Mgr, Integration Architecture


2/22

ETL Development Challenges

1. Lots of mappings needed for staging

2. Re-usable patterns available but mustreverse engineer

3. Re-testing of standard processes over and over

4. Integration Architects need to enforce astandard

5. Wouldnt be nice to just cut and paste?

2


3/22

Mapping Architect for Visio

Available as part of PCSE, no additional cost

3


4/22

Metadata driven framework for generating custom wizards for

templatesAbility to build your own wizards based on the pattern without

coding

4

DI ArchitectDevelop Visio mappingtemplate, logical flow

DI DeveloperMeaningful use case specificwizard

Slowly Changing Dimension Wizard

Step 2 Step 3

DI ArchitectProvide UI informationin template XML file

TemplateXML

TemplateXML

Step 1


5/22

Mapping Architect for Visio v8.6Enhancements Summary

Workflow and Session Generation

Support for more reusable objects

Source and Target shortcuts

Mapplets

Reusable transformation

Support for more transformations

Stored Procedure

Create multiple pipelines in a mapping

5


6/22

Session / Workflow Generation Wizard

1. Specify Integration Service

2. Specify Connection Information.

Note: Connection variables are notsupported

6


7/22

Session / Workflow Generation

Click Configure to fine tune individualproperties if needed

7


8/22

Shortcuts Usage Scenario

DI Developer createsSource and TargetShortcuts in the PC folder

Step 2

DI Architect createsData Replicationpattern in Visio

Step 1

DI Developer uses the

8

shortcuts in ImportMapping Template Wizard

Step 3

Generated Mapping


9/22

Create multiple pipelines in a mapping

9


10/22

Create multiple pipelines in a mappingExample Generated Mapping

10


11/22

Installation and Upgrade

New Installation

PowerCenter Client installation automatically installs the

Mapping Architect for Visio Plugin

Upgrade from older versions

User will be given two choices Skip or Install

Skip will skip the MAV plugin and continue with thePowerCenter Client installation

Install will uninstall the old version and install the new versionof the plugin

11


12/22

Troubleshooting

Reason for failure is displayed in the wizard

More detailed error messages is also captured inmapgen.log

Mapgen.log gets created in the same directory as yourtemplate XML file.

12


13/22

Pre-defined templates and wizards

Pre-defined templates and wizards built using the metadatadriven framework

Wizards for common data integration patterns Slowly Changing Dimension (10 templates for Type1, Type2,

Type3)

Incremental load (2 templates)

Removing Duplicates (1 template)

Mappings can be generated using the wizard or the commandline function mapgen

Pre-defined templates (XML format) are available in{Informatica Installation Dir}\client\bin\templates

13


14/22

Pre-defined templates and wizards

14


15/22

Incremental Load Wizard

Generate mappings forhandling IncrementalLoad logic

Types of Incremental Load

Use Session Timestamp -Extracts incremental rowsfrom last load

Use Time Period Extractsincremental rows from thelast time period (eg., Sysdate

1)

15

I l L d M i


16/22

Incremental Load MappingExample From Last Load

Source Filter:UPDATE_DS > '$$INCREMENT_TS'

Source Qualifier Extracts incremental data

Expression Sets session variable to the session run time

16


17/22

Remove Duplicates Wizard

Wizard to automatically generate mappings forremoving the duplicate source rows

Key Fields foridentifyingduplicate records

17


18/22

Remove Duplicates Mapping

Sorter - Sorts based on the key fields for de-duplication

Aggregator Returns the last record for each group

18


19/22

Slowly Changing Dimension Wizard

Wizard to automatically generate mappings for handling SlowlyChanging Dimension logic

Support for different types of Slowly Changing Dimension Type 1

Type 2 - Effective Date, Current Flag and Version Number

Type 3

Two options for every SCD type

Dynamic changes (Mapping uses dynamic lookup)

Static changes (Mapping uses Static lookup, Pushdown-able)

19


20/22

SCD Wizard Features

Metadata-driven wizard, customizable without coding

Wizard enhancements Options for using static or dynamic lookup

Use an existing target table

Incremental extract condition

Options for providing default end date. For eg., 12/31/9999 instead of NULL

Mapping enhancements Dynamic lookup can handle multiple attribute changes

Uses dynamic lookup capabilities for detecting changes Mapping with static lookup pushdown-able

Routers instead of Filters

Lookup fetches only the latest row improving the performance

Less complex and more efficient mapping

SCD wizard addresses Insert and Update scenarios, does not address Deletescenario

20


21/22

Slowly Changing Dimension Template

21


22/22

For more information

Mapping Architect for Visio User Guide

DEMO

22

TMO Visio Integration Architect_Seattle IUG

Documents

Transcript of TMO Visio Integration Architect_Seattle IUG