CIF - PowerEdddxchange Training-1

download CIF - PowerEdddxchange Training-1

of 70

Transcript of CIF - PowerEdddxchange Training-1

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    1/70

     Training | CIF CONSULT | Redouane BELBAHRI

    InformaticaInformatica

    PowerEc!ange "#$PowerEc!ange "#$

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    2/70

    Agenda

    Objectives What is PowerExchange How Does the Team typically use PWX Power Exchange Batch rchitecture !eal Examples

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    3/70

    gen"a

    1 Objectives

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    4/70

    gen"a

    This course explains what PowerExchange is an" how

    use"# We will learn the rchitetue $batch% o& PowerEan" the (ey components

     – Unde%tand t!e PowerEc!ange Arc!itecture

     – &e%cri'e How P($ &atama)% are u%ed and w!ere t!e* are %tored

     – Create a 'a%ic &atama) in t!e P($ Na+igator ,UI

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    5/70

    gen"a

    2 What is PowerExchange

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    6/70

    gen"a

    Power Exchange $PWX% is a tool we use to parse coman" pull them into Designer#

     – Power Ec!ange -P($. i% com)ri%ed of / main com)onent%

    C!ange &ata Ca)ture 0 A11ow% *ou to monitor and retrie+e c!ange% t!at !data in w!ic! *ou !a+e e)re%%ed an intere%t#

    &ata 2a)% 0 U%ed to acce%% data %ource% 1i3e I2S data'a%e%4 5SA2 61e% a

    Per%ona1 2etadata 8 A11ow% *ou to 'row%e meta data from remote data'a

    Remark: Change Data Capture (CDC) and Personal Metadata are out of scope in this presentation

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    7/70

    PowerExchangeBatch Platforms

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    8/70

    PowerExchange Change Capture (CDC)

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    9/70

    gen"a

    3 How Does the eam t!"ica##! $se PW%

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    10/70

    How Does the Team typically use PWX

    *omplex +lat +ile Parsing

     – Com)1e co)*'oo3% wit! mu1ti)1e record t*)e%

     – Creating mu1ti)1e record% out of occur% de)ending on or '1owing t!fu11 range of t!e occur%

    ,eri&ying that the layout is correct with a row test

     – &ata from t!e row te%t can 'e co)ied into a tet 61e and t!en im)oa% a comma de1imited 61e#

    -a(ing sure that the input "ata can be seen correc

     – Interaction wit! Power Center Pulling .ources an" Targets set up with PWX into /

    Designer

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    11/70

    When to 0se Power*enter

    Power*enter supports only )xe" wi"th)les'/n&ormatica ,.- rea"er "oes not supportvariable length )le#

     – T!i% 61e i% read u%ing a PowerCenterNorma1i9er tran%formation#

    Power*enter "oes not support the Occurs

    Depen"ing On clause#Power*enter supports comp' comp12' comp13 an"comp1x )el"s#

    When to use PWX

    When to 0se PowerExch

    However' PowerExchango& rea"ing the variable le

     – In PowerEc!ange cma) for t!e 5SA2 6im)orting t!e COBO

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    12/70

    gen"a

    & Power Exchange 'atch Architect$re How Does PWX wor(4

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    13/70

    Where PW% is insta##ed (

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    14/70

    /n&ormatica PowerExchangeDesign Time - Batch Architecture

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    15/70

    PowerExchange *D* rchitecture)or Orac#e (option available at AXA) PowerExchange Change Data Capture (CDC) works in conjunction with Powe

    changes to data in source tables and replicate those changes to target tables

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    16/70

    Tra"itional -etho"s &or -oving Data

    Multiple manual steps for each source database 

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    17/70

    PowerExchange pproach

    5o Programming' 5o /nterme"iate +iles Data extracte" with .67' converte" an" )ltere"

    7oa"e" to target in memory !estart an" !ecovery integration with Power*ente

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    18/70

    Datamap "e)nes meta"ata

     – For non8re1ationa1 data'a%e%4 need to de6ne metadata

     – Contain% a11 information regarding t!e under1*ing data%et *reate" &rom existing in&ormation

     – 5SA2 0 co)*'oo3%

     – I2S 0 &B&%4 t!en o+er1a* %egment co)*'oo3%

     – A&ABAS 0 F&T

     – I&2S 0 %c!ema% +lattens out hierarchical or multi1recor" type "ata .tore" on the same plat&orm as the "ata 5ot nee"e" &or relational sources Provi"es the in&ormation to convert an .67 statem

    actual "ata base re8uests

    What is a Datamap (

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    19/70

    Where is the Datamap store"4

    .ource version o& "atamap is store" on win"ows mwhere create"

     – &atama)% fo1der4 -dm) 61e on window%. !un time version is store" with the PWX so&tware o

    source "ata machine

     – &atama)% fo1der4 -dm) 61e t*)e on window%.

     – In%ta11#1i'#&ATA2APS %e:uentia1 61e on 25S

     – Stdatama)% 1i' on AS;

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    20/70

    Different t!pes of data and where the! are stored

    The :compile": version o& the "ata map' in this case;test#EB*D/*#"mx: is store" in the :"atamaps: &ol"e

    un"er the pro"uct install "irectory on the system wbe use" by the pro"uct to access the "ata# /t is sensee a message in 5avigator that says that in&ormatbe sent to the :remote system: in or"er to retrieve

    There is also a loc( )le &or the customer "ata map#

    :customer#lc(: an" is also store" in the .hare" &ol"eto seriali

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    21/70

    *on)guration +ile

    *on)guration +ile

     – Set% man* defau1t% )arameter% for PowerEc!ange

     – Pro+ide %ecurit* %etting%

     – Communication Setting% *on)g +ile *ommunication Params=

    7/.TE5E! Node Name  TCPIP -%tandard )arm. Port Num'er

    5ODE Node name  TCPIP -%tandard )arm Ho%t Name or IP addre%% Port Num'er

    +am"#e dbmover*c,g ,i#e

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    22/70

    What is a 7istener4

    PowerExchange tas( that accept re8uests &or "at 0ses an /P a""ress an" Port 5umber

    *an listen on multiple Port numbers at the same ti *an have multiple listeners running $on uni8ue /P a Only nee"e" on remote plat&orms &or access to bat lso use" &or connecting to remote PowerExchange

    creating "atamaps an" *apture !egistrations

    7i Ph li

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    23/70

    7istener > Phone lineEasy way to remember  The 7istener is the e8uivalent o& the phone number that "e)nes a number' whitch is the /

    once turne" on can be calle" &rom other places#

    5 " "" B ( 5 b

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    24/70

    5o"e > ""ress Boo( 5umbers Easy way to remember 

    "ode state#ent gi$es all the a$ailable nu#bers we can call fro# this locat

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    25/70

    7istener an" 5o"e Example

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    26/70

    gen"a

    - Rea# Exam"#es

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    27/70

    Eam)1e%

    ?# +ixe" 7ength +ile@# ,ariable 7ength +ile

    2# ,ariable 7ength +ile with multiple recor" types

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    28/70

    *onnection to PWX 5avigator

    +rom the Tas(bar

    Des(top icon

    =

    =

    Connection toPowerExchangeclient tool 

    5ote> No need to u%e a Login and )a%%word

    ?  AccesHomepage

    %&

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    29/70

    Eam)1e = 0 Fied 1engt! 5SA2 61e

    *reate Data -ap that convert an EB*D/* )le to .*&ormat=

     – Add a &ata 2a) – Fi11 in t!e Sc!ema name and t!e &ata 2a) Name

     – In%ert t!e In)ut Fi1e name and it@% 1ocation on t!e %er+er4 Se1ect t!ec!ange t!e defau1t 1ine to EBC&IC IB28=

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    30/70

    Prepare the *obol )le structure

    1. The Cobol file structure you are being to use should not contains the header informations, if not later you willhave this error 

    Rem

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    31/70

     Add a data map

     Right click on the data map folder to add a data map.

    Fill in the Schema Name and the Data ap

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    32/70

    Fill in the Schema Name and the Data apName

    1. Fill in the Schema ame and the !ata "ap ame

     #.  $ccess "ethod% S&' (for Flat file)

    *. Click ne+t 

    Data ap Properties

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    33/70

    Data ap PropertiesLocation and type of copybook that you want to import.

    1. nsert the file name (data file) that the map will need to read in nformatica

      (this file will be on the server). 

    1. Select fi+ed or variable depending on the type of file.

     #. n the Si-e bo+, enter the record length ( if not known give 1 as si-e, will correct later  ).

    *. The screen print above is for a fi+ed file only.

    . Click Finish

    C # $ S il

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    34/70

    1. &nter information about the location and type of metadata that you want to import.

     #. Click e+t 

    !mport Cop"#oo$ % So&rce Details

    Column Range%

    &nter the start and end column range for the copybook%

    Source%

    /ocal. The copybook is located on the 0ower&+change a

    Remote. The copybook is located on a remote system. 

    ! t C # $ ' l C # l D t il

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    35/70

    1. Tell 0ower&+change where you have your copybook located on your 0C 

     #. Click ne+t.

    !mport Cop"#oo$ % 'ocal Co#ol Details

    ! t C # $ C ( ti D t il

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    36/70

    1. Click Finish

    !mport Cop"#oo$ % Con(g&ration Details

    ! t C # $ ! f ti

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    37/70

    !mport Cop"#oo$ !nformation

    1. Click 2 

    )ecord De(nition

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    38/70

    )ecord De(nition

    1. Click 2 

    Add a data map

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    39/70

     Add a data mapPhysical denition mapped to the relational denition

    &ecord

    'able

    1. Click 2 

    Add a data map *E+CD!C,

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    40/70

     Add a data map *E+CD!C,

    1. Click Close

     #. "ake a note of the file actual length

    *. Click yes

    Add a data map *E+CD!C,

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    41/70

     Add a data map *E+CD!C,

    1. Right click on Test.&3C!C in the resource e+plorer (!ata "ap) and select properties.

     #. Select the S&' $ccess "ethod Tab and change the length to *45.

    *hec( the *reate" Data map

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    42/70

    pEdit Resource Conguration A PowerExchange .avigator reso$rce con,ig$ration de,ines the #ocation o, data ma"s/ "ersona# metadata "ro,i#es/and an! #oca

    registrations and extraction ma"s*

    .ote0 ou cannot edit the resource configuration if a PowerExchange resource is open

       

     Add a data map *E+CD!C,

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    43/70

    Example with Occurs

    .en" "ata map to 5o"e

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    44/70

    .en" "ata map to 5o"e

     

     

     

    ee db#o$ercfg on the lo

    Per&orm a !ow Test $?A2%

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    45/70

    Per&orm a !ow Test $?A2%

    . !elect the "able and Click Row "est 

    #. $n the %atabase Row "est dialog box select N)D+ &'onrelational data source (

    ). Enter the name of the le in the O*erride +ile 'ame box &le should be in the ser*er(

    ,. Click -o

     

    Per&orm a !ow Test $@A2%

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    46/70

    Per&orm a !ow Test $@A2%

    Per&orm a !ow Testl i h $ %

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    47/70

    Example with Occurs $2A2%

    *reate" "atamap on the integration .erver

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    48/70

    *reate" "atamap on the integration .erver

    /mport the create" "mx as "atamap

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    49/70

    /mport the create" "mx as "atamap

     

     

    /mport the source into Power*enterD i

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    50/70

    Designer

    1. 6o into nformatica designer and open the Source $naly-er.

     #. Select Sources and then Select mport from 0ower&+change.

    m"ort the so$rce into Powerenter Designer

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    51/70

    1. Select the /ocation% node!&7 

     #. Select Source Type% S&'

    *. Select "ulti8Record !atamaps.

    . Click connect.

    " g

    It doe%n@t rea11* matter if t!erecord 'o i% c!ec3ed un1e%%tru1* !a+e mu1ti8record datam

    List of nodes on the dbmove

    local machine

    m"ort the so$rce into Powerenter Designer

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    52/70

    1. Select the data map that you want to import from 09:

     #. Click ok

    " g

    m"ort the so$rce into Powerenter Designer

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    53/70

    " g

    etadata Extensions

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    54/70

    Note !ere4 t!ere i% a 2etadata Eten%ion created automati:ua11* in t!e %ourc5SA2#

    4se the +o$rce in a ma""ing

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    55/70

    4se the +o$rce in a ma""ing!ith "ccurs

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    56/70

    !ith "ccurs

    reate new onnection ,or PW%

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    57/70

    1. n the 9orkflow manager, create new $pplication Connection to use in the session,

     #. Choose 09: R!3 3atch

    *. Click 2 

    reate new onnection ,or PW%

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    58/70

    1. n the 9orkflow manager, create new $pplication Connection to use in the session,

     #. Choose 09: R!3 3atch

    *. Choose Code 0age% 3"15; 

    . Click 2 

    Server location: dbmover.cfg

    P +ession r$ns

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    59/70

    1. 9hen the 0C session runs, it would talk to the 09: /istener on the ntegration Server, and the 09: /iste

    would open the file, read it, and send the data to the 0owerCenter session

    *reating a Data map!hat #e have done

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    60/70

    !hat #e have done

    &ATA2APSTraining#EBC&IC#dm)

    Exa#ple * – +ariable ,ength +-M file

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    61/70

    Coming

    %oon

    ,ariable 7ength ,.- examples

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    62/70

    Exam"#e 1A 5+A data set consists o, two record t!"es o, di,,erent #engths disting$ished b! the va#$e in a ,ie#d that is in the same # ocation in both record t!"es*

    'e#ow is a sam"#e O'O6 co"!book o, the records de,inition0

      715+A5AR8RE1*

      17 9E:8)E6DP %;2

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    63/70

    0pgra"e or -igrate Datamaps across"ierent plat&orms using PowerExchange

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    64/70

    p g g5avigator

      

     

     T!e datama)% wi11 %!ow in *our Na+igator datama)% windowand t!e .dmp 61e% wi11 'e created in t!e Loca1 Pat!#

    im)ort t!e datama)% t!at *ou want to migrate#

     

    Co)* t!e #dm) 61e% to t!eLoca1 Pat! for *our new PowerEc!

    Sa+e eac! datama) in t!e new Na+igator en+ironment>

    *on)gure a PowerExchange Datamap to replaceinvali" pac( "ata with

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    65/70

     To re)1ace in+a1id )ac3 data wit! 9ero% ena'1e &ata C!ecPowerEc!ange &atama) Pro)ertie%#

    . Click the Data Checking tab

    * elect the Packed Data /ield option0 elect &eplace according to Data Defaults fro# the 1ow do !ou want to 1andle bad /ield Data2 3o to the Data Defaults tab4 elect -ll or ingle Character under Character &eplace#ent5 Enter 676 (8ero) in +alue  'his will replace all in$alid packed Data fields with 8eros

       

    *on)gure a PowerExchange Datamap toretain recor" values o& ba" "ata

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    66/70

    I% it )o%%i'1e to etract t!e record% or 6nd t!e record infow!ere w!ic! get% %3i))ed a% 'ad data4 %o t!at we can re%end it to our concerned team and ma3e %ure t!at we do

    'ad data in t!e %ource 61e#'o retain records with bad data in the source file do the following:

    . elect the Data Checking option in the Data#ap properties* elect 9kip row and write log file #sg9 under the 1ow do !ou want to handle ad /ield Data; list '

    records with bad data and writes the record to the PowerExchange ,istener Detail log0 Clear the uppress Data ,ogging to retain the record

    ,.-

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    67/70

    5SA2 %tand% for 5irtua1 Storage Acce%% 2et!od# It i% a memanaging 61e% t!at i% u%ed main1* on mainframe% 'ut a1%S)eci6ca11*4 5SA2 can %)eed u) acce%% to 61e data '* u%

    inde of record% a))ended to 61e%# T!i% inde i% ca11ed a B

    5SA2 i% a 3ind of record8oriented 61e %*%tem# In t!i% 3indinformation i% %tored a% a co11ection of record%# 5SA2 recoan* 1engt! t!e* need not 'e of one %et 1engt!# T!e* are4organi9ed into '1oc3% ca11ed Contro1 Inter+a1%4 w!ic! are m'*te%# T!e%e Contro1 Inter+a1% are furt!er organi9ed into Cw!ic! are mea%ured in muc! 1arger unit%#

    Overri"ing *onnection ttributes in theParameter +ile

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    68/70

    If *ou u%e a %e%%ion )arameter to de6ne a connection fortarget4 *ou can o+erride t!e connection attri'ute% in t!e 61e# U%e t!e FTPConnectionName4 GueueConnectionNa

    LoaderConnectionName4 or A))ConnectionName %e%%i

    (!en *ou in%ta11 PowerCenter4 t!e in%ta11ation )rogram ctem)1ate 61e named ConnectionParam#)rm t!at 1i%t% t!e attri'ute% *ou can o+erride for FTP4 :ueue4 1oader4 and a)connection%# T!e ConnectionParam#)rm 61e i% 1ocated in t

    director*>?ser$er?bin

    4PA9ED )ie#ds

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    69/70

    )or the 4PA9ED )ie#ds* n the o$t"$t/ we ex"ect sign as >)? inste

    coming as >?* his was an iss$e in the con,ig$ration settings* o

    need to add the ,o##owing setting in dbmover*c,g ,i#e*

    "@ME&=C=3"A/

    Man! 'hanks for !ou ti#e toda!B

  • 8/18/2019 CIF - PowerEdddxchange Training-1

    70/70