Infa PWX Oraclecdc

download Infa PWX Oraclecdc

of 18

Transcript of Infa PWX Oraclecdc

  • 7/21/2019 Infa PWX Oraclecdc

    1/18

    1

    Dan SmithPrincipal Subject Matter Expert

    May 2012

    PowerExchange CDC for Oracle:

    LogMiner vs. Express

  • 7/21/2019 Infa PWX Oraclecdc

    2/18

    2

    PowerExchange CDC for Oracle

    Two PowerExchange Oracle CDC products:

    PWX LogMiner CDC

    PWX Express CDC

    Architecture Comparison Feature Comparison

    Short Term Roadmap

  • 7/21/2019 Infa PWX Oraclecdc

    3/18

    3

    PowerExchange CDC for Oracle:

    Two Products

  • 7/21/2019 Infa PWX Oraclecdc

    4/18

    4

    PowerExchange CDC for Oracle PowerExchange LogMiner CDC for Oracle

    Traditional PWX Oracle CDC

    Can handle 6-8 GB / hour of Oracle Archive Log

    Single Threaded: will use at most 1 CPU

    Leverages Oracles LogMiner utility

    Subject to LogMiner bugs and disconnects

    Strongly recommend running PWXCCL (PWX Logger for LUW)

    Is included in the base price of PWX CDC for Oracle

  • 7/21/2019 Infa PWX Oraclecdc

    5/18

    5

    PowerExchange CDC for Oracle PowerExchange Express CDC for Oracle

    Replaces the LogMiner part of the product with a new Log

    Reader developed by Informatica 10x faster than PWX LogMiner CDC for Oracle

    Multi-threaded, will take advantage of multiple CPU (New!)

    Developed & Supported by Informatica PWX R&D

    Installs the same way, uses the same registrations, except.

    If you want to capture ROWID (New!), then tables must be re-registered.

    A cold start is required if upgrading from PWX LogMiner CDC

    Uses PWXCCL (the PWX Logger for Linux, UNIX, & Windows)

    Can not run in the same PWX instance as PWX LogMiner CDC

    Is included in the base price of PWX CDC for Oracle

  • 7/21/2019 Infa PWX Oraclecdc

    6/18

    6

    PowerExchange CDC for Oracle:

    Architecture Comparison

  • 7/21/2019 Infa PWX Oraclecdc

    7/18

    7

    Data Integration

    Platform

    Operating Environment

    PowerExchangeOracle Instance

    RegistrationData Maps

    Continuous Extraction of changes

    Architecture for Oracle using PWX LogMiner CDC 9.x

    PowerCenter

    DataRecords

    SQL

    PWXListe

    ner

    PowerExchange Logger

    Col

    lector

    Oracle

    OracleLogs

    LogMiner

    CheckpointFiles CND

    Files

  • 7/21/2019 Infa PWX Oraclecdc

    8/18

    8

    Data Integration

    Platform

    Operating Environment (PWX resides on Oracle Server)

    Oracle Server

    RegistrationsData Maps

    Continuous Extraction of changes

    Architecture for Oracle using PWX Express CDC 9.1.2

    PowerCenter

    DataRecords

    SQL

    PWXListe

    ner

    PowerExchange Logger

    Col

    lector

    Oracle

    OracleLogs

    CheckpointFiles CND

    Files

    Log

    Reader

  • 7/21/2019 Infa PWX Oraclecdc

    9/18

    9

    Data Integration

    Platform

    Operating Environment (PWX not on DB server)

    PowerExchange ServerOracle

    Server

    RegistrationsData Maps

    Continuous Extraction of changesArchitecture for Oracle ASM using PWX Express CDC 9.1.2

    PowerCenter

    DataRecords

    SQL

    Listener

    PowerExchange Logger

    Collector

    Oracle

    Oracle

    Logs

    CheckpointFiles Logger

    Files

    Log

    Reader

    ASMCalls

  • 7/21/2019 Infa PWX Oraclecdc

    10/18

    10

    Data Integration

    Platform

    Operating Environment (PWX not on DB server)

    PowerExchange ServerOracle

    Server

    RegistrationsData Maps

    Continuous Extraction of changesArchitecture for Oracle Non-ASM using PWX Express CDC 9.1.2

    PowerCenter

    DataRecs

    SQL

    Listener

    PowerExchange Logger

    Col

    lector

    Oracle

    Oracle

    Logs

    CheckpointFiles Logger

    Files

    Log

    Reader

    Oracle

    Logs

    via NFS

  • 7/21/2019 Infa PWX Oraclecdc

    11/18

    11

    Data Integration

    Platform

    Operating Environment (PWX not on DB server)

    PowerExchange ServerOracle

    Server

    RegistrationsData Maps

    Continuous Extraction of changesArchitecture for Oracle Log Shipping using PWX Express CDC 9.5.1

    PowerCenter

    DataRecs

    SQL

    Listener

    PowerExchange Logger

    Col

    lector

    Oracle

    Oracle

    Logs

    CheckpointFiles Logger

    Files

    Log

    Reader

    Shipped

    Archive

    Logs

  • 7/21/2019 Infa PWX Oraclecdc

    12/18

    12

    PWX for Oracle CDC Comparisons

    PowerExchange

    Listener

    PWX LogMiner

    CDC

    Oracle

    Logs

    Transaction Server

    Oracle

    Logminer

    Hi Volume Transaction Server

    Oracle

    Logs

    Informatica

    LogRead

    APIPWX Express CDC

    Real-time change data capture and

    delivery with:

    Minimal Impact

    Low LatencyContinuous Data Delivery

    The main change to PWX Oracle CDC was to replace

    Oracle LogMiner with an Informatica written Log Reader

  • 7/21/2019 Infa PWX Oraclecdc

    13/18

    13

    PowerExchange CDC for Oracle:

    Feature Comparison

  • 7/21/2019 Infa PWX Oraclecdc

    14/18

    14

    Feature ComparisonAll Things Are Not Equal

    Feature Description LogMiner Express

    Can process over 8GB Archive logs per hour No Yes

    Supports RAC Yes Yes

    Supports ASM Yes Yes

    Supports V9 of Informatica Yes Yes

    Supports Index Organized Tables Yes No

    Supports Compression (Oracle tables/data) Yes No

    Supports Sorted Hash Cluster Columns Yes No

    Supports Transactional Data Encryption (TDE) Yes NoOracle Log Shipping No 9.5.1

  • 7/21/2019 Infa PWX Oraclecdc

    15/18

    15

    PowerExchange Express CDC for Oracle

    Short Term Roadmap

  • 7/21/2019 Infa PWX Oraclecdc

    16/18

    16

    PWX Express CDC for Oracle 9.1.2 -> 9.5.1Features by Version 9.1.2 9.1.2HF1 9.5 9.5.1

    Release Date: 8/2011 3/2012 6/2012 12/2012

    Integrated Restart/Recovery Management

    Integrated with Informaticas ETL platform Changes captured based on completed Units of Work

    Capture Changes once, Consume unlimited times

    Logger can run anywhere, and store changes anywhere

    Flexible configuration, run anywhere & communicate viaSQL*Net

    Faster, easier implementation (no LogMiner setup)

    Source data filtering at the lowest level

    Support PowerCenter/PowerExchange v9.1.0 HF1

    Support PowerCenter/PowerExchange v9.1.0 HF4

    Convergence to 9.5 release train

    Full PAM Support

    Archive_Only: Support Archive Log shipping

  • 7/21/2019 Infa PWX Oraclecdc

    17/18

    17

    PowerExchange Express CDC for Oracle:Release Timeline

    PWX Express 9.5

    June 2012

    Read archive logs shipped to a differentserver

    Integration into 9.5 Release train Complete PAM

    PWX Oracle CDC

    Beyond 9.5.1

    Performance and Feature Enhancements

    TBD based on competitive analysis and

    Customer Requirements

    PWX Express 9.1.2 HF1

    March 2012

    PWX Express bug fixes

    Support PC/PWX 9.1.0 HF4 Support Win64, z/Linux

    PWX Express 9.5.1

    December 2012

    Express 9.1.2

    August 2011

    Support PowerCenter/PWX 9.1.0 HF1

    Support RAC & ASM Support AIX, HP-UX, Linux, Solaris

  • 7/21/2019 Infa PWX Oraclecdc

    18/18

    18