EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by...

36
Ellucian ODS9.0 Upgrade Migrating from OWB to ODI Amir Saleem Centennial College May 17, 2017

Transcript of EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by...

Page 1: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Ellucian ODS9.0 UpgradeMigrating from OWB to ODI

Amir Saleem

Centennial College

May 17, 2017

Page 2: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Topicsu OWB Support

u Oracle Data Integrator (ODI)

u ODI Architecture

u Upgrade paths

u General Guideline for ODS infrastructure

u Upgrade of Oracle Warehouse Builder

u Oracle Data Integrator install and configuration

u Upgrade of ODS 8.5 to ODS 9.0

u Migrating OWB projects and maps to ODI

u Q&A and Contact Information

Page 3: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

OWB Support

u OWB was a free ETL tool distributed with Oracle Database Server Enterprise Edition

u Oracle has dropped the OWB from Oracle Database 12.x distribution but will support the 11.x OWB with 12.1 database server

u OWB will be not be supported once the Oracle Database 12.1 release has reached its End of Premier Support

Page 4: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Oracle Data Integrator (ODI)

u ODI is the ETL tool chosen by Ellucian to replace OWB

u This tool includes the full Application Suite to implement data integration solutions

u Products included in a full distribution are:

u Weblogic Application Server

u Oracle Data Integrator Studio

u ODI Master Repository and ODI Work Repository

u Sources and Targets (In our case Banner and ODS/EDW/DSR)

u Runtime Standalone Agent

Page 5: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Architecture

Page 6: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Architecture

Page 7: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Architecture

Page 8: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Upgrade Paths

u Install and setup ODS from scratch

u Recommended if you don’t have customization done to ODS

u Will be a clean install with no OWB objects and repository left in the database

u Upgrade the existing ODS environment

u If there are a lot of customization done then upgrade path can be taken

u Will have to cleanup OWB objects and repository after the upgrade is done

Page 9: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Centennial Infrastructure for ODS 9

Storage is EMC VNX-5200 with all SSD drives Oracle Sparc T5-8 machine 30 thick threaded virtual cores / 512G RAM for ODS server92 thick threaded virtual cores / 1TB RAM for Banner server38 thin threaded virtual cores / 64G RAM for Cognos server

Page 10: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Upgrade of Oracle Warehouse Builder

u For in-place upgrade to ODS 9.0 the OWB should be running out of the 11.2.0.4 with following patches

u OWB commulative patch # 17906774

u OWB oneoff patch # 21977765

u Make sure to run the OWB repository optimization from Warehouse Builder

u On Solaris/Linux environments AWT_TOOLKIT value should be set to Xtoolkitfor OWB to launch after upgrade to 11.2.0.4

Page 11: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Oracle Data Integrator install and configuration

u Make sure the Java 8 update 101 is installed

u Make directory /software/sworacle/odi/Middleware/odi12212

u Make sure that /usr/jdk/latest/bin/java -version return java 8

u /usr/jdk/jdk1.8.0_121/bin/java -jar fmw_12.2.1.2.6_odi.jar

Page 12: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Installation type

Page 13: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Repository Creation

u Make sure to set your JAVA_HOME variable and latest is pointing to the right version of JAVA

u export JAVA_HOME=/usr/jdk/instances/jdk1.8.0_121

u Change directory to $ODI_HOME/oracle_common/bin and run ./rcu

Page 14: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Repository Creation

Page 15: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Repository Creation

Page 16: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Repository Creation

Page 17: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Repository Creation

Page 18: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Repository Creation

Page 19: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Repository Creation

Page 20: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Repository Creation

Page 21: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Studio Configurationu To Configure ODI studio go to /software/sworacle/odi/Middleware/odi12212/odi/studio/bin and

edit odi.conf and set JavaHome=/usr/jdk/instances/jdk1.8.0_121

u Launch it using ./odi and click on File > New

Page 22: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODI Studio Configuration

Page 23: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Standalone Agent Deploymentu Goto /software/sworacle/odi/Middleware/odi12212/oracle_common/common/bin and

run ./config.sh

Page 24: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Standalone Agent Deployment

Page 25: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Standalone Agent Deployment

Page 26: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Standalone Agent Deployment

Page 27: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Standalone Agent Deployment

Page 28: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Standalone Agent Deployment

Page 29: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Standalone Agent Deployment

Page 30: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Standalone Agent Deployment

Page 31: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Standalone Agent Deployment

Page 32: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Defining Agent in the physical Topology

Page 33: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Finalize ODI Setupu Modify the ide.conf file in <ODI_HOME>\jdeveloper\ide\bin and change ‘-Xmx800M’

with ‘-Xmx4096M’u After Installation finishes start the agent from

$Middleware_Home/user_projects/domains/base_domain/bin using following command

nohup ./agent.sh -NAME=OracleDIAgent1 PORT=20910 &

u Create the setenv_odi for ODI environment setup in ~/bin folder of oracle user and it should like this:

u export JAVA_HOME=/usr/jdk/instances/jdk1.8.0_121

u export ODI_HOME=$YourPath/Middleware/odi12212

u export CLASSPATH=$CLASSPATH:$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$ODI_HOME/odi/sdk/lib/*:$ODI_HOME/oracle_common/modules/oracle.jps/*:$ODI_HOME/oracle_common/modules/oracle.jdbc/*:$ODI_HOME/oracle_common/modules/oracle.idm/*:$ODI_HOME/oracle_common/modules/oracle.nlsrtl/*:$ODI_HOME/oracle_common/modules/oracle.jmx/jmxspi.jar:$ODI_HOME/oracle_common/modules/javax.management.j2ee.jar

Page 34: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODS9.0 Upgradeu Set you environment to Banner DB

u Make sure you unlock your system account in BANNER DB and reset password to a known value

u Change you directory to /software/banupg/ods_edw/ods/ods90000u/banner/upgrade and modify login.sql to reflect your environment

u Run the change_password_before_upgrade.sql to change passwords of default accounts in BannerDB

u Run sqlplus /nolog @upgrade_login_test.sql

u Run sqlplus /nolog @odsstg_upgrade.sql

u Set you environment to ODS database

u Modify the login.sql in /software/banupg/ods_edw/ods/ods90000u/ods/upgrade to reflect your ODS environment

u Run the statement sqlplus /nolog @upgrade_login_test.sql

u Run the Rename_script_from_SCT_to_BL.sql as odsmgr

u Run sqlplus /nolog @ods_upgrade.sql

Page 35: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

ODS9.0 Upgradeu Run the following scripts for different modules

u sqlplus /nolog @general_etl_upgrade.sql

u sqlplus /nolog @finance_etl_upgrade.sql

u sqlplus /nolog @student_etl_upgrade.sql

u sqlplus /nolog @payroll_etl_upgrade.sql

u sqlplus /nolog @posnctl_etl_upgrade.sql

u Verify the environment by running sqlplus /nolog @gurutlrp.sql

u Copy SmartImport.jar and login.properties from ods/odi/java/ to <ODI_HOME>/odi/sdk/lib

u Move the non_licensed modules into subfolder in /software/banupg/ods_edw/ods/ods90000u/ods/odi/xml to Not_Licensed

u Use the method 2 from step 22.5 to import ODI metadata and run following command after modifyigthe login.properties files according to our environment

java -cp $CLASSPATH smartimport.SmartImport

**You will get errors that <Module.zip> file does not exist ignore that

u Run the script

u sqlplus /nolog @gurutlrp.sql

u sqlplus /nolog @warehouse_recompile_banner.sql

Page 36: EllucianODS9.0 Upgrade Migrating from OWB to ODI · PDF fileu ODI is the ETL tool chosen by Ellucianto replace OWB u This tool includes the full Application Suite to implement data

Q&A and Contact Information

Amir Saleem

Centennial College

[email protected]