A Conversion from Oracle to Netezza From

the Perspective of the Company’s SAS Users June 19, 2015

Andrew T. KuligowskiManager – CRM

Infrastructure & Reporting

Introduction

Introduction

• Introduction

• What needs to be changed?

– How many / which routines are affected

– How many / which file(s) are queried in each routine?

– Ad hocs vs. production routines / regularly executed vs. on demand

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

• Process improvements

– Comparing run times – Oracle vs. Netezza

Introduction

• Process improvements (continued)

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

• Conclusion

• What needs to be changed?

What needs to be changed?

• What needs to be changed?

– How many / which routines are affected

– How many / which file(s) are queried in each routine?

– Ad hocs vs. production routines / regularly executed vs. on demand

What needs to be changed?

• What needs to be changed?

– How many / which routines are affected

– How many / which file(s) are queried in each routine?

– Ad hocs vs. production routines / regularly executed vs. on demand

What needs to be changed?

• What needs to be changed?

– How many / which routines are affected

– How many / which file(s) are queried in each routine?

– Ad hocs vs. production routines / regularly executed vs. on demand

What needs to be changed?

• What needs to be changed?

– How many / which routines are affected

– How many / which file(s) are queried in each routine?

– Ad hocs vs. production routines / regularly executed vs. on demand

120+ Production Routines

80 in regular use

NOTE: DO NOT WORRY ABOUT THE OTHERS

NOTE: IN FACT, KILL THE ONES YOU CAN GET AWAY WITH KILLING!!

64 perform one or more database queries. NOTE: We can ignore the others.

39 use “the main query” – further analysis needed.

Implement the changes

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Implement the changes

• Implement the changes

– Macro vs. Hard-coding

– Tracking progress

Process improvements

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

– Comparing run times – Oracle vs. Netezza

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

–

• Now what???

– Report to my manager. And his manager. AND …

– Report to IT. And my IT contact’s manager. AND …

– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.

– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

–

• Now what???

– Report to my manager. And his manager. AND …

– Report to IT. And my IT contact’s manager. AND …

– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.

– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

–

• Now what???

– Report to my manager. And his manager. AND …

– Report to IT. And my IT contact’s manager. AND …

– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.

– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

–

• Now what???

– Report to my manager. And his manager. AND …

– Report to IT. And my IT contact’s manager. AND …

– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.

– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

–

• Now what???

– Report to my manager. And his manager. AND …

– Report to IT. And my IT contact’s manager. AND …

– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.

– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!

• Useful Options

– BL_USE_PIPE=YES (default for Netezza) or NO (default for Oracle)Use a named pipe to transfer data between Netezza and SAS/Access

– BULKUNLOAD=YES or NO (default)Calls the Netezza Remote External Table Interface[There is a parallel BULKLOAD option.]

SO WHY DIDN’T THEY WORK – AND, IN FACT, MADE THINGS MUCH WORSE??

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

–

• Now what???

– Report to my manager. And his manager. AND …

– Report to IT. And my IT contact’s manager. AND …

– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.

– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!

• Useful Options

– BL_USE_PIPE=YES (default for Netezza) or NO (default for Oracle)Use a named pipe to transfer data between Netezza and SAS/Access

– BULKUNLOAD=YES or NO (default)Calls the Netezza Remote External Table Interface[There is a parallel BULKLOAD option.]

SO WHY DIDN’T THEY WORK – AND, IN FACT, MADE THINGS MUCH WORSE??

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

–

• Now what???

– Report to my manager. And his manager. AND …

– Report to IT. And my IT contact’s manager. AND …

– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.

– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!

• Useful Options

– BL_USE_PIPE=YES (default for Netezza) or NO (default for Oracle)Use a named pipe to transfer data between Netezza and SAS/Access

– BULKUNLOAD=YES or NO (default)Calls the Netezza Remote External Table Interface[There is a parallel BULKLOAD option.]

SO WHY DIDN’T THEY WORK – AND, IN FACT, MADE THINGS MUCH WORSE??

Netezza SAS

Process improvements

• Process improvements

– Comparing run times – Oracle vs. Netezza

– HOLY <expletive> !!

– Figure out what’s going on … and fix it.

–

• Now what???

– Report to my manager. And his manager. AND …

– Report to IT. And my IT contact’s manager. AND …

– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.

– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!

libname temp netezza database=&Ntzdb. user=&user. password=&password. server=&server. direct_sql=yes BULKUNLOAD=YES connection=global dbcommit=0 dbmstemp=yes;

Netezza SAS

Conclusion

Conclusion

• Have a plan … Follow your plan … be prepared … yada, yada, yada …

• “Transparent to the user” usually translates to “BOHICA”

• Improvements still Work in Progress