Using Hot and Cold Data in your SAP Analytics Landscape

Using Hot and Cold Data in your SAP Analy5cs Landscape

Clint Vosloo (@vosloo777) – Manager Partner for ANZ (EV Technologies)

In this session..

•  Understand what database technology you can use in the SAP Real-‐Time Data PlaMorm to drive analy5cs

•  Benefit from hot/cold data storage to maximize your investments

•  Set up and configure Near-‐Line Storage for your SAP BW environment using SAP Sybase IQ

•  Understand Extended Tables in your BW Environment •  Take advantage of SAP’s new Smart Data Access using SAP

Sybase IQ and SAP HANA and Calcula5on Views– just released in SP7

What we will Cover

SAP Real-‐Time Data PlaMorm Near-‐Line Storage for SAP BW using SAP Sybase IQ Using Extended Tables in your BW on HANA Environment SAP Smart Data Access with SAP HANA and SAP Sybase IQ Wrap-‐up

SAP’s Real-Time Data Platform

Hadoop as a DWH by Gartner

Guinness Book World Record •  Benchmark done with SAP Sybase IQ 16 •  Loaded 34.3 TB of data per hour (Over double the previous

record of 14 TB per hour) •  Equates to 823 TB per day and 5.7 PB per week •  In printed macer, Sybase IQ could load the en5re collec5on of

the Library of Congress in under 35 minutes •  One petabyte is approximately 13.3 years of HD TV content,

meaning Sybase IQ could load and analyze 76 years worth of True Blood episodes per week

•  *** Valid as of April 2013 ***

Guinness Book World Record •  Benchmark done with SAP HANA SPS07 SAP IQ 16 •  12.1 PB Data Warehouse •  Combina5on of SAP HANA and SAP IQ – Using Smart Data

Access to Federate queries •  4 to 1 compression ra5o •  12 000 5mes the US Library of Congress Stored (10 TB) •  ** Valid as of March 2014 **

SAP IQ vs SQL Server

Sybase IQ SQL Server Free Edi5on Free

11 469 MBs Raw Data Size 5 427 MBs 123 534 969 Rows Loaded 63 558 180 4 966 MBs Database Size 9 216 MBs 230,95 % Compression % 58,89 %

72,5 seconds Ave Query Run Time Speed 159,4 seconds

* SAP Sybase IQ was on average 580% faster! ** No CPUs were harmed during this benchmark…

SAP BW – Current State

SAP BW – Large Data Volumes

5 TB

SAP BW – HANA Solution

1 TB

What we will Cover


SAP BW – NLS (7.3 SP09)

1 TB 1 TB

SAP BW – NLS with HANA

1 TB 200MB

Setting Up BW NLS with SAP Sybase IQ

•  Step 1: Install SAP Sybase IQ Drivers on the BW system •  Step 2: Set up a secondary database connec5on in SAP BW

–  Transac5on code DBCO

Setting Up BW NLS with SAP Sybase IQ (cont.)

•  Step 3: Install all the SAP Notes/Patches men5oned in documenta5on (20 at 5me of comple5ng the work)

•  Step 4: Set up a Near-‐Line Storage Connec5on –  BW Code RSA1

•  Administra5on ª Current Semngs ª Near-‐Line Storage Connec5ons

Setting Up BW NLS with SAP Sybase IQ (cont.)

•  Step 5: Set up the object (either DSO or InfoCube) for NLS –  Specify a Selec5on Profile (date-‐based, transac5on code, etc.)

•  Step 6: Kick off Near-‐Line Storage –  Click on “Manage” for the Object that you want to archive –  Go to the Archiving Tab –  Create an Archiving Request

•  Push “Archive in the Background” •  SAP First Guidance — SAP NLS Solu5on with Sybase IQ

–  www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/301395ac-‐c476-‐3010-‐1d84-‐802a2f12f530?QuickLink=index&overridelayout=true&58540404284044

•  SAP NetWeaver® BW Near Line Storage solu5on (NLS) based on Sybase IQ –  hcp://scn.sap.com/docs/DOC-‐39944

Live Demo – NLS with IQ

•  Benchmark Queries from SAP BW •  Run Compara5ve Queries Directly from SAP Sybase IQ

What we will Cover


SAP BW – Extended Tables

** Image from SAP

•  BW 7.4 SP 5 •  HANA SPS07 •  SAP IQ 16 SP2 •  Only GA Q4 2014

What we will Cover


Smart Data Access (SDA)

** Image from SAP

SDA on Amazon AWS Step 1: Configure PuTTY to talk to Amazon Instance

hcp://docs.aws.amazon.com/AWSEC2/latest/UserGuide/pucy.html

Remember to load the KeyPair file through PucyGen first Step 1a: Set up DynDNS on HANA Amazon Instance

hcp://scn.sap.com/community/hana-‐in-‐memory/blog/2013/07/26/using-‐dynamic-‐dns-‐with-‐amazon-‐ec2-‐and-‐hana-‐development-‐edi5on

This requires a DynDNS account and assumes you are using an Amazon hosted instance of HANA running on Linux

SDA on Amazon AWS Step 2: Download SAP Sybase IQ Driver from SAP Service Market Place

§  hcps://websmp206.sap-‐ag.de/support § Requires login creden5als to the SAP Service Marketplace for SMP with correct access rights

SDA on Amazon AWS Step 3: FTP the SAP Sybase IQ ODBC driver files to your Amazon SAP HANA Server using FTP Client of choice

§  Remember to add your Amazon .pem file to the SFTP sec5on in semngs

§  Look out for SAP NOTE for more detailed informa5on for Sybase ASE and TerraData

Step 4: Install the Sybase IQ Drivers on your SAP HANA system Step 5: Set up a SAP Sybase IQ DSN entry in the ODBC.ini file

§  Make sure that unixODBC is installed on your Linux server § www.linuxfromscratch.org/blfs/view/svn/general/unixodbc.html

SDA on Amazon AWS

Step 6: In SAP HANA Studio, create a new Remote Data Source Connec5on

SDA on Amazon AWS

Step 7: Add a virtual table in remote system

SDA – Live Demo

•  Configura5on Overview •  Crea5ng Virtual Tables •  Running Queries •  Reviewing Performance Sta5s5cs

What we will Cover

SAP Real-‐Time Data PlaMorm Near-‐Line Storage for SAP BW using SAP Sybase IQ SAP Smart Data Access with SAP HANA and SAP Sybase IQ Wrap-‐up

More Information

•  “Semng up BW Near-‐Line Storage with SAP Sybase IQ” (Diversified Seman5c Layer) hcp://dslayer.net/vlayer/view/219-‐semng-‐up-‐bw-‐near-‐line-‐storage-‐with-‐sap-‐sybase-‐iq

•  Clint Vosloo, “SAP’s big play in the EDW Space – But does any-‐one know about it?” (SAP SCN, April 2013). hcp://scn.sap.com/people/clint.vosloo/blog/2013/04/30/saps-‐big-‐play-‐in-‐the-‐edw-‐space-‐-‐but-‐does-‐any-‐one-‐know-‐about-‐it

•  Official Product Tutorials – SAP BI Suite (SCN). hcp://scn.sap.com/docs/DOC-‐7725

•  DSLayerd Podcast on SAP BusinessObjects Analy5cs Bundles hcp://dslayer.net/dslayer/view/202-‐bundles-‐of-‐sap-‐joy

More Information

•  SAP HANA and SAP IQ Guinness Book World Record •  hcp://www.saphana.com/community/blogs/blog/

2014/03/05/guinness-‐world-‐record-‐-‐largest-‐data-‐warehouse

•  SAP HANA Academy Tutorials (YouTube) •  HANA Academy: Smart Data Access – Connec5ng to Sybase

IQ 16 •  www.youtube.com/watch?v=SVTt0T3yfO8

•  HANA Academy: Smart Data Access using Sybase IQ 16 •  www.youtube.com/watch?v=cEkzgQVnfwg

•  Timo Ellioc’s Blog on Hadoop •  hcp://5moellioc.com/blog/2014/04/no-‐hadoop-‐isnt-‐

going-‐to-‐replace-‐your-‐data-‐warehouse.html

Contact Information

Using Hot and Cold Data in your SAP Analytics Landscape

Data & Analytics

Transcript of Using Hot and Cold Data in your SAP Analytics Landscape