Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar...

28
CUSTOMER Installing and Configuring SAP IQ as Extended Storage for SAP HANA

Transcript of Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar...

Page 1: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

CUSTOMER

Installing and Configuring SAP IQ as Extended Storage for SAP HANA

Page 2: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

Table of Contents1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

2 Supported Platforms. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4

3 Downloading SAP IQ from SAP Service Marketplace. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

4 Preinstallation Tasks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6

5 Installing SAP IQ on Linux. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

6 Post Installation Tasks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

7 HANA ODBC Driver Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

8 Creating the IQ Extended Storage Database. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

9 Creating the IQ Server Configuration File. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

10 Configure Your Licenses. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

11 Applying Database Options to the IQ Database. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

12 Using SCC with SAP IQ. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17

13 Allocating Storage for SAP IQ. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2013.1 Creating the RLV dbspace. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2013.2 Creating the User dbspace: Example. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

14 Checking the IQ Database Status. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

15 Common Maintenance Tasks for IQ Extended Storage Server. . . . . . . . . . . . . . . . . . . . . . . . . . . .26

2C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANATable of Contents

Page 3: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

1 IntroductionCustomers often use warm or cold storage strategies to segregate data according to value for information lifecycle purposes--archives, historical data, and corporate data retention policies, making data accessible as needed.

SAP HANA SP7 includes HANA extended tables, which logically sit in SAP HANA and can be used as if they were regular SAP HANA tables. However, the data in the HANA extended tables are physically located in an SAP IQ server connected to an SAP HANA server, and provide an area for cool or warm data (infrequently used, but important, data). Accessing cool or warm data is slightly slower than accessing the hot data that reside in HANA memory.

NoteThis version of HANA Extended Tables is intended for Pilot use only, and is not generally available at this time.

SAP opted to use SAP IQ as the warm data extension to SAP HANA because:

● SAP IQ’s patented index-based structure allows the database to store data in a much smaller space than the size of the raw input data.

● SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data.● SAP IQ loading and query operations scale up and out to more efficiently use computing resources to achieve

high performance.● SAP IQ is a disk-backed columnar store, so it can handle large data volumes with economical deployment of

hardware.

These features make SAP IQ ideal for storing and accessing extremely large data. Fundamentally, the extended storage feature allows BW-on-HANA to handle petabyte-scale data volumes at an attractive price point.

This document describes how to install and configure SAP IQ as the extended store for SAP BW on HANA. For this release, you must manually perform the installation and configuration steps.

See Setting up Extended Tables in your SAP Netweaver documentation for information about

● Prerequisites● BW extended storage usage● Configuring HANA for extended storage (after you have configured SAP IQ)

Installing and Configuring SAP IQ as Extended Storage for SAP HANAIntroduction

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 3

Page 4: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

2 Supported PlatformsSAP IQ for BW on HANA extended storage is supported only on the Linux x86-64 operating system.

4C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANASupported Platforms

Page 5: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

3 Downloading SAP IQ from SAP Service MarketplaceYou must download the SAP IQ 16 SP03 software from SAP Service Marketplace.

1. Download the software from the SAP Service Marketplace:

a) Go to http://service.sap.com/swdcb) Expand the Support Packages and Patches drop-down list.c) Select Browse our Download Catalog.d) Select Sybase Products.e) Select Sybase IQ.f) Select Sybase IQ 16.0.g) Select Sybase IQ Server 16.0.h) Select Comprised Software Component Versions.i) Select Linux on x86 64 64bit.j) Download the TGZ file to your machine.

2. Use the tar command to extract the binaries:

tar –xzvf IQSERV160003_0-20011180.TGZ

3. Log into SAP® Service Marketplace using the product and licensing information you received from SAP and

generate license keys for the IQ software: http://service.sap.com/licensekeys

You can merge these licenses into a single file when you create them.

The required licenses are:

○ 7010846 Sybase IQ Enterprise Edition

○ Number of host machines – 1○ Number of licenses – equal to (or greater than) the number of CPU cores on the machine on which IQ

will run○ 7010848 Sybase IQ Unstructured Data Analytics

○ Number of host machines – 1○ Number of licenses – equal to (or greater than) the number of CPU cores on the machine on which IQ

will run○ 7010850 Sybase IQ Very Large Database Management Option

○ Number of host machines – 1○ Number of licenses – 99

NoteThe SAP IQ license files are text files with the extension ‘.lic’.

Installing and Configuring SAP IQ as Extended Storage for SAP HANADownloading SAP IQ from SAP Service Marketplace

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 5

Page 6: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

4 Preinstallation TasksBefore you install SAP IQ, you must perform a number of tasks.

1. Review the SAP IQ 16 SP3 release bulletin and Installation Guide, located at http://infocenter.sybase.com .2. As the root user, create a group sapsys and a user in that group named sybase.

groupadd sapsysuseradd sybase -G sapsys

3. If the sybase user does not have a home directory, create one. For example:

mkdir /home/sybase

4. Change the owner of the home directory to sybase user:

chown -R sybase:sapsys /home/sybase

5. As root, change the password for the sybase user:

passwd sybase

6. Change the permissions in the directory where you extracted the installation zip file (<IQ_Install_Image_Dir>):

chown -R sybase:sapsys <IQ_Install_Image_Dir>

7. Create directory /usr/sap/sybase and these subdirectories, and change their permissions:

mkdir /usr/sap/sybasemkdir /usr/sap/sybase/servermkdir /usr/sap/sybase/datamkdir /usr/sap/sybase/data/dbmkdir /usr/sap/sybase/data/logmkdir /usr/sap/sybase/data/systemmkdir /usr/sap/sybase/data/messagesmkdir /usr/sap/sybase/data/tempmkdir /usr/sap/sybase/data/html

chown -R sybase:sapsys /usr/sap/sybase

6C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAPreinstallation Tasks

Page 7: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

5 Installing SAP IQ on LinuxYou must run the installation steps as the user sybase.

1. Change to the sybase user:

su - sybase

2. Move to the directory where you extracted the files in step 2 in chapter 3 and issue the following to start the installation wizard:

./setup.bin

3. Enter /usr/sap/sybase/server as the path to the directory in which you installed IQ server.

4. Select the Custom radio button.5. Use the default settings for the Install Set.6. Select the radio button titled "Install licensed copy of Sybase IQ Server Suite 16.0 sp03 (64-bit)".7. Select the button to agree with the terms of the license.8. Select "Continue Installation without a license key."

9. Select these items from the drop-down lists:

○ Product Edition – Enterprise Edition (EE)○ License Type – CPU License (CP)

10. Select No to confirm you do not want email alerts.

The installer displays a screen that summarizes your selections.11. Verify the content and click Install to start the installation.

The next sequence of steps install and configure Sybase Control Center.

NoteThe default port numbers are 8282 (HTTP), 8283 (HTTPS), and 9999 (RMI). Make sure these ports are not already in use for other purposes. If they are in use, select unused port numbers

12. Enter the port numbers for the HTTP and HTTPS ports.13. Enter the port number for the RMI port.14. Enter and confirm the passwords for:

○ SCC administrator○ SCC agent administrator

NoteMake a note of your password selections in a secure location.

The installer displays a screen that summarizes your configuration.15. Determine if you want to start SCC after the installation and configuration is finished.

NoteThe installation program informs you if the installation was successful.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAInstalling SAP IQ on Linux

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 7

Page 8: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

16. Click Next to start the installation and configuration17. Check the boxes to launch SCC or the Sybase products website.18. Click Done.

8C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAInstalling SAP IQ on Linux

Page 9: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

6 Post Installation TasksAfter you install SAP IQ, you must perform a number of tasks as the user sybase.

1. Create file ~/.profile

cd ~touch .profile

2. Add these lines to .profile:

# SYBASE environmentif [ -f $HOME/.bashrc ]; then . $HOME/.bashrc fi # SYBASE environment

3. Create file /usr/u/sybase/.bashrc

cd ~touch .bashrc

4. Add following to .bashrc:

# SYBASE environment if [ -f /usr/sap/sybase/server/SYBASE.sh ]; then. /usr/sap/sybase/server/IQ-16_0/IQ-16_0.shfi # SYBASE environment export PATH=$PATH:/usr/sap/sybase/server/IQ-16_0/bin64

5. If the directory /bin/env does not exist, enter the following command as root user:

ln -s /usr/bin/env /bin/env

Installing and Configuring SAP IQ as Extended Storage for SAP HANAPost Installation Tasks

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 9

Page 10: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

7 HANA ODBC Driver ConfigurationYou must copy and install the ODBC driver from the HANA installation or download it from the SAP Market Place.

1. Go to http://service.sap.com/swdc2. Expand the Support Packages and Patches drop-down list.3. Select Browse our Download Catalog.4. Select SAP In-Memory (SAP HANA)5. Select HANA Platform Edition.6. Select SAP HANA PLATFORM EDITION.7. Select SAP HANA PLATFORM EDIT. 1.0.8. Select Entry by Component.9. Select HANA Client.10. Select SAP HANA Client 1.00.11. Select Linux on x86 64 64bit.12. Download the latest revision of SAP HANA CLIENT 1.00.13. Copy the libodbcHDB.so drive to $SYBASE/IQ-16_0/lib64:

cp libodbcHDB.do $SYBASE/IQ-16_0/lib64

14. As sybase user:a) Extract the file into a temporary directory on the IQ server:

sapcar -xvf IMDB_CLIENT10_<revision>-10009663.SAR -R <target_directory>

b) Move to the directory where you extracted the files and issue this to start the installation:

./hdbinst -a client

c) Enter the installation path (usr/sap/hdbclient is the default).

a) Check the installation by listing the files in the installation directory. The usr/sap/hdbclient directory must include the libodbcHDB.so file which you issue the ls command.

15. If IQ server is running, restart the server. If the server is not running, continue to the next topic.

10C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAHANA ODBC Driver Configuration

Page 11: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

8 Creating the IQ Extended Storage DatabaseAfter you acquire all the SAP IQ ‘.lic’ license files, copy them to the $SYBASE/SYSAM-2_0/licenses directory.

$SYBASE: points to parent installation directory (in the examples described here, this is usr/sap/sybase/server).

Creating the SAP IQ database requires that you first create dbspaces. A dbspace is a logical collection of dbfiles (an operating system file or a raw partition used to store data for an SAP IQ database). If a database runs out of space, you can expand it by adding additional dbspaces. You can increase the space of each dbspace by adding additional dbfiles.

HANA extended storage requires that you create four dbspaces:

● IQ_SYSTEM_MAIN – contains structures necessary for the database to operate● IQ_SYSTEM_TEMP – holds temporary data● User dbspace – this is the dbspace that holds the actual user data● RLV dbspace – it is used to store the persistent logs for RLV-enabled tables. RLV is similar to the delta store

in HANA.

Refer to the sizing guidelines for information about sizing each of these dbspaces.

Creating the SAP IQ database instance for extended storage requires that you start a default database, which allows you to create the extended storage database. The default database instance is named utility_db. The directory from which you start utility_db determines where subsequent files are created.

1. Change to the sybase user:

su sybase

2. Start the SAP IQ utility database from the /usr/sap/sybase/data/db :

start_iq –n utility_db

SAP IQ displays information similar to:

===============================================================IQ server starting with: 10 connections ( -gn) 12 cmd resources ( -iqgovern) 77 threads ( -iqmt) 512 Kb thread stack size ( -iqtss ) 39424 Kb thread memory size ( -iqmt * -iqtss ) 1 IQ number of cpus ( -iqnumbercpus ) 0 MB maximum size of IQMSG file ( -iqmsgsz ) 0 copies of IQMSG file archives ( -iqmsgnum )===============================================================

I. 02/14 14:58:51. Database server started at Fri Feb 14 2014 14:58I. 02/14 14:58:51. Trying to start SharedMemory Link . . . I. 02/14 14:58:51. SharedMemory link started successfullyI. 02/14 14:58:51. Trying to start TCPIP link . . . I. 02/14 14:58:51. Starting on port 2638I. 02/14 14:58:56. TCPIP link started successfullyI. 02/14 14:58:56. Now accepting requestsNew process id is 13016

Installing and Configuring SAP IQ as Extended Storage for SAP HANACreating the IQ Extended Storage Database

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 11

Page 12: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

Server started successfully

3. Start Interactive SQL, and connect to the utility_db database (this example connects to a server named myserver):

dbisql –c "uid=dba;pwd=sql;eng=myserver;dbn=utility_db"

4. Use the script provided below to create the IQ database (after adjusting the script's sizing according to your site’s requirements). In this example, the units for iq size (size of IQ_SYSTEM_MAIN dbspace) and temporary size (size of IQ_SYSTEM_TEMP dbspace) are in megabytes.

NoteSize IQ_SYSTEM_MAIN so that it is 5 – 10% of the user dbspace size (the user dbspace holds all of your compressed user data), and size IQ_SYSTEM_TEMP according to the total working set size that concurrent queries may access. This is difficult to predict. In the example below, IQ_SYSTEM_TEMP (which stores various types of temporary data) is set initially to the same size as IQ_SYSTEM_MAIN – about 8GB. However, you must adjust these sizes based on your data size needs. You will probably be adding additional dbfiles to the IQ_SYSTEM_TEMP dbspace later in the configuration process: SAP recommends a minimum size of 8GB for IQ_SYSTEM_MAIN and IQ_SYSTEM_TEMP. Refer to the sizing guidelines for sizing IQ_SYSTEM_MAIN and IQ_SYSTEM_TEMP correctly.

/* ============================================================*/ /* create_database.sql */ /* SAP IQ database instance "SAPIQDB" - CREATE DB */ /* ============================================================*/ create database 'SAPIQDB.db' log on '../log/SAPIQDB_log.log' collation 'CESU8BIN' encoding 'CESU8' temporary path '../temp/SAPIQDB_tmp_001.iqtmp' case respectiq path 'SAPIQDB_main_001.iq' message path '../messages/SAPIQDB_msg.iqmsg' iq page size 524288 iq size 8192 temporary size 8192 jconnect on java on blank padding on ;

5. Exit from Interactive SQL.6. Stop the utility_db database:

stop_iq

12C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANACreating the IQ Extended Storage Database

Page 13: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

9 Creating the IQ Server Configuration FileThe configuration file specifies options for the start_iq server start up utility.

1. Change to the sybase user:

su sybase

2. Save this script to the SAPIQDB.cfg file in the /usr/sap/sybase/data/db directory, changing the settings to match those required for your site. The settings in this script are based on a machine with 256GB of memory and 64 cores.

Refer to the sizing guideleines described in section 3 of the accompanying Tech Note. The configuration show below is only an example, and the actual values you use should be based on the sizing guidelines provided by this Tech Note.

NoteSAP recommends that machine have 2–4 GB of memory for each core.

#### Name of the server -n SAPIQ_SERVER

#### -c: cache memory for catalog store. Set to 2 – 8 times the#### the size of the catalog file (the .db file). -c 4096m

#### -gc: Maximum interval (in minutes) between checkpoints-gc 20

#### -gd: which users are allowed to start and stop IQ servers-gd all

#### Cache sizes in MB: adjust based on the total memory on the system. #### Use 80% of existing RAM. Configure the parameters based on the #### sizing guidelines.-iqlm 51200 -iqtc 51200-iqmc 51200-iqrlvmem 51200

#### location of the temporary files for IQ -dt ../temp

#### -x: specify unused port for IQ server to listen for client#### connection attempts-x tcpip{port=2638}

#### -gl: which users are allowed to execute LOAD TABLE statement -gl all

#### -gm: maximum number of concurrent client connections -gm 100

#### -gp: server page size in bytes. Match to the value of the stripe #### size of your storage system. Value must be greater than or equal to#### the database page size.-gp 4096

See the IQ Utility Guide for more information about start_iq options.

Installing and Configuring SAP IQ as Extended Storage for SAP HANACreating the IQ Server Configuration File

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 13

Page 14: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

3. Start up your extended storage IQ database:

start_iq @SAPIQDB.cfg SAPIQDB.db

14C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANACreating the IQ Server Configuration File

Page 15: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

10 Configure Your LicensesYou must manually verify that your licenses are valid.

The SAPIQDB.lmp file (located in /usr/sap/sybase/data/db) contains two lines similar to:

PE=EELT=CP

Verify the values in the SAPIQDB.lmp file match the values in the .lic license file that you copied to the $SYBASE/SYSAM-2_0/licenses directory. For example, this .lic file for an evaluation license includes this text (the key values are in bold text):

# Sybase Software Asset Management License File. EV License for Sybase IQ# Enterprise EditionPACKAGE IQ_EE SYBASE COMPONENTS=IQ_CORE SUPERSEDE ISSUED=13-feb-2014 \ SIGN2="13BD 786A C81C 7576 94D4 3997 67B1 9A9A B662 9B60 04F4 \ BAD6 08EF E76F E819 187B 5F48 C10A 40D2 81BD 63B5 A0FE 6F8C \ 24CF C274 4C23 CF0E 8D97 41ED 7327"# License for Host ID DEMOINCREMENT IQ_EE SYBASE 2014.04140 14-apr-2014 uncounted \ VENDOR_STRING=PE=EE;LT=EV;AP=IQ HOSTID=DEMO ISSUER="CO=Sybase, \ Inc.;V=15.0;AS=A;" ISSUED=13-feb-2014 NOTICE="Sybase 60 Day \ Evaluation License" SN=1-15-OW112748 TS_OK SIGN2="1751 362B \ 0FB2 60CA 9CF2 C22E BF06 65BA 635F 9F7E DB30 DA1D 7B71 2EFF \ 3C22 0416 F405 0C5D 6F13 2659 5F97 742F 9ADF 2FF4 21F6 35C5 \ 05FB C717 D7B0 6872"

In this example, theSAPIQDB.lmp must also include these values:

PE=EELT=EV

Installing and Configuring SAP IQ as Extended Storage for SAP HANAConfigure Your Licenses

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 15

Page 16: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

11 Applying Database Options to the IQ DatabaseUse Interactive SQL to apply the database options.

1. Start Interactive SQL:

dbisql –c “uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB”

2. Enter these set options and values into the SQL Statements window:

set option public.allow_read_client_file='on'; set option public.force_no_scroll_cursors='on'; set option public.max_cartesian_result=0;set option public.string_rtruncation='off';set option public.snapshot_versioning='row-level';

16C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAApplying Database Options to the IQ Database

Page 17: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

12 Using SCC with SAP IQYou can use SAP Control Center (SCC) to manage and administer SAP IQ extended storage.

This section describes specifics for using SCC with HANA extended tables.

For general information about:

● Using SCC – see http://infocenter.sybase.com/help/index.jsp?topic=/

com.sybase.infocenter.dc01087.1530/doc/html/jcu1295019001506.html ● Getting started with SCC – see http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc01267.0327/doc/html/bth1252720395585.html● Registering SCC – see http://infocenter.sybase.com/help/topic/com.sybase.infocenter.dc01267.0327/doc/

html/jfo1259595672898.html

Starting SCC

To launch SCC, issue this command as the user sybase from the host on which you installed IQ:

$SYBASE/SCC-3_3/bin/scc.sh

NoteIf SCC does not start, verify your <DISPLAY> environment variable is set correctly and ensure that clients can connect to the host by issuing xhost +at the command line.

Stopping SCC

To stop SCC, issue this as the user sybase:

$SYBASE/SCC-3_3/bin/scc.sh

Accessing and Logging in to SCC

To access SCC:

1. Open a web browser.2. Enter this URL, entering the correct port number for your:

https://<hostname>:<port_number>/scc

where <hostname> is the name of the host at your site where you installed SCC, and <port_number> is the port number you entered during installation (the default is 8283).

Installing and Configuring SAP IQ as Extended Storage for SAP HANAUsing SCC with SAP IQ

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 17

Page 18: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

3. Enter the:

○ User name – sccadmin, or other users configured○ Password – established during the SCC installation

Logging Out of SCC

To log out:

● Select Application > Log Out from the main menu bar, or● Click Log Out on the upper-right corner of the main SCC window.

Registering the SAP IQ Server

1. Select Resource > Register from the Resource Explorer.2. Specify the:

○ Resource Name – name of the server○ Resource Type – specify "IQ Server"

3. Click Next.4. Specify the Host Name, Port Number, and Database Name used to connect to the server.5. Click Next.6. Enter the IQ user name and password to connect.7. (Optional) Click Add this resource to the current perspective. You must add IQ server to a perspective

before you can manage or monitor it.8. Click Finish.

Configuring a Pluggable Authentication Module (PAM) for UNIX

1. Configure SCC to use UNIX <username> and <password> login accounts.2. If you are using SUSE version 11 and later, create a sybase-csi file in your /etc/pam.d directory that

contains:

# sybase-csi PAM Configuration (SUSE style)auth include common-authaccount include common-accountpassword include common-passwordsession include common-session

NoteFor information about configuring additional platforms or versions, see http://infocenter.sybase.com/help/

topic/com.sybase.infocenter.dc01267.0327/doc/html/bth1253572423588.html

18C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAUsing SCC with SAP IQ

Page 19: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

Adding Additional Users to SCC

1. Verify that you have configures SCC to use UNIX login accounts (described above).2. From the SCC main menu, select Application > Administration.3. Expand the Security folder in the Sybase Control Properties dialog.4. Select Logins.5. Select Create Login.6. Enter a login name and, optionally, an expiration value for the new account.7. Select Next.8. Select Specify new user information or Use existing user information.9. If you selected:

○ Specify new user information – enter details about the user (the fields marked with * are mandatory):

○ Title○ First name*○ M.I. (middle initial)○ Last name*○ Suffix○ E-mail address*○ Phone○ Ext.○ Fax○ Mobile○ Supports text messaging (checkbox)

○ Use existing user information – choose a user from the existing set of users.10. Click Finish

Setting Roles for SCC Users

1. From the SCC main menu, select Application > Administration.2. Expand the Security folder in the Sybase Control Properties dialog.3. Click Logins4. Select the login account to which you want to assign a role.5. Click the Roles tab.6. Select the role from the Available roles for resource list, then click Add.

For example, to grant administrative privileges, add the SCC Service:sccAdminRole.

NoteIf a role appears in the Has following roles list, this account or group has already been configured with that role.

7. Click OK.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAUsing SCC with SAP IQ

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 19

Page 20: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

13 Allocating Storage for SAP IQYou must create a user dbspace, add files (or raw devices) to expand its capacity, and create the RLV (row level version) dbspace.

NoteRefer to the sizing guideleines described in section 3 of the accompanying Tech Note.

13.1 Creating the RLV dbspace

The RLV store must be only large enough to keep the data in memory that is being loaded and changed prior to being merged with the IQ main store data.

1. The correct amount depends on the number of tables, and how frequently the data is loaded and merged. Use the sizing guidelines provided in the SAP technote to determine the optimal size for RLV dbspace.

2. Start interactive SQL:

dbisql -c "uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB"

3. Enter this statement into the DBISQL SQL Statements window, changing the settings to match those required for your site (this example creates an RLV dbspace of 1 GB):

CREATE DBSPACE syb_rlvusing file syb_rlv_001'/usr/sap/sybase/data/db/SAPIQDB_rlv_001.iq'size 1 GBIQ RLV STORE;

13.2 Creating the User dbspace: Example

HANA extended storage does not support raw devices. You must use filesystem devices. Refer to the sizing guidelines to size the user dbspace.

This example uses 2TB of storage: 1TB for the user data and 1TB for temporary data. Adjust these values for your site's requirements.

1. SAP recommends that you add dbfiles in multiples of 32GB instead of as a single large file. Placing these dbfiles on different physical devices may improve performance.

2. Start interactive SQL:

dbisql -c "uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB"

3. Create the dbspace:

CREATE DBSPACE syb_mainusing file syb_main_002

20C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAAllocating Storage for SAP IQ

Page 21: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

'/usr/sap/sybase/data/db/SAPIQDB_main_002.iq'size 32 GB;set option public.default_dbspace='syb_main';

4. Add devices to syb_main and IQ_SYSTEM_TEMP dbspaces. The sizes in the script below are for the configuration described above. Adjust the values for your site.

NoteIn the script below:

○ The dbfile number starts at ‘003’ because you have already added two dbfiles to the IQ main store (one for IQ_SYSTEM_MAIN, and another to your user dbspace, syb_main),

○ The dbfile number starts at '002' because you already added one dbfile to IQ_SYSTEM_TEMP when you created the dbspace.

○ The ‘...’ acts as a placeholder for the remaining files you must create on your system.

ALTER DBSPACE syb_main ADD FILE SAPIQDB_main_003 '/usr/sap/sybase/data/temp/SAPIQDB_main_003.iq' size 32 GB, FILE SAPIQDB_main_004 '/usr/sap/sybase/data/temp/SAPIQDB_main_004.iq' size 32 GB, ... FILE SAPIQDB_main_033 '/usr/sap/sybase/data/temp/SAPIQDB_main_033.iq' size 32 GB ;

ALTER DBSPACE syb_main STRIPING ONSTRIPESIZEKB 128 ;

ALTER DBSPACE IQ_SYSTEM_TEMP ADD FILE SAPIQDB_tmp_002 '/usr/sap/sybase/data/temp/SAPIQDB_tmp_002.iqtmp' size 32 GB, FILE SAPIQDB_tmp_003 '/usr/sap/sybase/data/temp/SAPIQDB_tmp_003.iqtmp' size 32 GB,... FILE SAPIQDB_tmp_032 '/usr/sap/sybase/data/temp/SAPIQDB_tmp_032.iqtmp' size 32 GB;

ALTER DBSPACE IQ_SYSTEM_TEMP STRIPING ONSTRIPESIZEKB 128 ;

Installing and Configuring SAP IQ as Extended Storage for SAP HANAAllocating Storage for SAP IQ

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 21

Page 22: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

14 Checking the IQ Database StatusCheck the status of the IQ database and its license usage (some license options, like IQ_UDA, may not be active if they are not used). SAP recommends that you periodically run these stored procedures to better understand the status of IQ.

Checking the Status of IQ Database and Its Objects

sp_iqstatus checks the status of the IQ database. sp_iqstatus:

● Shows information about the current database with additional information such as page size, dbspace, segments, buffer usage, and so on

● Shows out of memory status for main and temporary dbspaces● Monitors the memory used by RLV store

To execute sp_iqstatus:

1. Start interactive SQL:

dbisql –c “uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB”

2. Enter sp_iqstatus in the text window.

See the detailed documentation for sp_iqstatus at http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc01840.1600/doc/html/san1278453329555.html

Checking the Status of the IQ licenses

sp_iqlmconfig checks the status of IQ licenses. sp_iqlmconfig shows the information of ‘Product Edition’ and ‘License Type’ used, along with other pertinent information.

To execute sp_iqlmconfig:

1. Start interactive SQL:

dbisql –c “uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB”

2. Enter sp_iqlmconfig in the text window.

See the detailed documentation for sp_iqlmconfig at http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc38151.1510/html/iqrefbb/CHEGBGBB.htm

Checking the Options Configured for IQ

sp_iqcheckoptions confirms the options you configured. Specifically, you should confirm that the options you configured in Chapter 13 display and are set correctly.

22C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAChecking the IQ Database Status

Page 23: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

To execute sp_iqcheckoptions:

1. Start interactive SQL:

dbisql –c “uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB”

2. Enter sp_iqcheckoptions in the text window.

See the detailed documentation for sp_iqcheckoptions at http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc38151.1510/html/iqrefbb/CIHHEAHB.htm

Checking the Status of Configured dbspaces

sp_iqdbspace verifies information about the configured dbspaces, showing information for each configured dbspace, including the dbspace name, type of dbspace, online status, and statistics about its size.

To execute sp_iqdbspace:

1. Start interactive SQL:

dbisql –c “uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB”

2. Enter sp_iqdbspace in the text window.

See the detailed documentation for sp_iqdbspace at http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc38151.1510/html/iqrefbb/CIHDAEDC.htm

Checking the Status of Each Object in Each dbspace

sp_iqdbspaceobjectinfo verifies information for the configured dbspaces, including information about dbspace tables (columns, indexes, primary keys, metadata, unique constraints, and so on).

To execute sp_iqdbspaceobjectinfo:

1. Start interactive SQL:

dbisql –c “uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB”

2. Enter sp_iqdbspaceobjectinfo in the text window (you can view objects only from the dbspace you specify). For example, the second sp_iqdbspaceobjectinfo only views objects for iq_main:

sp_iqdbspaceobjectinfosp_iqdbspaceobjectinfo iq_main

See the detailed documentation for sp_iqdbspaceobjectinfo at http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc38151.1510/html/iqrefbb/CIHBFHEI.htm

Installing and Configuring SAP IQ as Extended Storage for SAP HANAChecking the IQ Database Status

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 23

Page 24: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

Checking the Usage for Each dbfile in dbspace

sp_iqfile checks the usage and other properties for each dbfile in a dbspace.

To execute sp_iqfile:

1. Start interactive SQL:

dbisql –c “uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB”

2. Enter sp_iqfile in the text window (you can view objects only from the dbspace you specify) the specify the name of a dbspace to view objects from that dbspace only. For example, the second sp_iqfile only checks information about the dbfiles for iq_main:

sp_iqfile sp_iqfile iq_main

See the detailed documentation for sp_iqfile at http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc38151.1510/html/iqrefbb/iqrefbb356.htm

Checking the RLV Store Memory Usage

sp_iqrlvmemory checks the RLV store memory usage per table.

To execute sp_iqrlvmemory:

1. Start interactive SQL:

dbisql –c “uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB”

2. Enter sp_iqrlvmemory in the text window (you can check the RLV memory usage only for table you specify). For example, the second sp_iqrlvmemory only checks information about the tbl1 table:

sp_iqrlvmemory sp_iqrlvmemory ‘tbl1’

See the detailed documentation for sp_iqrlvmemory at http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc01840.1600/doc/html/jcu1351698812931.html

Checking Information About Locks

sp_iqlocks checks information about current locks in the database, including information for connections and tables.

To execute sp_iqlocks:

1. Start interactive SQL:

dbisql –c “uid=dba;pwd=sql;eng=SAPIQ_SERVER;dbn=SAPIQDB”

24C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANAChecking the IQ Database Status

Page 25: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

2. Enter sp_iqlocks in the text window, including any additional parameters. For example, the second sp_iqlocks checks information about connection IDs:

sp_iqlocks sp_iqlocks <connection-id>

See the detailed documentation for sp_iqlocks at http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc01840.1600/doc/html/san1278453304508.html

Installing and Configuring SAP IQ as Extended Storage for SAP HANAChecking the IQ Database Status

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 25

Page 26: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

15 Common Maintenance Tasks for IQ Extended Storage ServerYou can perform a number of maintenance tasks at the command line or with SAP Control Center (SCC).

Increasing the Size of dbspace

You can increase the size of dbspace at the command line or with SCC.

● At the command line:

○ To increase the size of IQ_SYSTEM_MAIN dbspace:

alter dbspace IQ_SYSTEM_MAIN add file <logical-file-name-1> ‘<file-path-1>’ size 1GB, file <logical-file-name-2> ‘<file-path-2>’ size 1 GB

○ To increase the size of IQ_SYSTEM_TEMP dbspace:

alter dbspace IQ_SYSTEM_temp add file <logical-file-name-1> ‘<file-path-1>’ size 1 GB

○ To increase the size of RLV dbspace –

alter dbspace <rlv-dbspace-name> add file <logical-file-name-1> ‘<file-path-1>’ size 1GB, file <logical-file-name-2> ‘<file-path-2>’ size 1 GB

○ To increase the size of user dbspace:

alter dbspace <user-dbspace-name> add file <logical-file-name-1> ‘<file-path-1>’ size 1GB, file <logical-file-name-2> ‘<file-path-2>’ size 1 GB

● With SCC – use the online instructions provided here: SAP Sybase IQ 16.0 > Sybase Control Center 3.2.7 for SAP Sybase IQ> Administer and Monitor SAP Sybase IQ > DB Files ( http://infocenter.sybase.com/help/

topic/com.sybase.infocenter.dc01267.0327/doc/html/jwi1278974853813.html )

Start and Stop the IQ server

You can increase the size of dbspace at the command line or with SCC.

● At the command line –To start the IQ server:

1. As a sybase user, move to /usr/sap/sybase/data/db.2. Execute:

start_iq @SAPIQDB.cfg SAPIQDB.db

To stop the IQ server:

26C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Installing and Configuring SAP IQ as Extended Storage for SAP HANACommon Maintenance Tasks for IQ Extended Storage Server

Page 27: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

1. As a sybase user, move to /usr/sap/sybase/data/db.2. Execute:

stop_iq

● With SCC –Use the online instructions provided here to start the IQ server: SAP Sybase IQ 16.0 > Sybase Control Center 3.2.7 for SAP Sybase IQ > Administer and Monitor SAP Sybase IQ > Simplex Servers > Administer Simplex Servers (http://infocenter.sybase.com/help/topic/com.sybase.infocenter.dc01267.0327/doc/html/

jwi1278974855579.html )Use the online instructions provided here to stop the IQ server: SAP Sybase IQ 16.0 > Sybase Control Center 3.2.7 for SAP Sybase IQ > Administer and Monitor SAP Sybase IQ > Simplex Servers > Administer Simplex Servers (http://infocenter.sybase.com/help/topic/com.sybase.infocenter.dc01267.0327/doc/html/

jwi1278974855829.html )

Modifying Cache Sizes or Startup Parameters

To modify the cache sizes or startup parameters:

1. Stop IQ server.2. Modify the SAPIQDB.cfg configuration file (located in /usr/sap/sybase/data/db).3. Restart IQ server.

Monitoring the IQ Extended Storage Server

See the documentation located here: Sybase Control Center 3.2.8 ESD1 > Sybase Control Center 3.2.7 for SAP Sybase IQ >Administer and Monitor SAP Sybase IQ > Simplex Servers (http://infocenter.sybase.com/help/topic/

com.sybase.infocenter.dc01267.0327/doc/html/jwi1277844486475.html )

Installing and Configuring SAP IQ as Extended Storage for SAP HANACommon Maintenance Tasks for IQ Extended Storage Server

C U S T O M E R© 2014 SAP AG or an SAP affiliate company. All rights reserved. 27

Page 28: Installing and Configuring SAP IQ as Extended Storage for ...€¦ · SAP IQ’s columnar architecture is designed for fast, complex queries on large volumes of data. SAP IQ loading

www.sap.com/contactsap

© 2014 SAP AG or an SAP affiliate company. All rights reserved.No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice.Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. National product specifications may vary.These materials are provided by SAP AG and its affiliated companies ("SAP Group") for informational purposes only, without representation or warranty of any kind, and SAP Group shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP Group products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries.Please see http://www.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.