4.Technical Infrastructure Requirements-2.3

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTSSince the workload and type of work done in a data warehousing environment is very different from traditional Online Transaction Processing (OLTP), this section pays attention to some of the items considered to be of high importance to data warehousing. This section should be the basis for vendor’s proposed technical strategy.

4.1. General Requirements 4.1.1 Vendor shall be able to perform the installation, configuration, implementation, and

problem solving etc. during non-office hours.<Please Compile the paragraph Here:Everything? By 24Hr?>

4.1.2 Vendor shall provide all hardware, software and implementation services forsuccessful implementation of the business services requirements in this RFP.<Please Compile the paragraph Here:Are there anything we don’t provide?>

4.1.3 Vendor shall provide administration, operation, support and problem solving servicesafter project go-live.<Please Compile the paragraph Here:After Production support? What is our policy?>

4.1.4 Vendor shall propose overall system architecture/infrastructure, components andconfiguration diagram with detail description including hardware and softwarespecification.<Please Compile the paragraph Here:is it our standard deliverable?>

4.1.5 The proposed hardware and software should conform to existing THAI’sinfrastructure as much as possible and the interface systems/equipments shall beprovided.

In case, proposed hardware or software does not conform to THAI’s infrastructure, its’ benefit/reasons shall be clearly defined.

<Please Compile the paragraph Here: are there any incompatable on our HW?>

4.1.6 Vendor shall provide appropriate and sufficient hardware, software, equipments and

all necessary items required for the successful implementation. If any of pre-requisite

infrastructures at THAI is missing or insufficient, according to either DW solution or

standard of THAI infrastructure requirements, it is vendor responsibility to provide

them.

For example, vendor shall provide sufficient hardware accessories such as UTP cable, fiber cable, fiber channel adapter, network adapter, mountable rack, etc. needed for successful connecting the proposed hardware to THAI’s corporate network, tape library and storage devices.

<Please compile this paragraph here : are there any additional HW component we need from THAI? Or it is not include in our propose solution please write the comment here.>

4.2. Hardware Requirements

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS 1


4.2.1 All proposed equipments shall be able to operate on 220V., 50Hz. and also delivered

together with the operation manuals & software drivers (if applicable).

<Please Compile the paragraph Here:220v/50Hz?>4.2.2 Vendor shall install all proposed equipments at the location notified by THAI.

<Please Compile the paragraph Here:Yes?>4.2.3 Vendor shall propose hardware for development and production system with the same

platform.

<Please Compile the paragraph Here: Yes?>4.2.4 Proposed solution shall be able to manage, use, and administer as single

environment/console.

<Please compile this paragraph here : Single sign on Monitoring? Monitoring/Management Portal?>4.2.5 Vendor shall provide but not limited to the following hardware:

4.2.5.1 Sets of server nodes and completed components with adequate capacity and

good performance to operate the following items and all other required

servers to serve THAI’s business requirements.

Database Engine

ETL/ELT, Data Cleansing, and Data Quality

Business Intelligence Data Mining Metadata

Backup, Archive and Recovery

Management

Etc.

<Please compile this paragraph here :Do we separate all the servers for each Component? We can put the HW diagram and SW that installed on them here.>4.2.5.2 All proposed hardware shall be able to operate for 24 hours x 7 days,

therefore, redundant, hot swappable, hot standby and fault tolerant hardware

is required. For example, the hardware provides the following high

availability features and require no additional effort to setup, configure and

administer:

Mirrored operating system disks

Dual redundant power cables to enable connection to redundant power circuits.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 12


Dual redundant hardware components including but not limited to host bus adapters, network connections, fiber channel connections to the disk arrays, disk array controllers and RAID 1 disk mirroring.

Hot standby Node

Etc.

<Please compile this paragraph here : is it support all the feature THAI requires?>

4.2.5.3 Proposed hardware for database engine shall be able to operate in MPP

(Massive Parallel Processing) shared-nothing environment and shall provide

the following features;

Linear scalability

Balance workload automatically, such that workload is distributed most efficiently.

Automatically and evenly distribute data to all units of parallelism.

Support data high availability when node(s) in the MPP environment failed, the other/stand by node(s) shall be able to automatically take the failed node’s resources and make the data available to users.

Proposed hardware shall support co-existence of multiple generations of hardware (without hardware performance downgrade) in a single platform reducing the need to dispose of existing hardware when more capacity is required.

<Please compile this paragraph here : is our DB Engine/Server support all the feature THAI requires?>4.2.5.4 Proposed hardware for backup, archive and recovery managements should

be conform to the following requirements: -

Able to operate on UNIX-based SUN Solaris 10 or

up. Able to operate on SUN E25K or M9000 model

Provide adequate equipments and software license to support LAN-Free backup for all proposed servers.

<Please compile this paragraph here :SUN is the only backup system the have, if we use other please provide the reason and benefit here.>4.2.5.5 Vendors will be at an advantage if they are able to proposed hardware

for other servers outside database engine and backup, archive and recovery

management and able to operate on one of current THAI’s consolidate

server infrastructure as defined in the hardware and software specification

for THAI’s consolidate server items in Appendix-B and as details in the



following items.

For Intel-Based Server, brand name to include DELL, HP, IBM, HP,

NEC or Fujitzu, operating system which should support: -

• Microsoft Window 2003 up that could operate on consolidate

server VMWare ESX 3.5 or up

For UNIX-Based, operating system which should support: -

• AIX 5.3 up that could operate on consolidate server IBM Unix

platform, or

• Solaris 10 up that could operate on consolidate server SUN

E25K/M9000 up.

Since THAI now has inadequate server resource, vendor should propose new box for all server types mentioned above.

<Please compile this paragraph here :Do we separate all the activity to another box of HW? If we do, will we get more evaluate score?>4.2.5.6 Vendors will be at an advantage if they are able to proposed storage and

tape media that conform to current THAI’s infrastructure as defined in

Appendix-B for example:-

Fiber Channel Storage EMC: CX3-80 and CX4-960 (hot swappable fiber disk with 4Gbs and 15 Krpm)

SAN Switch Connectrix ED-24000B, ED-48000

Tape Drives with certified to install with THAI existing Tape Library system: IBM3584. Below are the minimum technical requirements for Tape Drive Unit and frame of Tape Library vendor should provide Tape library frame to complete the installation for THAI..

• Drive Type : Minimum LTO-4 (minimum transfer rate of 120

MB/s) • Drive interface : 4 Gb Fiber channel interface per connection • Mixed media supported : Support media type of LTO3 and

LTO-4 • Able to operate with EMC storage CLARion CX700 and SAN

Switch Connectrix ED-24000B and ED-48000B

Data Cartridge • Data Cartridge Media Capacity: Minimum LTO-4 (800 GB/1.6

TB per cartridge) • Equip with barcode scan engine to be able to scan and



read barcode from cartridge tape

• Number of Barcode Label provided<Please compile this paragraph here : HW Specification should be here. Or we can refer to the catalogue.>4.2.5.7 Hardware Sizing Requirements

All propose hardware shall cover initial data, history data with data and workload growth of 5% per year for at least 3 years.

Capacity of the provided hardware and sizing calculation shall be:-

• Able to accommodate growth of concurrent users from 50 to 100

users.

<Please compile this paragraph here : Can we? 100 or more?>• Able to serve Recovery Point Objective (RPO) within 24 hours

and Recovery Time Objective (RTO) within 12 hours.

<Please compile this paragraph here :Can we???>• Able to support DW connection from clients in Thailand and

station abroad.

<Please compile this paragraph here : Depend on THAI Network??.>

Provide adequate servers, processors, memory, storage, network interface card, host bus adapter and all requiredequipments/accessories to serve workload and growth required byDW and business requirements with user acceptable reliable, performance and response time. <Please compile this paragraph here : Proof that our HW is cover to THAI data sizing and still good resonse.>Vendor shall provide detail hardware specification for each set of the following servers with detail calculation method: -

• Database Engine

• ETL/ELT, Data Cleansing, and Data Quality

• Business Intelligence

• Data Mining

• Metadata

• Backup, Archive and Recovery Management

<Please compile this paragraph here :Refer to the HW/SW catalogue ??>Provide adequate high speed disk storage and all required components to support raw data size as estimated in Appendix-A and shall serve the following requirements: -



• Adequate to keep all designed layers for DW including semantic

and OLAP layers which shall be directly accessed by business

intelligence and data mining tools.

• Adequate to keep database and data repository required for all

proposed software such as ETL/ELT, Metadata, Business

Intelligence, Data Mining, etc.

• Adequate to keep interim data required by ETL/ELT/Cleansing/

data quality process that extract, transform, cleansing data from

both THAI’s internal or external data sources into target DW and

also interim data out of DW to other required systems.

• Adequate storage to keep staging of backup, archive log and

interim data for at least 2 weeks retention before transfer to tape.

<Please compile this paragraph here : Refer to the HW/SW catalogue ??>Provide adequate SAN Switch port for both unit (ED24000B and ED 48000B) if required and one server shall be connected to two SAN switch for high availability reason.

<Please compile this paragraph here : which model we use?>Vendor can propose new SAN switch with the same or higher class (enterprise) and newer model.

<Please compile this paragraph here : do we have?>Provide the estimate number of IP, LAN port, Heart Beat port, SAN switch port, NTP, etc. those required from THAI’s infrastructure.

<Please compile this paragraph here :IP Table by the server and their Network interfaces and Network Protocol require>The network bandwidth shall be estimated to accommodate the connection from clients in Thailand and station abroad to DW for all kinds of services.

<Please compile this paragraph here : Network Bandwith can we calculate here(Number of concurrent users and Data records?)>Sizing calculation method shall be clearly defined for infrastructure requirements and all proposed hardware sizing.

<Please compile this paragraph here :HW Size Calculation>Provide adequate backup equipments for the proposed backup and recovery solution with following requirements.



(The proposed hardware should conform to existing THAI’s infrastructure as defined in item 4.2.5.5.)

• Backup Server, which is able to accommodate back up window

time - maximum 6 hours per day.

• Adequate tape drive units and frames of tape library, which are

able to serve the above backup windows requirements. Adequate data cartridges to keep monthly, weekly and daily backup of the DW built from the estimate of raw data size defined in Appendix-A and growth including interim data required by ETL/ELT/Cleansing/ data quality process with retention for 3 months. Adequate data cartridges to create daily copy.<Please compile this paragraph here :>

4.2.6 Vendor is responsible to perform UTP cabling for connecting servers and console to

THAI’s corporate network and is responsible to perform cabling to THAI’s storage

and Tape backup as defined in Cable Wiring Requirements

Cable Wiring Requirements

4.2.6.1 UTP Cabling for connecting server and switch to corporate network(support 1 Gb connection). The number of points required shall beaccommodated the proposed solution requirement.

Vendor is responsible for LAN wiring in THAI’s office according to the provided floor layout and LAN configuration.

Standard UTP CAT 6 is recommended to use for LAN cables with supported minimum data transfer speed 1 Gbps and supported frequency 250 MHz.

In case of open ceiling, UTP cable shall be wired in EMT conduit and close- ceiling or T-Bar ceiling UTP cable shall be wired in flexible conduit and clamped on ceiling or laid-on wire way cable tray.

Each location shall be equipped with patch panel for CAT 6 RJ-45 modular jack (Female) - and CAT 6 RJ-45 modular plug (male) with color plug boot.

Each face plate & the end of cable shall be labeled (Nameplate & Shrink Tube Wire Marker) with Thai standard- code 9 digits. Example: "aabbccddd" aa: Building No., bb: Source Floor, cc: Destination Floor, - ddd: Cable running No.

No connection within Ethernet standard range 100 meters.

Vendor shall provide at least 10 meters of UTP CAT 6 Patch cord (molded type) with 2 male RJ-45 modular plugs & Color plugs- boot for Server side and Network side.

Vendor shall provide UTP CAT6 cable (basic link) and design



by THAI (Length , Position).

Vender shall provide Wire Management Panel with Cover )ifrequired.(

Modular plug (Male) with FIX Jacket RJ-45 CAT 6.

Modular jack (Female) RJ-45 CAT 6 Keystone Lead frame technology can be mounted to face plate or blank Patch Panel.

Standard CAT6 cable, Modular plug (Male) & Modular jack (Female) RJ-45 preferable: AMP, BICC, AT&T, ALANTEK, HUBELL, AVAYA, BELDEN, PANDUIT. Ccc

Blank Patch Panel: 24-ports Modular Blank 19 inches used formounting modular jack and rack.

Vendor shall connect cable to Server, Switch, NAS, SAN or Network Equipment.

Vendor shall test all cables (end-to-end) by cable tester with report for each cable standard TIA/EIA 568B - ISO11801. (Example: Length, Attenuation, Resistance, Impedance) and test for CAT6 channel only.

Vendor shall provide cable number on drawing floor layout (AutoCAD or Visio files format and- Printed on papers).

Repair or replacement of defected equipment shall be completed within the period defined in hardware remedy services after receiving notification of failure and the vendor shall check end-to-end point with TIA/EIA 568B - ISO11801 standard. <Please compile this paragraph here :>

4.2.6.2 Fiber Optic cabling

Vendor is responsible to perform the cable wiring in THAI Office for connecting server to SAN Switch, from SAN Switch to Tape drive (if required), from disk storage to SAN Switch (if required).

Standard fiber cable with supported minimum data transfer speed 4 Gbps.

Vendor shall install fiber optic patch cable in flexible conduit. The end of flexible conduit shall be fixing at on back of racks.

Vendor shall provide fiber optic, fiber optic cabling and fiber optic patch (if required).

Vendor shall install exceed length of fiber optic patch cable on shelf at Server rack.

Vendor shall label origination and destination at the end of fiber optic patch cable. <Please compile this paragraph here :>



4.3 Network Requirements 4.3.1 Vendor shall provide WS-X6148A-GE-TX Ethernet Port 10/100/1000 RJ-45 48 Ports

at least 2 Modules.

<Please compile this paragraph here :>

4.4 Software Requirements 4.4.1 Vendor is requested to propose complete set of software licenses to serve all THAI’s

DW solutions, business requirements, infrastructure requirements and related

development tools with license certificate issued by product owner, and also at least

one complete set of software media. Vendor is also responsible to ensure that all

software licenses are properly validated and registered.

<Please compile this paragraph here :>4.4.2 Adequate numbers of software licenses shall be provided to serve all

user/administrator clients, control agents, server nodes and all business required in

this RFP.

<Please compile this paragraph here :>4.4.3 The proposed software for system administrator, system operator and database

administrator shall provide GUI and/or web-based user interface using Internet

Explorer.

<Please compile this paragraph here :> Ekkasit: Oracle Data Integrator comes with built-in a designer with graphical point-and-click interface. The designer is a tool allows developers or business users to specify the rules to apply to integration processes. With declarative design, the number and complexity of steps is greatly reduced, which in turn shortens implementation times. Automatic code generation reduces the learning curve for integration developers and streamlines access by non-IT professionals to the definition of their integration processes and data formats.



4.4.4 The proposed software for business services shall provide web-based user interface

using Internet Explorer.

BI part will comply this<Please compile this paragraph here :> 4.4.5 Vendor is responsible to install operating system, fixes/patches and all required

drivers as agreed with THAI technical support staff.

<Please compile this paragraph here :>SF will comply this. 4.4.6 Vendor is also responsible to install and configure all proposed software and all

required third party software.

<Please compile this paragraph here :>SF will comply this.

4.4.7 The proposed software should conform and be able to interface with existing THAI’sinfrastructure as defined in Appendix-B. For example: -

4.4.7.1 Support THAI’s operating system

Sun Solaris V10

IBM AIX V 5.3 or up

Windows 2003 or up (under VMWare ESX 3.5 or

up) VMWare ESX 3.5 or up

ODI 10gR3 is certified on Windows



2003 (SP1+), Sun Solaris v10 and AIX 5.3 (TL8+) platforms.(http://www.oracle.com/technology/products/oracle-data-integrator/10.1.3/htdocs/documentation/odi_certification.xls)<Please compile this paragraph here :>

4.4.7.2 Support THAI’s backup services

system

Veritas NetBackup 6.5 or up

IBM 3584 - Tape Library for Distributed Systems

Veritus comply this.<Please compile this paragraph here :> 4.4.7.3 Support THAI’s interface software between Tape Drive and Backup Server

as following detail (license per tape drive shall be provided):

VRTS Netbackup option shared storage for tape 6.5 XPLAT STD BAND S

VRTS Netbackup library based tape drive 6.5 XPLAT STD BAND S

Veritus comply this.<Please compile this paragraph here :> 4.4.7.4 Support THAI’s high availability system

Storage Foundation & HA v5 or up.

Veritas Cluster v5 or up

SF will choose on H/A file system.<Please compile this paragraph here :> 4.4.7.5 Support THAI’s database management system

IBM DB2 for AIX V 8.2 or up

ORACLE for Solaris V10g or up

SF purpose Oracle Database 11g<Please compile this paragraph here :> 4.4.7.6 Support THAI’s LDAP server for authentication and authorization

Microsoft Active Directory 2000/2003

Sun Java Directory

IBM Directory Server

SoftIT<Please compile this paragraph here :> will comply this (Oracle BI) 4.4.7.7 Support THAI’s Web Application server

IBM WebSphere

Sun Java Enterprise System

In case, proposed software does not conform to THAI’s infrastructure, its’ benefitshall be clearly defined.

SoftIT will comply this (Oracle BI Server)<Please compile this paragraph here :>

4.4.8 Software licenses proposed for the DW solution shall be provided (but not limited to)



the following software and features: -4.4.8.1 Operating System for all proposed servers. Yes. SF will provide OS license for all proposed servers. 4.4.8.2 Software agent for all client types such as system administrator, business

administrator, user, operator, etc. Yes. SF will provide license for all proposed software clients. 4.4.8.3 Database Engine for all proposed solutions such as DW, metadata, business

intelligence, data mining, etc Propose and describe how the proposed solution conforms to the requirements below:

Provide Real parallel process at database engine for • load parallel: provides load and unload utilities which leveraging

all parallelism features within the DW platform. • query parallel: provides unconditional parallelism whereby all

parts of every query plan execution are processed in parallel

when appropriate - including local sorting and aggregating that

accelerate the building of aggregates and derived data • load and query parallel: provides concurrent load and query

process with acceptable performance. • backup parallel and recovery parallel • parallel index creation • Etc.

Able to automatically balance user sessions across the processing nodes to spread the resource requirements of user and session management evenly. Provides an easy to manage platform that dynamically manages data distribution and space re-collection as part of normal processing. Provides non-impact business processing features to reclaim database space such as online database reorganization, or provides ability to reclaim space without database reorganization. Able to accommodate system expansion easily without having to perform a load/unload of the database. Provides open connectivity interfaces such as ODBC, OLE-DB, JDBC, CLI and others to access all data sources required in THAI’ business requirements. Provides data compression facility that can result in significant space savings in the DW environment. Provides the following high availability features for DBMS to perform: -



• Automatic node fail-over to surviving nodes or to a hot standby

node, if so equipped. • Optional Fallback capability (Fallback provides a software level

protection over and above RAID to support the highest level of

data availability) Provides a comprehensive set of DBMS auditing capabilities. Able to authenticate database users and password through LDAP v.3 (Light-Weighted Directory Access Protocol) Able to provide single sign-on capability for all proposed software. Able to provide both user and role based access control to effectively reduce the complexity and cost of security administration. Provides SQL extensions to perform complex statistical functions within the database engine. Should provide automatic and dynamic resources allocation to serve ad-hoc and incentive queries. Provides on-line full & incremental backup and archive capability that permits almost full use of the tables during the backup of the tables. Provide point-in-time recovery capability. Provides simplified management and administration of backup, archive and recovery operations. Provide database features to support cleaning-up obsolete data with high performance and minimum resource consuming, or archiving the data into cheaper media in the form that can be viewed or query by users when needed. Provide row-level security at the database table or view level and can extend it to provide column-level security as well. Essentially the SQL clause allows only users whose credentials pass the security policy.

<Please compile this paragraph here :>4.4.8.4 Metadata

Provide a complete description of proposed metadata solution, including the key features of the proposed solution and products, as well as what makes vendor’s solution unique. Propose and describe how the proposed solution conforms to the requirements below:

Metadata is required and shall be tightly integrated with all DW layers designed and easily view via graphic user interface (GUI) or web browser by authorized users. The metadata will used to keep the information architecture and all data structure with detail data definition/description for both business and technical perspectives including mapping flow of how data can be derived from data sources. Provide facilities that serve the following items:-



• Serves as a guide for understanding what metadata (data about

data) is captured and maintained in the Repository, where the

described data resides in corporate databases, and what corporate

applications and reports use the data. • Serves as a translation vehicle, providing common business

names and descriptions for technical data and abbreviations

stored in the Repository. • Empower users to access the corporate Repository with a few

clicks in a web browser. • Provide quick and easy facility for locating existing data elements

and their definitions. • Provide impact analysis features for detecting data relationships

and assessing the impact of proposed changes. • Provide tool to understand the impact of change to an information

system component. • Provide help facility to bridge the gap between technical naming

standards and commonly understood business namesEkkasit: Oracle Data Integrator Repository is built Oracle Data Integrator is built around an open, comprehensive metadata repository, which can be installed on relational databases such as Oracle, Microsoft SQL Server, IBM DB2 UDB, IBM DB2/400, Informix, Sybase AS Anywhere, Sybase AS Enterprise, and Sybase ASIQ. Because metadata is stored in database tables, the repository is completely open and can be used as a source by any reporting system.The repository includes all the domains used in data integration:- Security information—including users, profiles, and access privileges for the Oracle

Data Integrator platform - Topology information—including technologies, definitions of servers, schemas,

contexts, and languages- Data models—including descriptions of schemas, datastore structures, fields and

columns, data integrity rules, cross-references, data lineage, and so on - Integration projects—including declarative rules, transformation rules, mappings,

packages, procedures, folders, knowledge modules, variables, and so on - Execution—scenarios, scheduling information, and logs-

The Oracle Data Integrator Metadata Navigator web application provides access to repository metadata from any web browser. Users can browse the entire repository



metadata and graphical views of the data flows. With the Data Lineage feature, they can easily track data to the source items from which they were derived and subsequently integrated by Oracle Data Integrator.The Oracle Data Integrator Metadata Navigator in ODI is a web-based module, where users can address many of the metadata questions such as: What if the data type of this field is changed? Where does the data go, and how is it transformed? What are the rules that calculate a particular indicator? What was the last time my table was updated?

Business users can also effortlessly view flow maps, data lineage for understanding the path taken by data, and execution logs with accurate job statistics. <Please compile this paragraph here :>

Oracle Data Integrator provides a reverse engineering process that populates the repository with metadata from the information system. Reverse engineering retrieves metadata from data storage (databases, XML files, and so on) and loads it into the repository. (For example, reverse engineering detects the description of tables, columns, datatypes, constraints, and comments from a database to load the repository.) Reverse engineering supports database management systems, files of many diverse formats, and COBOL CopyBooks through wizards. Users can customize the reverse engineering process to retrieve nonstandard metadata from the databases or from proprietary repositories such as ERP/CRM (enterprise resource planning/customer relationship management) systems (SAP, Oracle’s Siebel, Oracle Applications, salesforce.com, and so on). Customization is done through Oracle Data Integrator’s reusable reverse engineering knowledge modules (RKMs). Oracle Data Integrator comes with pre-built RKMs for the major technologies. Oracle Data Integrator supports (http://www.oracle.com/technology/products/oracle-data-integrator/10.1.3/htdocs/documentation/odi_certification.xls):

- Oracle BI EE Suite+ (10.1.3.3) - Oracle Hyperion Essbase (7.1.6+) -

SoftIT (Oracle BI) for the red bullets.



4.4.8.5 Data Acquisition (ETL/ ELT), data cleansing and data quality module Provide a complete description of proposed data acquisition,

cleansing and data quality solution, including the key features of the proposed

solution and products, as well as what makes vendor’s solution unique.

Propose and describe how the proposed solution conforms to the requirements below:

Provide interactive and easy-to-use facility to setup ETL/ELT, data cleansing, data quality criteria.

Oracle Data Integrator comes with GUI component called ‘Designer’. This tool allows the business users or the developer specified the rules to apply to the integration

processes. The tool automatically generate data flows, manages their complexity, and administrators the correct instructions for the various source and target systems.

Perform automate functions and mapping flow to Extract all THAI’s data sources defined in this RFP, Transform Load (ETL) / Load Transform (ELT) to all levels of DW architecture.

Oracle ODI supports built-in database functions and data mapping. Provides an optimized ETL/ELT environment that leverages on the parallel and scalable nature of the proposed hardware and database for high performance.

Oracle ODI’s Knowledge Module implement how the integration processes occur. Each Knowledge Module type refers to a specific integration task:

Reverse-engineering metadata from the heterogeneous systems for ODI-EE. Handling Changed Data Capture (CDC) on a given system. Loading data from one system to another, using system-optimized methods. Integrating data in a target system, using specific strategies (insert/update,

slowly changing dimensions) Controlling Data Integrity on the data flow. Exposing data in the form of services.



(Page 9, Knowledge Modules Type, Data Integrator Enterprise Edition Technology Overview , ODIEE_ TECHNICALOVERVIEW.PDF).

Provide a handshake and automated mechanism to ensure data sources/ files has been passed from one process to another.

Oracle ODI architecture uses a runtime component ‘Agent’ to orchestrates the ELT process execution. (Page 19, Agent, Oracle Data Integrator Enterprise Edition Technology Overview, ODIEE_TECHNICALOVERVIEW.PDF)

Allow the tracking of data that is loaded to the DW from Source to Target.

Oracle ODI agent retrieve code from the execution repository and requests the database servers, operating systems, or scripting engines execute that code. When the execution completed, the agent updates the execution logs in the repository and reports error messages and execution statistics. The execution logs can be viewed from the Operator user interface or a web interface: Metadata Navigator. (Page 19, Agent, Oracle Data Integrator Enterprise Edition Technology Overview, ODIEE_TECHNICALOVERVIEW.PDF)

Able to restart the unsuccessful ETL/ELT process at the nearest point of failure; need not to start at beginning process.

Oracle Data Integrator’s customizable Check Knowledge Modules (CKMs) help developers automatically enforce the data integrity of their applications based on declarative rules that have been captured by Oracle Data Integrator. These CKMs generate the code necessary for static or dynamic data checks and also for any error recycling that is performed as part of the integration process.Audits provide statistics on the integrity of application data. They also isolate data that is detected as erroneous by applying the business rules. Once erroneous records have been identified and isolated in error tables, they can be accessed from Oracle Data Integrator Designer, or from any other front-end application. This extensive audit information on data integrity makes it possible to perform a detailed analysis, so that erroneous data can be handled according to information technology strategies and best practices. For example, the following are four ways erroneous data might be handled:

Automatically correct data—Oracle Data Integrator offers a set of tools to simplify the creation of data cleansing interfaces that can be scheduled to run at predetermined intervals.

Accept erroneous data (for the current project)—In this case, interface developers need precise rules for filtering out erroneous data later, using Oracle Data Integrator filters.

Correct the invalid records—In this situation, the invalid data is sent to application end users via various text formats or distribution modes, such as human workflow, e-mail, HTML, XML, flat text files, and so on, using Oracle Data Integrator packages.

Recycle data—Erroneous data from an audit can be recycled into the integration process.

(Page 5-6, Correct the invalid records, Comprehensive Data Quality with Oracle Data Integrator , oracledi_comprehensive_quality.pdf)

Support housekeeping processes to clean-up unnecessary data at all levels/layers of DW.



Oracle ODI KM supports ‘Delete all rows’ option, allows to purge all target table before new recorded be inserted. (Page 42, Knowledge Module Developer’s Guide, Sample Replace or Append section, oracledi_km_development.pdf)

Provide archiving processes to archive history data from active data to the inactive one. The archived data shall be designed and kept in the form that can be viewed or queried easily whenever required.

SF will create and design archive tables and design ELT processes to maintain archive data.

Provide workload management for ETL/ELT processes schedule with priority and processes dependency.

Oracle ODI comes with its own scheduler out-of-the box. This is a graphical scheduler to define schedules and job dependencies. One can schedule by time and interval, where conditions might also be embedded in the workflows. ODI can also integrate and leverage the use of any 3rd party scheduler that can run a program from a command line interface.

Provide easy-to-use report and print facility to produce ETL documents/report such as ETL mapping flow, schedule, data cleansing, data quality, and transformation criteria.

Perform data cleansing before transform and load target data as required by THAI. Please provide detail features. Provide easy-to-use cleansing module that can help data quality process with the following quality functions: -

• Free-form text investigation - to recognize and parse out

individual fields of data from free-form text, • Standardization - to allow individual fields to be made uniform

according to THAI’s defined standards, • Address verification and correction - uses postal information to

standardize, validate, and enrich address data, • Matching - allows duplicates to be removed from sources, and

common records and common records across sources to be

identified and linked, • Survivorship - allows the best data from across different systems

to be merged into a consolidated record. Oracle Data Integrator is a data integration software product, providing a new declarative design approach to defining data transformation and integration processes, resulting in faster and simpler development and maintenance. Based on an “E-L-T” architecture, Oracle Data Integrator guarantees the highest level of performance for the execution of data transformation and validation processes, along with providing one of the most cost-effective solutions available. By combining data based, event based, and service based integration, ODI is able to address varying needs from data



warehousing and business intelligence to Master Data Management, Service Oriented Architecture and others. Oracle Data Integrator provides a unified infrastructure to streamline data and application integration projects.

Oracle Data Integrator customers have chosen the tool for one or more of the key reasons below: - Faster and simpler development and maintenance: The declarative rules driven approach greatly reduces the learning curve of the product and increases developer productivity while facilitating ongoing maintenance. The approach separates the definition of the processes from their actual implementation, and separates the declarative rules (the ‘what’) from the data flows (the ‘how’).

- Better execution performance: Traditional ETL software is based on proprietary engines that perform data transformations row by row, thus limiting performance. By implementing an E-L-T architecture and leveraging RDBMS engines and SQL, data transformations are executed on the target server at a set-based level yielding much

higher performance.



- Simpler and more efficient architecture: The E-L-T architecture removes the need for an ETL hub server sitting between the sources and target server. It utilizes the target server RDBMS to perform complex transformations, most of which happen in batch mode when the server is not busy processing end-user queries.

Oracle Data Integrator is organized around a modular repository in client/server or thin client mode by components entirely written in Java: the graphical interface modules and execution agents.

The Repository is a comprehensive, open and shared metadata repository. It stores the metadata for the accessed applications involved in the transformation and integration processing, the developed project versions and all of the information required for their use (planning, scheduling and executing of reports) Topology Manager is the graphical interface module used to manage the data describing the information system’s physical and logical architecture. The site, machine, and data server descriptions will enable Oracle Data Integrator to execute the same interfaces in different environments. Designer is a tool used to design data integrity checks and to build transformations. In particular, it incorporates functions for: - Automatic reverse-engineering of existing applications or databases - Graphical development and maintenance of transformation and integration

interfaces - Visualization of data flows in the interfaces - Automatic documentation generation - Customization of the generated code

Security Manager is the tool for managing users and permissions in Oracle Data Integrator.



Operator is the production management and monitoring module. It is designed for IT production operators.

The Agent orchestrates the inter-application interfaces developed with Designer. It integrates the Scheduler to execute the interfaces according to a predefined schedule. It can also be invoked via web services to start integration scenarios. Metadata Navigator is a thin client, browser based interface to access the Oracle Data Integrator Repository, browse, search and analyze all its contents, and perform advanced data lineage tracing, cross referencing impact analysis, etc. This tool can also be used to manage production processes.

Warehouse Builder implements general-purpose data matching and merging capabilities that can be applied to any type of data.

You can write the list of rows matched by your algorithms to a target table. You can also implement complex de-duplication logic to generated merged records, again using a variety of built-in merge rules or implementing your own merge rules.

Warehouse Builder matching and merging provides the following functionality:

- Determine matches using built-in algorithms, such as the Jaro-Winkler and Levenshtein edit distance algorithms, or using a custom algorithm you implement.

- Use weighting to determine matches between records. - Generate a table containing candidate matches, as input to some other merge



logic, such as an existing master data management application - Generate a table with merged data records, with merge logic based on built-in

merge rules, custom-implemented merge logic, or complex merge rules that can combine packaged and custom rules

- Cross reference data to track and audit matches. - Built-in advanced matching rules for person, firm and address data

Warehouse Builder matching and merging can be combined with Warehouse Builder name and address cleansing functionality to support householding, which is the process of identifying unique households in name and address data.

Warehouse Builder includes name and address cleansing functionality and can integrate with third-party name and address cleansing tools from a number of vendors. Warehouse Builder parses the names and addresses, and uses methods specific to this type of data, such as matching common nicknames and abbreviations. You can compare the input data to the data libraries supplied by third-party name and address cleansing software vendors, identify and correct errors and inconsistencies in name and address source data. You can then further augment your records with information

such as postal routes and geographic coordinates.




4.4.8.6 Business Intelligence (BI) Provide a complete description of vendor’s proposed BI solution, including the key features and benefits of vendor’s BI solution and products which conform to the requirement below;

Provide report generating including graphical chart and display capability that shall be able to operate in the form of Table, and able to Drill Down for Expand information, Exception Reporting function (Color Code), and shall be able to make notes, comments, and remarks of the information showing at the relevant period. The important functions that shall be included in both report and chart capability are:

• Drag and Drop menu • Pull Down menu • Dropdown List Box; help in selecting the relevant information • Able to produce graphic output • Able to read-only access, slice and dice, drill down/up/across and

Online Analytical Processing (OLAP) on web • Able to produce Text and Graph output on the same screen • Able to export the data to slide show, Excel, Acrobat, Sequential

file and Hard Copy • Multifunction hotspot • Able to import data from various analysis tools such as Excel,

Sequential file • Able to resize and reposition objects • Customization • Able to function without additional program (Codeless

Programming)• On-line Assistance tutorials help and documentation • Able to customize and create Variety Button Styles • API provided for security protection of application, individual

screens and individual data. • Able to produce charts: Pie, Bar 2-3 dimension, Combine chart

with 2 axes, show Value and Capability to Drill down from Chart



• Able to customize reports with THAI logo and any graphical

image. Provide statistic capability that shall be able to perform Forecast: Trend Analysis, Economics Model, What if Analysis, and Ad-Hoc Inquiry Analysis. Provide printing capability that shall be able to print source program, screen dumps, and reports. Provide workload management for BI processes schedule with priority. Provide analytic engine which is capable of federating highly optimized queries across multiple data sources, integrating disparate data sources and presenting intelligence back to end user through a simplified business model.

SoftIT and I-Able<Please compile this paragraph here :> will comply this.

4.4.8.7 Data MiningProvide a complete analytic tool or application to discover relationships in data that were previously unknown and have considerable business value which has capability to better manage the operational aspects of the business as well as enabling an effective customer service management capability. Designed for a particular application requires less knowledge on the part of the analyst and narrows the choice of algorithms used to mine the data. To create Classification models and to validate or test these models such as;

• To analyze why a certain classification was made • To predict a classification for new data

Able the associations mining function to find items in data that are associated with each other in a meaningful way.

Oracle Benz will comply this.<Please compile this paragraph here :>

4.4.8.8 Backup, Archive and RecoveryProvide a complete description of proposed Backup, Archive and Recovery solution, including the key features of the proposed solution and products, as well as what makes vendor’s solution unique. The backup, archive and recovery solutions should have but not limited to the following features:-

Provide backup, archive and recovery solution for all proposed software. Provide the flexibility and scalability for performance needs and configuration growth. Provide parallel backup and parallel recovery Provide online archive capability that permits almost full use of the database/tables and data repository during backup the



data. Provide simplified and easy-to-use management and administration of backup, archive and recovery operations. Should be able to interface with THAI’s backup system - Veritas NetBackup v6.5. Adequate backup server, media server and agents licenses to backup proposed software and database shall be provided. Provide LAN-Free backup for all servers. Backup license for tape drive - Adequate licenses shall be provided for the amount of tape drives. The software names are as follows

• VRTS Netbackup option shared storage option for tape 6.5 XPLAT STD BAND S with media

• VRTS Netbackup library based tape drive 6.5 XPLAT STD

BAND S with media <Please compile this paragraph here :>

4.4.8.9 Application Development Tools Provide a complete description of proposed Application Development Tools, which shall assist THAI’s application/business developers, database administrators, and end users to speed up delivering of business services related to the DW, and provide the key features of the proposed solution and products, as well as what makes vendor’s solution unique.

Oracle JDeveloper integrates development features for Java, SOA, Web 2.0, Database, Web, XML and Web services into a single development tool. The various artifacts share the same project structure and development experience, simplifying both the learning curve and the development process of composite applications that leverage a multitude of technologies. Oracle JDeveloper covers the full development lifecycle from initial design and analysis, through the coding and testing phases, all the way to deployment. Developers can design, generate, and visualize their code with UML, Java and database diagrams. An advanced coding environment and declarative and visual editors facilitate faster code development. Integrated testing, profiling, and code auditing features ensure the quality of the applications. Interfaces with versioning, build, and deployment tools enable packaging and deployment of the applications.



Oracle JDeveloper focuses on increasing developers productivity by offering a visual and declarative approach to application design. A combination of visual editors, property inspectors, structure panes, and editing dialogs simplify and eliminate tedious coding. These declarative features provide a simpler way to define the components that construct an application. The application’s code is always accessible for direct manipulation as well. Changes can be made by either the declarative means or directly in the code and are reflected in both simultaneously.

(Page 1 and 2, JDeveloper 11g Datasheet, jdeveloper11g-datasheet.pdf)<Please compile this paragraph here :>

4.4.8.10 Other Applications

Vendor shall provide solution conforms to the requirements

below:

PNR decode application and its detail specification.

The scheduling tool suitable for a DW environment.(Control-M preferable)


4.4.9 System Security

4.4.9.1 Vendor shall follow the policy, standards and regulation established by

THAI. This includes but not limited to THAI Security policy, user

authentication at the time of login, password management, user access

control, data access control, standard procedure, Building and premises

procedure, Human resources procedure, Data Center procedure, etc.

4.4.9.2 Vendor shall conduct the design session of the audit logs for DW system to identify the information needed to be kept, the log retention, the frequency of log review, the log protection according to the legal requirements (i.e. Computer Crime Act. B.E. 2550) and the business requirements.

4.4.9.3 Quality assurance should be conducted to ensure that all system functional

requirements, technical requirements and security requirements are satisfied.

This includes the functionality test, performance test and security test.

4.4.9.4 Vendor need to ensure that data is masked consistently in test environments

to a unique masked value to maintain the relationship between the data

across the test database while protecting the confidentiality of the original



sensitive data.

4.4.9.5 Vendor shall be included security roles and responsibilities for whom

working for THAI as part of the contracts.

4.4.9.6 Vendor may advise and provide alternative all DW security control

functions and all other related modules which can be more favorable to

THAI.



4.Technical Infrastructure Requirements-2.3

Documents

Transcript of 4.Technical Infrastructure Requirements-2.3