Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and...

9
Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers with a self-service model enabling ad-hoc analysis, dashboards, canned reporting, and analytics Provide a 3-5 year scalable architecture that accommodates 50-100 terabytes Maintain a high performance in a large, mixed user environment Make data management more efficient, less expensive, and very predictable Reduce TCO relating to system upgrades and support

Transcript of Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and...

Page 1: Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers.

Goals• Deploy a BI foundation that meets scaling requirements, offers speed,

flexibility and simplicity to delivery requirements• Provide users and customers with a self-service model enabling ad-

hoc analysis, dashboards, canned reporting, and analytics• Provide a 3-5 year scalable architecture that accommodates 50-100

terabytes • Maintain a high performance in a large, mixed user environment • Make data management more efficient, less expensive, and very

predictable• Reduce TCO relating to system upgrades and support

Page 2: Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers.

Why Netezza First1. Presentations, contacts with customers, and

discussions took place with both Teradata and Netezza2. We carefully reviewed what was presented and

proposed to our company3. Even if the idea was at one point to have both vendors

on site for concurrent POCs, the Netezza representation had far more appeal and we decided that the most appropriate sequence was to start with this vendor

Page 3: Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers.

Identification of Key Evaluation Criteria• “Game-changing” ad hoc query and analytical SQL

performance of at least 30X current• Ability to load huge volumes of site traffic data

within acceptable load windows and SLAs (at least 10X current)

• Data compression of at least 2:1 with zero negative impact to performance

• Enterprise-class administration and backup/recovery capabilities

• Ease of administration and quality vendor support

Page 4: Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers.

Identify the Tests to be Performed• Various MicroStrategy reports from the CPOR application run

on Netezza and current Production environment– Run individually and in various levels of concurrency

• Analytical SQL run against Site Traffic data in both environments– Actual queries analysts struggle with in Production due to

performance issues• Informatica ETL workflows for loading Site Traffic data

– Includes hourly loads and post-processing (sessionizing)• Various administrative scenarios and routine maintenance

– User administration, component failover, backup and recovery

Page 5: Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers.

MicroStrategy Report Performance

Page 6: Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers.

Analytical SQL Performance

Page 7: Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers.

ETL Load Performance

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Site Traffic Workflow Site Traffic Post-process

Oracle

Netezza

Page 8: Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers.

Benchmark ResultsNETEZZA ASSESSMENT

0

1

2

3

4

5QUERY CAPABILITIES

ANALYTICS CAPABILITIES

LOAD CAPABILITIESADMINISTRATION

BACKUP & RECOVERY

QUERY CAPABILITIES 4.89

ANALYTICS CAPABILITIES 4.72

LOAD CAPABILITIES 4.26

ADMINISTRATION 3.75

BACKUP & RECOVERY 4.33

Page 9: Goals Deploy a BI foundation that meets scaling requirements, offers speed, flexibility and simplicity to delivery requirements Provide users and customers.

Next Steps• Fix the network surrounding the platforms • Provide training to Delivery side of the teams• Partition of the Toaster (QA/Dev/Prod) • Finalize SLA with Ops (who owns what) • Transition to Ops • Provide “playground” to the Delivery teams • New focus for each of the BIT3 members to

provide guidance, mentorship, and standards to Delivery teams across the company