Sun microsystems bi infrastructure

43
Jim McManus Managing Consultant - BI/DW Sun Microsystems, Inc. SUN BUSINESS INTELLIGENCE DATA WAREHOUSE (BIDW) SOLUTIONS Infrastructure Made Easy

description

SUN MICROSYSTEMS BI INFRSATRUCTURE

Transcript of Sun microsystems bi infrastructure

Page 1: Sun microsystems bi infrastructure

Jim McManusManaging Consultant - BI/DWSun Microsystems, Inc.

SUN BUSINESS INTELLIGENCE DATAWAREHOUSE (BIDW) SOLUTIONS

Infrastructure Made Easy

Page 2: Sun microsystems bi infrastructure

Agenda

• Trends and typical requirements• BI Platform (SW and Infrastructure)• Data Integration• Data Warehouse• BI Reporting and Analytics• BI Access Layer• Summary

Page 3: Sun microsystems bi infrastructure

Trends in BI and DW• User populationUser population

• SecuritySecurity

• Volume of queries, Volume of queries, reports, analysisreports, analysis

• Enormous diversity of Enormous diversity of datadata

• Mass of customized dataMass of customized data

• Regulatory requirementsRegulatory requirements

Everything is Increasing!

Page 4: Sun microsystems bi infrastructure

BIDW Requirements

BIDW

FlexibilityFlexibility

ScalabilityScalability

PerformancePerformance

High AvailabilityHigh AvailabilityEnterpriseEnterpriseSecuritySecurity

Quick ROIQuick ROI

Cost-EffectiveCost-Effective

Long-TermLong-TermFoundationFoundation

Page 5: Sun microsystems bi infrastructure

Smarter Services for BIDWA Low Risk and Cost-Effective Approach to Architecting BIDW Environments

Business FocusedBusiness FocusedArchitecture Architecture

Approach Approach

Uniquely satisfies Uniquely satisfies BIDWBIDW

deployment deployment challengeschallenges

Based on Based on specific business specific business

requirementsrequirements

Develop & DeployDevelop & DeploySound Sound

ArchitecturesArchitectures Help Ensure SLAHelp Ensure SLA

AttainmentAttainment Extensive Extensive

Knowledge, ProvenKnowledge, ProvenDelivery MethodsDelivery Methods

While meeting While meeting business business

requirementsrequirements

Help reduce Help reduce cost & improve cost & improve

utilizationutilization

BIDW ServicesBIDW Services

• Executive BriefingExecutive Briefing• WorkshopWorkshop• Justification/TCOJustification/TCO

Analysis WorkshopAnalysis Workshop• Planning & Planning &

ConfigurationConfiguration• TrainingTraining• Architecture & Architecture &

Design & POCsDesign & POCs• Implementation & Implementation &

DeliveryDelivery• MigrationMigration• Performance TuningPerformance Tuning

Page 6: Sun microsystems bi infrastructure

BI Platform – SAS & Sun

Page 7: Sun microsystems bi infrastructure

The SAS Industry FrameworkCovering End-To-End Business Intelligence Needs

Page 8: Sun microsystems bi infrastructure

SAS Enterprise BI

SPIN

Cluster Analysis

Web Solutions Reports

Customer Repository(Managed Data Environment)

IMS

ODS

ZS Systems

SFA OLTP Database

Access1 B I

ATSI Color-graphics

SAP SD

SAP HR

SAP FI

Reports

Sales AnalysisWorkstation

Dart MC

Dart MDDashboard

Home OfficeWorkstationPPD

Blue Current

NTIS

MCO Field

Newton CCT

E Initiatives Workstation

Spin Webserver

Roche

CyborgHR Admin Workstation

Sales Admin Workstation

Concur

Accounting Workstation

Medical Services Workstation

Rep Laptop

IC Workstation

SAS 9

Page 9: Sun microsystems bi infrastructure

Sun BIDW Solution Architecture

Page 10: Sun microsystems bi infrastructure

Sun’ Infrastructure Options

Simplicity, Choice, Innovation, Security, Investment ProtectionData Management Resource

Management

Operating Systems

Processors/Servers

ApplicationPlatform

Suite

IdentityManagement

Suite

AvailabilitySuite

CommunicationsSuite

IntegrationSuite

Web Infrastructure

SuiteJava Enterprise System

BIDW Proof-of-Concept

ArchitecturesBIDW Services Sun Solution

CentersIndustry Leading Partners

Sun Service

Page 11: Sun microsystems bi infrastructure

Data Integration

Page 12: Sun microsystems bi infrastructure

Data Integration

80 percent of BIDW projects are spent building and maintainingthe data infrastructure

Page 13: Sun microsystems bi infrastructure

Requirements will drive the Design

Define Business, System, Data, Process and Personnel CTQs● What data and how often does the business require data to be loaded?● What are the availability requirements?● How much data will be pumped through the ETL process and what type of transformation will be done?● How will this process be supported (application, operations, etc) and by whom?

Page 14: Sun microsystems bi infrastructure

Data Integration Design AlternativesHorizontal(Grid) vs Vertical: Operating Systems: Solaris(SPARC or x86), RedHat, Suse, Windows Chip Technologies: SPARC, CoolThreads, AMD, Intel

Keys to Success: Focus on Requirements Focus on Supportability Focus on reducing complexity

Page 15: Sun microsystems bi infrastructure

Sun Strengths for Data Integration• CoolThreads – designed for

throughput (8 cores, 32 threads)• UltraSPARC IV+ — world record

setting performance(2.2TB < 90 minutes)

• AMD Opteron x64 servers — 65 world records and counting

• Sun Grid Computing – manage as a single resource, scalability

• Manage individual resources with Solaris Containers

Up to 32 SimultaneousThreads!

Page 16: Sun microsystems bi infrastructure

Data Warehouse

Page 17: Sun microsystems bi infrastructure

Warehouse Enterprise Engine

Page 18: Sun microsystems bi infrastructure

Data Lifecycle Management

Page 19: Sun microsystems bi infrastructure

Once Again, Focus on RequirementsDefine Business, System, Data, Process and Personnel CTQs What are the business query requirements? (adhoc, analytics, basic reporting, etc) What are the availability requirements? (9x5, cost of downtime, etc.) What is the merge and purge requirements? (2 yrs online, 3 yrs within reach, etc.) How will this environment be supported (application, operations, etc) and by whom?

Page 20: Sun microsystems bi infrastructure

DW Design Alternatives/OpinionsClustered vs non-Clustered, Vertical vs Horizontal, Tiered Storage(ILM) vs non-Tiered Storage Focus on Data and System CTQs Limited Horizontally Scaling (AMD, SPARC) – (ie don’t scale past 4 nodes) Develop a ILM strategy up front to support your merge and purge strategy. Performance focused – remove dormant data

Page 21: Sun microsystems bi infrastructure

Sun Strengths for the Warehouse Enterprise Engine

Proven performance forlarge DW—TPC-H QphH

59,435@3TB31% > than

leaderOn-the-flyscalability

Servers and Storage

High Availability

Designing next generation CPUs

(ROCK) for DB performance

Idealconsolidation

platform to reducecomplexity

Page 22: Sun microsystems bi infrastructure

Service Availability for Every Need

Availability

Page 23: Sun microsystems bi infrastructure

Sun Strengths for Data Lifecycle Management

Multiple Tiers of Storage

Partners

Page 24: Sun microsystems bi infrastructure

Storage Management• Automated storage resource management and

provisioning• Data protection and recoverability• Hierarchical storage management – SAM-FS• Automated policy management – SAM-FS

Page 25: Sun microsystems bi infrastructure

Flexibility, Scalability, and Performance

• Flexibility> Virtualization and automatic provisioning for data on-demand> Dynamically reconfigure resources> Solaris Containers and Solaris Resource Manager

• Performance> World-record benchmarks for SMP systems> Sun is the fastest data warehouse engine> CMT – more throughput and scalability> MPO – faster access to memory

• Scale up or out non-disruptivelyScalability

Page 26: Sun microsystems bi infrastructure

Application Service Availability At a Low Cost – Sun Java Availability Suite

• Continuous access to data and network

• $50 USD/per/employee subscription model

• Very fast recovery from failure• Support for Solaris SPARC and x64

platforms• Easier to manage• Supports SAS products

Availability

Page 27: Sun microsystems bi infrastructure

Manageability• Dynamic domains - manage pools of resources

individually• Solaris Containers - isolate applications in domains• Solaris Resource Manager - allocate resources

where needed• Sun StorEdge Pool Manager - same concepts for

storage• Sun StorEdge Data Services - common data

protection services

Page 28: Sun microsystems bi infrastructure

BI Reporting & Analytics

Page 29: Sun microsystems bi infrastructure

BI AnalysisAccess to Multidimensional Data

Page 30: Sun microsystems bi infrastructure

BI Analysis NeedsAccess to Multidimensional Data

• Spontaneous, ad-hoc queries to uncover trends and identify anomalies

• Support multi-threaded OLAP engines

• N-tier for load balancing, high availability

• 64-bit for larger analytical models

OracleSAS Cognos Hyperion Business ObjectsActuate

Page 31: Sun microsystems bi infrastructure

Considerations for BI Analysis

• Flexibility and Scalability> UltraSPARC for vertical scaling to

increase performance for analytics> CoolThreads for BI reporting> AMD Opteron servers for leading

performance, low-cost, less space, and energy-efficient

> J2EE architecture to support SOA initiatives

> Managed as a single, unified resource

Page 32: Sun microsystems bi infrastructure

Common OS – The Solaris 10 Operating System

• Binary compatibility and Binary compatibility and scalability – 1 to 144 cpusscalability – 1 to 144 cpus

• PerformancePerformance> Faster access to memoryFaster access to memory> Enhanced throughputEnhanced throughput> Streamlined networking stackStreamlined networking stack

• Virtualization and provisioningVirtualization and provisioning> Solaris ContainersSolaris Containers> Solaris Resource ManagerSolaris Resource Manager> Dynamic System Domains, Dynamic System Domains,

automated reconfigurationautomated reconfiguration• ReliabilityReliability

> DTraceDTrace> Predictive Self HealingPredictive Self Healing

Key Features

Page 33: Sun microsystems bi infrastructure

BI Access Layer

Page 34: Sun microsystems bi infrastructure

Access and Delivery

Page 35: Sun microsystems bi infrastructure

Access and Delivery Needs

• Secure access for customers, employees, and partners

• Anywhere access• Central administration

Page 36: Sun microsystems bi infrastructure

Sun Strengths for Access and Delivery

• Sun Java Identity Management Suite> Centralized enterprise wide approach> Single point of entry and sign-on> Quickly and automatically add and manage users> Control access to sensitive data> Secure, remote access

• Customized Java Identity Management Suite for any BI tool• Sun & Teleran iSight and iGuard(Application Usage Mgmt)

> Query monitoring, predictive analysis, and Web reporting> Query controls through policy management

Page 37: Sun microsystems bi infrastructure

How we can make a difference

Page 38: Sun microsystems bi infrastructure

Winter Top Ten

• Sun has 6 of 10 largest DW on UNIX by normalized volume

• Increased total awards from 28 to 72 in 2003

• 6 of 10, normalized data volume, UNIX, 5 of 10 all platforms

• Top 6, including #1 OLTP highest workload – 8.6 million SQL statements per hour, top 3 Scientific

• World's largest scientific system, normalized volume, 364 GB

• World's largest commercial database, over 100 TB, runs on the Solaris OS

ProvenPerformance

Page 39: Sun microsystems bi infrastructure

BIDW Proof-of-Concept Architectures

Designed

Pre-Tested

Reduces Risk

Cost

Complexity

Page 40: Sun microsystems bi infrastructure

Sun Solution CentersDedicated BIDW & SAS Competency Centers

• World-wide• Proof-of-concept• Testing for

performance and scalability

• Partner offerings• Learn from experts

Page 41: Sun microsystems bi infrastructure

Summary• Focus your solution towards ALL requirements• Smarter solutions to help you stay competitive

> Maximize investment in industry-leading technologies> Choice in partners for innovative, competitive solutions to

solve your business needs> Reduce risk with a consistent end-to-end infrastructure,

proof-of-concept architectures, and BIDW services> Open platform to integrate data and applications

> Open, free, industrial-strength OS with the Solaris 10 OS> Industry-standard AMD Opteron servers running the Solaris

OS, Linux, or Windows> One of the most comprehensive data, identity, and storage

management portfolios in the industry

Page 42: Sun microsystems bi infrastructure

Next Steps• Visit sun.com/bidw• Contact your Sun Sales

Representative to schedule a workshop

• Visit a Sun Solution Center to test before you invest

• Contact me at [email protected]

Page 43: Sun microsystems bi infrastructure

SUN BUSINESS INTELLIGENCE SOLUTIONS

Jim McManusManaging Consultant - BI/DWSun Microsystems, Inc.