Change the "I" in BIS to Intelligence

BIS-4041: Change the “I” in BIS to Intelligence

Tuesday, 8 am

2

Agenda

2 © 2008 CIBER, Inc. All rights reserved

BusinessBusinessInformationInformationIntelligenceIntelligenceServerServer

3

Agenda

• Who is CIBER?

• The Evolution of BI

• Self Service BI

• Components of BI

• Building your BI System

• Questions and Answers

© 2008 CIBER, Inc. All rights reserved

4

Who is CIBER?

4

A $1 billion Global IT services company that builds, integrates and supports applications and infrastructures for business and government

• More than 8,000 employees• NYSE: CBR - Headquartered in Denver• 85 Offices in 18 countries• Leader in ERP implementation and support,

State and Local government solutions, and Federal government solutions

• CIBERsites Distributed Delivery Framework

– Domestic development centers– IT Operations outsourcing– Offshore development and support

• ISO 9001 certified


5

CIBER is the IT services partner that

business-focused CIOs count on to deliver

tangible value to the enterprise.


Who is CIBER?

Just ask our customers…96% of whom say they will use CIBER again and 97% of whom will unequivocally recommend CIBER to their colleagues.

6

Business Information Server(MAPPER)

Internet Commerce Enabler(Cool ICE)

BIS Services Organization

Modernization Services

7

The Evolution of Intelligence Systems


8

Evolution of Intelligence Systems

• MIS (Management Information Systems) 1970’s

• DSS (Decision Support Systems) 1980’s

• EIS (Executive Information Systems) Late 1990’s

• BI (Business Intelligence) 2000’s


9

MIS DSS EIS BI


1970 1980 1990 2000

SQL RDMS OLAP Data Marts Spreadsheets Expert Systems

Graphic Terminals Disk space Fast Networks

Evolution of Intelligence Systems

10© 2008 CIBER, Inc. All rights reserved

What is Business Intelligence?

• Monitoring • Querying• Drilling• Analysis• Data Mining



• Monitoring: Dashboards


• Querying: Most often SQL

־ Need to know the database Natural Language to SQL Schedule query and wait for report So many reports that you need

Google to find them



• QueryingNatural Language to SQL:

What customers had an order in the last 12 months but had no order in the last 12 weeks?

What customers bought tables but not chairs?SELECT DISTINCT “CustomerName” as “Customer” FROM “Customers” WHERE exists (SELECT * FROM “Products”,“InvoiceLineItems”,”ProductSubCategories” WHERE (“SubCategoryName”=‘Tables’) and “Customers”.”CustomerKey”=“InvoiceLineItems”.”CustomerKey” and “Products”.”ProductKey”=“InvoiceLineItems”.”ProductKey” and “ProductSubCategories”.”SubCategoryCode”= “Products”.”SubCategoryCode”) and not exists (SELECT * FROM “Products”,“InvoiceLineItems”,”ProductSubCategories” WHERE (“SubCategoryName”=‘Chairs’) and “Customers”.”CustomerKey”=“InvoiceLineItems”.”CustomerKey” and “Products”.”ProductKey”=“InvoiceLineItems”.”ProductKey” and “ProductSubCategories”.”SubCategoryCode”= “Products”.”SubCategoryCode”);

SELECT DISTINCT “CustomerName” as “Customer” FROM “Customers” WHERE exists (SELECT * FROM “InvoiceLineItems” WHERE (“RefDate” between ‘2006-12-31 12:44:00’ and ‘2007-12-31 12:44:00’) and “Customers”.”CustomerKey”=“InvoiceLineItems”.”CustomerKey”) and not exists (SELECT * FROM “InvoiceLineItems” WHERE (“RefDate” between ‘2007-10-08 12:44:00’ and ‘2007-12-31 12:44:00’) and “Customers”.”CustomerKey”=“InvoiceLineItems”.”CustomerKey”);




• Drilling: Drill down:

־ to access more detailed data Roll up:

־ to see the summarized data Drill across:

־ to access the data of interrelated dimensions



• Analysis: Subtotaling Averaging Min and Max Ranking Display as a graph:

־ Line chart, bar chart, pie chart, histogram, scatter diagram (w regression lines)


• Data Mining Knowledge Discovery Algorithms process

huge amounts of data looking for interesting things, with no prior hypotheses



• Data Mining Techniques Associations Discovery Sequential Pattern Discovery Classification Clustering Forecasting

Data Mining


• Associations Discovery Links occurrences within a single event “If a customer buys snacks, there is an 85

percent probability that the customer will also buy soft drinks or beer.”

• Sequential Pattern Discovery Links events over time “If a customer buys a washing machine, there

is a 70% probability that they will also buy a dryer within six months.”

Data Mining


• Classification Looks at the behavior and attributes of

predetermined groups like frequent flyers,high spenders, or loyal customers

Can identify whether a new person might fit into that group

• Clustering Used to discover different groupings within

data when no groups have yet been defined Used for detecting manufacturing defects or

finding affinity groups for credit cards

Data Mining


• Forecasting Regression analysis: uses known values of

data to predict future values or events based on historical trends and statistics

Time sequence discovery: Forecasts only time-dependent values, e.g. rates of accidents during a holiday season based on rates from previous years

Data Mining


So what do users really want?

Do they want to:

1) Form queries to retrieve and format data? or2) Monitor & analyze data to make decisions?

Self Service BI


Percentage of Active BI Users

Self Service BI


Typical BI UsersPower Users (20%)Create lots of reportsCreate inconsistent reports Create runaway queriesWaste time & money

Casual Users (80%)Can’t find the right report No single version of truthSlow response times Too complex to use

Self Service BI

25

Form a query

Get a list of “Reports” that might match

You can even search for an available report

Self Service BI


• A layered information delivery system

• Tailored to a specific group of users

• That individuals can personalize

• A performance dashboard or parameterized report

What is Tailored Delivery?

Self Service BI


• Each contains about 20 dimensions and 12 metrics

• Users think they are doing “ad hoc” but they’re not

• Each can replace dozens or hundreds of reports

Tailored Delivery

Self Service BI

28

Self Service BI


Performance Dashboard

GraphicalData

Summarized Data

Detailed Data

Monitor

Analyze

Drill thru

Functionality Users

Managers

Analysts

Workers


Where we want to go…thesweetspot

Self Service BI

30

BIS & RADS

can take you there

31

Building your BI System


B I S

RADS

YourB I

Customize

Tools

Power

32

The Components


ETL

OperationalDB

Internet

OperationalDB

OperationalDB

Data Mart

OLAP

PresentationAnalysis

• Dashboards• Graphs• Tables

Spreadsheet

Business Intelligence

Building Your BI System

33

• ETL: RADS• Data mart: BIS• Analysis: BIS• Dashboard: RADS• Drilldown: RADS


B I S

RADS

YourB I

HOWTO

Building your BI System

34

• Design and Plan Data discovery

־ What data do you have?־ Where is it?־ What does it look like?־ How does it need to be transformed

to load it into the data mart?־ How often does it need to be loaded?

Meta Data־ Populated during data discovery־ Supports automated ETL


Building Your BI SystemB I S

RADS

YourB I

35

• Design and Plan Data mart design

־ Do you store all transaction data?־ What data do you summarize?־ How do you add new data?־ How long do you keep data?־ How do you handle slowing changing values?

Presentation־ How can you customize dashboards for

specific users?־ How do you provide secured drill-down?



RADS

YourB I

36

• ETL Issues Extracting

־ Do you to extract RDMS, flat files, IMS, ISAM,spreadsheets, and/or web crawlers?

־ Which columns do you select?־ When and how often do you extract?־ How long will the extractions take?־ How do you coordinate extraction from

different servers at different times?



RADS

YourB I

37

• ETL Issues Transforming

־ Selecting on certain columns־ Translating coded values־ Encoding free form values־ Deriving a calculated value־ Joining data from multiple sources־ Summarizing multiple rows־ Transposing or pivoting rows and columns־ Splitting a column into multiple columns־ Applying and reporting validations



RADS

YourB I

38

• ETL Issues Loading

־ How is the data spread?־ Can you add at the bottom?־ How do you recalculate summarized data?־ Can you perform loads without impacting

on-line users?־ Can you exploit parallel processing?



RADS

YourB I

39

• ETL with RADS Data_Services Use meta data stored in BIS Extract

־ A separate data_service for each extract ־ Schedule extracts thru SCHEDULER־ RDMS extracts with @FCH־ Non-RDMS extracts with batch jobs, FTP

and @RET־ Spreadsheet extract with CIBER Excel

Import Utility



RADS

YourB I

40

• ETL with RADS Data_Services Use meta data stored in BIS Transform

־ Separate transformation data_services־ RADS “filters” to change column arrangement,

widths and names־ Each field mapped to zero or more subroutines־ Shared subroutines for special transformations

o Standardizing nameso Standardizing dateso Splitting addresses



RADS

YourB I



RADS

YourB I

� � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ� � � B� ¸ ä e Ð ñ e l K � T � e í · W » ¾ e ¼ ø ñ � è eí · � á “ dt ß � �0™9� 5� � � � � � � , Q )—Ø¤9: � � �� ¯ 9� ° 9� $Ò̀ • 9� � ß½� � I � � � � � � Ðñ

42

• Data mart with BIS Relational not required Normalization not required Store data based on:

־ how it is used most often־ the ease of loading new data

The first step in queries is a Search־ Minimize the breadth of the search־ Maximize the ease of the search


B I SRADS

YourB I


43

• Data mart with BIS One dimensional:

־ single rid or single drawer Two dimensional:

־ single drawer with rids in cross-sections Multi dimensional:

־ Store event (transaction) centrally־ Store dimensions relationally


B I SRADS

YourB I



B I SRADS

YourB I


Two Dimensional (Grid)

1 2 3 4 5 6 7 8 9 10

11 12 13 14 15 16 16 18 9 20

21 22 23 24 25 26 27 28 29 30

31 32 33 34 35 36 37 38 39 40

41 42 43 44 45 46 47 48 49 50

51 52 53 54 55 56 57 58 59 60

61 62 63 64 65 66 67 68 69 70

71 72 73 74 75 76 77 78 79 80

81 82 83 84 85 86 87 88 89 90

91 92 93 94 95 96 97 98 99 100

Customer groups

Pro

duct

gro

ups


B I SRADS

YourB I


Multidimensional (Star Schema)

46

B I SRADS

YourB I

• Analysis with BIS Typical BIS query

־ Search transactions־ Count ־ RADS filter to add Name or Description־ Match in Name or Description

Another dimension־ Rename above result־ Search another dimension־ Match this into rename with “m” option


47

• Dashboard with RADS Screen_Form“A dashboard is a visual display of the most important information needed to achieve one or more objectives; consolidated and arranged on a single screen so the information can be monitored at a glance.”

Stephen Few, “Dashboard Confusion”, Intelligent Enterprise, March 20, 2004.


B I SRADS

YourB I


48

• Dashboard with RADS Screen_Form KPI’s

־ Thermometer, gas gauge, traffic light, etc. Graphs

־ Several per screen Drill-down

־ From KPI or graph ־ To table־ To RADS screen


B I SRADS

YourB I


49

B I SRADS

YourB I


50

• Drill-down with RADS Pro Capability

־ From a screen’s list box־ Requires one or more key fields־ Multiple drill-downs per screen

Define־ RADS > Links > Drill Down Administration

Execute־ Drill icon on tool bar ־ Magnifying glass in lower right ־ Double-click in list box


B I SRADS

YourB I


51

B I SRADS

YourB I

DEMO


52

Summary and Questions

??• Questions

Who is CIBER? The Evolution of BI Self Service BI Components of BI Building your BI System

53

Custom Solutions

14746-B N. 78th WayScottsdale, AZ 85260Phone: (480) 624-4900

www.ciber.com

54

• “Business Intelligence Roadmap”, Moss and Atre, Addison-Wesley publishers

• “Information Dashboard Design” by Stephen Few; O’Reilly & Associates publisher

• “Performance Dashboards: Measuring, Monitoring, and Managing Your Business” by Wayne W. Eckerson; John Wiley & Sons publisher

Additional Resources

Change the "I" in BIS to Intelligence

Documents

Transcript of Change the "I" in BIS to Intelligence