Architecting business intelligence system
-
date post
18-Oct-2014 -
Category
Technology
-
view
1.049 -
download
0
description
Transcript of Architecting business intelligence system
![Page 1: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/1.jpg)
Architecting Business Intelligence System
![Page 2: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/2.jpg)
Slava KokaevLead Business Intelligence Architect at
Industrial Defender
Email: [email protected]: @SlavaKokaev
![Page 3: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/3.jpg)
Agenda
• What is business intelligence?• Business Intelligence Architecture• Understanding Business Process and System
Architecture• Modeling Business Processes• Modeling Dataflow• Modeling Dimensional Model• Modeling Analytical System• ETL Architecture
![Page 4: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/4.jpg)
Tools And Technologies
• Microsoft SQL Server 2012 Database Engen• Microsoft SQL Server 2012 Integration Services• Microsoft SQL Server 2012 Analysis Services• Microsoft SQL Server 2012 Reporting Services• SQL Server Data Tools in Visual Studio 2012• UML• IDEF0 Notation• SADT Methodology
![Page 5: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/5.jpg)
What is Business Intelligence?
Business intelligence (BI) is a set of theories, methodologies, processes, architectures, and technologies that transform raw data into meaningful and useful information for business purposes."Business Intelligence - enables more effective strategic, tactical, and operational insights and decision-making."
![Page 6: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/6.jpg)
What is Business Intelligence Technologies?
BI technologies provide historical, current and predictive views of business operations.
Expl
ore
Anal
yze
Visu
alize
Cont
rol
![Page 7: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/7.jpg)
Types of BI SystemsBatch processing Architecture Scheduled Large dataset size
Close to real time architecture Scheduled or triggered Small dataset size
Real Time architecture Data stream Messages
![Page 8: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/8.jpg)
Business Processes
![Page 9: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/9.jpg)
Enterprise Business Analysis System
Customers Business partners
Vendors, Suppliers, Channel partners
IT providers Financial service providers
Monitoring Systems Analysis Systems
Business Processes and Operations
Controlling Systems Strategy and Planning Systems
![Page 10: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/10.jpg)
Business Conceptual FrameworkD
ata
Sou
rces
Data
In
tegra
tion
Data
Sto
rage
Data
Analy
tics
(l
ogic
)
Data
Vis
ualiz
ati
on
Clie
nt
App
licati
on
ETL Data Warehouse Data Presentation
![Page 11: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/11.jpg)
Data Sources
Customer Web App Order Cloud
Web Service
FTP Server
Database Server
![Page 12: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/12.jpg)
Data Sources
Customer Web App Order Cloud
Web Service
FTP Server
Database Server
ETL
![Page 13: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/13.jpg)
Web Service
FTP Server
Database Server
ETL Extract, Transform, Load
ETL
Data Warehouse
![Page 14: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/14.jpg)
ETL Extract, Transform, Load
Web Service
FTP Server
Database Server
ETL
Data Warehouse
Data Warehouse
![Page 15: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/15.jpg)
Data Warehouse
Data Warehouse
OLAP Cube
Data Mining
Structure
![Page 16: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/16.jpg)
Data Warehouse
Data Warehouse
OLAP Cube
Data Mining
Structure
Data Presentation
![Page 17: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/17.jpg)
OLAP Cube
Data Mining
Structure
Data Presentation
SharePoint Server
Custom Application
Dashboards
Clients
Business Logic
Power User
![Page 18: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/18.jpg)
Use Case
Reseller Sales
AmyJack
Mo Night Freight
Sales Quota $1000
Boss
Order Date Order # Reseller Sales Person Ship Date Product
06/17/2010 E223084 Jack Yo Amy Valdez 06/18/2010 Mountain Bike -200
![Page 19: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/19.jpg)
Identifying System Boundary
Reseller
Sales Mager
Sales Person
Shipping Person
Browse Product Catalog
Get Product Quotes
Order Product
Receive Product
Analyze Sales Create Sales
Plan
Sale Product
Process Order
Ship the Product
Package Product
Get Processed
Order
Source System
Create KPI
Business Intelligence System
![Page 20: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/20.jpg)
Business Process
Business ActivityMoney
Customers
Materials
Business Rules Plans Standards
IT ResourcesHuman Resources Equipment
Products
Orders
Contracts
![Page 21: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/21.jpg)
Functional Structure
Plan
Act
Check
Do
Data Mining Reporting Services Analysis ServicesSQL Server
Input Data
Resources
Plans, Business Rule and KPI
Result Data
Process Output (Facts /Measures)
Feedback (Improvement)
![Page 22: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/22.jpg)
Sales Business Process
Plan Sales
Analyze Sales
Monitor Sales
Resellers Sales
SQL Server DB
Sales ManagerSales Representative
Market Data
Reseller (Dimension)
Sales Quota and KPI
Sales Result
Sale Orders (Facts /Measures)
Sales corrections and Improvement
Sales Summary
Balance Scorecards
Sales Transaction
![Page 23: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/23.jpg)
Designing Dimensional Model
DimensionDimensionDimensionDimensionDimensionFact
![Page 24: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/24.jpg)
8/12/2013DateSK812201
3
Full NameAmy
Valdes
EmployeeSK5
Full NameJohn Doe
ResellerSK20
ProductNameBike-200,
Mnt, B
ProductSK
555
Date
Designing Dimensional Model
Order Date ResellerSales Person Product Price Order Qty8/12/2013 John DoeAmy Valdes Bike-200, Mnt, B $150.00 20
Shipping Date9/3/2013
Order Date
ResellerSales Person
Product8/12/2013 John Doe
Amy Valdes
Bike-200, Mnt, B
DimDate
DimEmployee
DateSK8122013
DateSK932013
EmployeeSK5
DimReseller
ResellerSK20
DimProduct
ProductSK555
FactResellerSales Measures
9/3/2013 932013
![Page 25: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/25.jpg)
Analytical System of the Data WarehouseBI Semantic Model
Data model
Business logic and queries
Data access ROLAP MOLAP VertiPaq DirectQuery
MDX DAX
Multi-dimensional
Tabular
Third-partyReporting Services Excel PowerPivot
Databases
LOB Applications
Files OData Feeds
Cloud Services
SharePoint
![Page 26: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/26.jpg)
ETL Logical Architecture
Extract Data
Load Staging
Extract from Staging
Transform Data
Load Dimensions
Load Facts
Process Cube
Log ETL Process
Send Notification
![Page 27: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/27.jpg)
Batch Processing Architecture
Data Source Staging Table DWH Table
ETL
Truncate Table
![Page 28: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/28.jpg)
Batch Processing Architecture (Table Switch)
Data SourceStaging Table 1
DWH Table
ETL
Staging Table 2
Truncate Table
![Page 29: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/29.jpg)
Presentation System
![Page 30: Architecting business intelligence system](https://reader033.fdocuments.us/reader033/viewer/2022061105/544294e1afaf9ff3098b46b7/html5/thumbnails/30.jpg)
This is the End of the presentation
But not the end of the way