Quipu expert session 17 jun2010
-
Upload
delostilos -
Category
Data & Analytics
-
view
72 -
download
1
Transcript of Quipu expert session 17 jun2010
![Page 1: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/1.jpg)
open source data warehousing
Expert session
June 17th, 2010
![Page 2: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/2.jpg)
Agenda • Introduction • QUIPU presentation
– Background – Architecture – Future plans – More info
• QUIPU demo • Q&A • Drinks
![Page 3: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/3.jpg)
Introduction • Our highly appreciated guests…
![Page 4: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/4.jpg)
Introducing the QUIPU team • Juan-José van der Linden • Michael Heymans • Peter Kurstjens • Jeroen Klep
![Page 5: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/5.jpg)
• BI strategy developement • Information analysis • (E)DW architecture • Project management • Adapttm training
• Maintenance & support • Data vault technology • Quipu development
![Page 6: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/6.jpg)
Customers
![Page 7: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/7.jpg)
QUIPU: Open Source DW generation • Open Source Data Warehouse Generation System, based on
Data Vault principles • First public release planned for July 1st 2010 • QOSQO takes a leading role in continuous development and
support
![Page 8: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/8.jpg)
What is Quipu about? • Fast implementation of DV based EDWH • Reduction of risk of modeling errors • Removal of repetitive tasks • Lowering TCO
![Page 9: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/9.jpg)
Benefits • Automated data warehouse data model design
and implementation • Lower total cost of ownership using open source
licensing model • Fully repository based metadata driven data
model and load code generation • Supports most common database platforms using
ANSI-SQL over JDBC
![Page 10: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/10.jpg)
Characteristics
QUIPU GUI
QUIPU BACK-END
Hudson
Redmine
Subversion
Source(s) Target DW
Repo
![Page 11: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/11.jpg)
Templates
Repository structure
Connections
Dialects
Models
loggin
g
sched
ulin
g
Sec
urity
![Page 12: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/12.jpg)
QUIPU
Source 1
Source 2
Source n
Data Warehouse (Business Data Vault)
DM 1
DM 2
DM 3
T ETL Tool
LOAD TL
Generate DV Model
Generate Load
Generate DM’s
Generate TL Modeling
Tool
Scheduler
Logging / Monitoring
Quipu basic architecture: ‘classic’
![Page 13: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/13.jpg)
QUIPU
Source 1
Source 2
Source n
sDV 1
sDV 2
sDV n
bDV
DM 1
DM 2
DM 3 T
LOAD
ETL Tool
DM 1
DM n
DM 2
DM 3
TL
Generate DV Model
Generate Load
Generate DM’s
Generate TL
Generate DV Model
Generate Load
Generate DM’s
Generate TL
Scheduler Logging / Monitoring
Quipu extended architecture
DM 3
LOAD
TL
![Page 14: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/14.jpg)
QUIPU
Source 1
Source 2
Source n
bDV
sDV 1
sDV 2
sDV n
DM 3
T
LOAD
DM 1
DM n
DM 2
Generate DV Model
Generate Load
Generate DM’s
Generate TL
Scheduler
Logging / Monitoring
Quipu extended architecture / 2
T
TL
DM 3
![Page 15: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/15.jpg)
QUIPU
T
Generate DV Model
Generate Load
Generate DM’s
Generate TL
Scheduler
Logging / Monitoring
Quipu Repository
T
Quipu Repository
Source n
![Page 16: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/16.jpg)
Future plans • Community Edition
– Enhancements • Data mart generation • Scheduling • ??
– Paid add-ons – Customer request based – Community request based
• Enterprise Edition – Completely new product – Support for multiple versions, models, customers, users
![Page 17: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/17.jpg)
QUIPU EE
QUIPU version management
DM 1
DM 2
Version x
LOAD TL
Generate DV Model
Generate Load
Generate DM’s
Generate TL
Scheduler
Logging / Monitoring
Quipu Enterprise Edition
Quipu Repository
Multiple DW / Project / Version Management / DTAP / Customer
![Page 18: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/18.jpg)
More info
• www.QOSQO.nl • www.datawarehousemanagement.org
!Download available per July 2nd 2010
• Launch event July 1st, 2010, Vught • OS_Quipu
![Page 19: Quipu expert session 17 jun2010](https://reader034.fdocuments.us/reader034/viewer/2022042716/55b4eee4bb61eb4c2d8b4726/html5/thumbnails/19.jpg)
QOSQO, the DataVault specialist, is the leading company behind Quipu www.QOSQO.nl
Our sister company Nippur assists in executing business intelligence projects www.nippur.nl
Karel Doormanlaan 1b 5688 BP OIRSCHOT The Netherlands E: [email protected] T: +31 ( 0499 ) 577 562 F: +31 ( 0499 ) 577 059 open source data warehousing