Implementinga Big Data Strategy PRASA Passenger Rail ...€¦ · Implementinga Big Data Strategy...
Transcript of Implementinga Big Data Strategy PRASA Passenger Rail ...€¦ · Implementinga Big Data Strategy...
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
Implementing a Big Data StrategyPRASA Passenger Rail Agency of South Africa
MarkLogic World 2016San Francisco
Agenda
MARKLOGIC WORLD 2016AGENDA
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
• Introduction• About the customer• Project Goals• Challenges• The Solution• Demo
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
Introduction
MARKLOGIC WORLD 2016WHO AM I
Alexander DelesCEO, EBCONT
• More than 20 years experience in IT• MarkLogic Partner since 2011
• EBCONT delivered more than 20 MarkLogic projects successfully
EBCONT groupEBCONT is a leading Austrian provider of IT, communication and personnel services. Established in 2000, its founder Rupert Weissenlehner still privately owns the company. Initially positioned as a pure IT service provider, EBCONT used its first ten years of systematic development and stable growth to consolidate a corporate structure in 2010.
Employees 550+
Turnover 52 Mio. Euro
Owner Rupert Weissenlehner
Focus IT, Communication
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016WHO WE ARE
Award: EBCONT is MarkLogicPartner of Excellence!
The Customer
MARKLOGIC WORLD 2016THE CUSTOMER
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
Passenger Rail Agency of South AfricaPRASA – BE MOVED
MARKLOGIC WORLD 2016THE CUSTOMER
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
Name PRASA
Industry Passenger rail
Founded 1990 (as SARCC)
Headquarter Hatfield, Pretoria
Revenue ZAR 4.2 billion (USD 275 Mio.)
Employees 500,000 (whole group)
Project Goals
MARKLOGIC WORLD 2016PROJECT GOALS
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016REASON TO ACT
Digital Evolution
Overall Goals• Create a Data Strategy• Define a data centric enterprise IT architecture• Define a data centric interface strategy and
workflow for all IT systems• Deliver Proof-of-Concept• Implement
– Reference Implementation– Reference Infrastructure
MARKLOGIC WORLD 2016GOALS
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016GOALS
Goals• 360 degree overview• Standardize reporting• Improve quality of service• Fraud detection• Geo spatial data / heat maps• Point-in-Time analysis• Alerting• Root cause analysis• Virtualize data• Ease of use – use everywhere with:
– Desktop PC– Tablet– Smartphone
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016GOALS
Why Data Virtualization?
CRM, Web CMS, Marketing, Ticketing, Contact centers, HR, Counters, Incident Management, Schedules, etc.
Challenges
MARKLOGIC WORLD 2016
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016CHALLENGES
Challenges• Variety of data• Different systems and formats for the same purpose
– e.g. more than one incident management
system• Data quality
– Different coverages• Data linkage• Different languages
– English– Africans
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016DATA
Ticket Sales
Incident Management
Fuel Prices
Documents
Tracks
Stations
Weather Data
Work Shift DataTwitter
Input DataTrain Movement Data
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016PERSPECTIVES
Different PerspectivesExecutive
Org. Performance
Operations
• Exploration• Find patterns• Improvements
• Near real-time data• Reporting• Ad-hoc insights
• Root cause analysis• Data streams• Alerting
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
Solution
MARKLOGIC WORLD 2016
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016PROJECT SETUP
Project StreamsQuarter 1 Quarter 2 Quarter 3
Prototypingstream
Data strategy stream
Reference infrastructure stream
Reference implementation stream
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016INGREDIENTS
Ingredients1 2 3CONCEPT APPROACH TECHNOLOGIE
Next Generation Database – Enterprise NoSQL
“For all your data!”
• Schema-agnostic• Massive scale• Query and search• Analytics• Application services• Semantics• Geo Spatial
Data CentricBi-Modal IT
Bi-Modal IT
MARKLOGIC WORLD 2016BI-MODAL IT
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016ARCHITECTURE
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
So - What’s the plan?
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
Relia
bilit
y
System 1
API
Stable ITIT CentricSystem
2
API
System 3
API
System 4
API
System n
API
BI-M
OD
AL IT
Agi
lity
Data Transport
Data Integration
• Poly-structured Content• Government Grade Security• Extraction• Semantics• Geo-spatial• Data Intelligence• Data Quality
Flexible ITData CentricData Centric
Approach
Integration Pattern(Template)• Initial Data Load• Updates
ApplicationsBusiness Centric
Shor
t Cy
cles
API
Business- and Customer-Centric
Dashboard Search Apps StreamsRo
les
and
Gov
erna
nce
MARKLOGIC WORLD 2016PROVEN PRACTICE: EBCONT‘S DATA SERVICES HUB CONCEPT
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016INFRASTRUCTURE
Scalable Reference Infrastructure
DATA LAYER
VIRTUALIZATION CLUSTER
VMS
ESB 1
MarkLogic 1
SVN
Storage
VMH1 VMH2 VMH3
MarkLogic 2 MarkLogic 3 MarkLogic 4
ESB 2 Load Balancer
Nexus
ETL 2
ETL 1
APP 1 APP 2 Admin DB
Firewall
MarkLogic 5
Technology stack• Apache Loadbalancer
• Red Hat Enterprise Linux
• VM Ware Cluster
• NETAPP (Storage)
• HP (Server)• Astaro (Firewall, virtualized))
• Zabbix (Monitoring)
• Veeam (Backup)VMH4 VMH5
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016HOW MARKLOGIC HELPED
How MarkLogic helped
Semantics
Geo spatial
Schema agnostic
Search
English, AfricansData linkage
TracksStations, Assets, Signal
Train movementsData linkage
Fast integrationVariety of formats
Easy data consolidation
ExplorationAnalysis
Data linkage
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016
Live Demo
Any Questions?
MARKLOGIC WORLD 2016
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
Thank you for your attention!
EBCONT proconsult GmbH
Millennium TowerHandelskai 94-961200 ViennaAustria
http://www.ebcont.com
EBCONT proconsult, Millennium Tower, Handelskai 94–96, A–1200 Vienna
MARKLOGIC WORLD 2016
WE ARE LOOKING FORWARD TO INTERESTING
DISCUSSIONS