From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert >...

19
From Prototype to Operative Software with RapidMiner Data Analytics @ Lufthansa

Transcript of From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert >...

Page 1: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

From Prototype to Operative Software with RapidMinerData Analytics @ Lufthansa

Page 2: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

AirPlus LGBSLufthansa Passenger

SwissAustrian

Lufthansa Industry

Solutions

Lufthansa Systems

Finance and ServiceCompanies

Passenger Airlines

DigitalService Companies

Lufthansa Industry

Solutions

Lufthansa Technik

LSG Sky Chefs

Aviation Industry

Lufthansa Cargo

Air Freight

16 Oktober 2018 Company Presentation2

Page 3: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

Norderstedt HamburgCologne

BerlinWetzlar

FrankfurtBasel

Miami

Wolfsburg

Oldenburg

16 Oktober 2018 Company Presentation3

LocationsOur

Page 4: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

Norderstedt HamburgCologne

BerlinWetzlar

FrankfurtBasel

Miami

Wolfsburg

Oldenburg

16 Oktober 2018 Company Presentation4

LocationsOur

Hard Facts

100% owned by Lufthansa

217 Mil. € total revenue (50 % of which within the Lufthansa Group)

>200 customers

1,500 skilled employees (Update: Q2 2018)

Managing Director Bernd Appel

Founding 1998 as Industry Solutions division within Lufthansa Systems AG

Page 5: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

Technology Services of Lufthansa Industry Solutions

Industrial IoT

Data Analytics/ Data Engineering

Security

Artificial Intelligence

+ Digital Lab (Hamburg & Frankfurt)

Cloud Computing Blockchain

SAP OLTP- & Mobile Development

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 5

Page 6: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

Process Model

›› ›› ›› ›› ›› ››

››

››

ıData Management

Data Science

BusinessAnalysis

Implementation

Process and IT Design

Visu

aliz

atio

n Ope

ratio

n

Data Acquisition

Data Integration

Autom

ationProcess Improvement Model Building

Expl

orat

ion

Digital Business StrategySmart Data Strategy Use Case Hypothesis

%BUB�%SJWFO�"QQSPBDI�6TF�$BTF�%SJWFO�"QQSPBDI�

Scoping Phase

Laboratory stageImplementation stage

Laboratory stageImplementation stage

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 6

We deliver actionable insights from your data

Page 7: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

FlightPrediction @ Lufthansa

We predict the arrival time as the aircraft takes off

Page 8: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

Accurate OnBlock arriving estimates are crucial for effective airline operations

Seite 8

Operations Control Turnaround Management

Passenger Care Crew Management

Request Priority Landing or Taxi Change Aircraft

Request Direct Transfer

Rebook Passengers

Estimated OnBlock Time

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 8

Page 9: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

Business and Analytics Process Alignment

LandingDeparture

Rolling Rolling Airtime

Gate - to - Gate

Arrival

Prediction Point

Avg. error of arrival estimates

Avg. deviation estimated vs. actual OnBlock

Takeoff

Prediction Time

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 9

* Analysis is based on a randomly drawn test data sample

Page 10: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

How? Unleashing The Power of Big Data

Sour

ces:

avi

atio

nwea

ther

.gov

/rad

ar/m

osai

c fli

ghtr

adar

24.c

omlu

ftha

nsa.

com

/us/

en/R

oute

-Map

Predicted Arrival Time

Historic Data

Historized Flight Data Stream

Eurocontrol

Weather Data Stream

Data Warehouse Reporting Server

Real-Time Data

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 10

Page 11: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

The Cycle

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 11

Page 12: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

§ A few rolling window features are good!

§ Prefer models that can be trained fast: Play around with features instead of models.

Model Building

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 12

Page 13: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

§ A few rolling window features are good!

§ Prefer models that can be trained fast: Play around with features instead of models.

Model Building

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 13

* Analysis is based on a randomly drawn test data sample

Page 14: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

The Cycle

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 14

Page 15: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

§ Runs every hour

§ Asserts that …

§ enough data

§ enough predictions

§ predictions produced fast

§ not too much missing data§ …

Automation: SupervisorSupervision of Model

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 15

Page 16: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

§ Achieve business engagement by focusing on the particular business pain point

§ Support business in understanding the output by going fast to `market`

§ Make sure business understands the impact by visualizing the monetary effects

Lessons LearnedGo To The Real World Fast – Make Everybody Understand The Benefits

§ Play around with features instead with models§ Need for standards

§ Prototype needs to be translated to real application

§ You do not want to rebuild everything

Business side IT side

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 16

Page 17: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

§ Partnership founded in 2015§ RM widely used in Lufthansa§ Keeps up with market technologies§ For prototyping and productive applications§ Still lacks some software engineering capabilities …§ We pair it up with Hadoop, Oracle, Teradata, R, Python, …§ Lufthansa Industry Solutions: certified RapidMiner trainers

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 17

Page 18: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Title of presentation (click on “Insert > Header & Footer”) Space for logo of client

Contact

Dr. Stanislaw (Stan) SchmalProject Manager Analytics

Lufthansa Industry Solutions BS GmbH, LLCBranch Office US

801 Brickell Avenue, Suite 500

Miami, FL 33131Phone: +1 305 584 9093E-Mail: [email protected]

Dr. Fabian WernerData Scientist

Lufthansa Industry Solutions AS GmbH 

Schützenwall 122844 NorderstedtPhone: +49 151 589 435 [email protected]

16.10.18 From Prototype to Operative - Data Analytics @ Lufthansa 18

Page 19: From Prototype to Operative Software with RapidMiner · Title of presentation (click on “Insert > Header & Footer”) Space for logo of client Contact Dr. Stanislaw (Stan) Schmal

Space for logo of client

Many Thanks for Your Attention!