TrainingAI/MLmodelsusingDigitalDataMarketplaces

DDSGteleconferenceNovember29th 2018

LeonGommans,AnneSavelkoul,Wouter Kalfsbeek,DirkvandenHerik,DavidLangerveld,ErikIJzermans,FlorisFreeman,Brend Dikkers,CeesdeLaat,TomvanEngers,Wouter Los,PaolaGrosso,JosephHill,ReggieCushing,Giovanni Sileno,LuZhang,Ameneh Deljoo,

ThomasBaeck,WillemKoeman,LaurieStrom,AxelBerg,Gerben vanMalenstein,Kaladhar Voruganti,RodneyWilson, PatriciaFlorissi

BUSINESS CONTEXT

Companies increasinglyunderstandhowtoapplyAI technologiestoextractbusinessvaluefromdata.

Themoredatathe better:algorithmqualitydependsondataquantityandqualityKnowledge howtotranslatesuch dataintoreliable algorithms iscompetitive

Companies arereluctanttosharedatawhenconsidering involvedrisk.

Emergingplatformdominance: “Whilecreatingrealvalueforusers,thesecompaniesarealsocapturingadisproportionateandexpandingshareofthevalue,andthat‘sshapingourcollectiveeconomicfuture”.*

Sharingdataacrosscompaniesincreasesthepotentialof

creatingbusinessvaluenosingleorganizationcancreateonitsown.

* M. Iansiti, K.R. Lakhani, Managing our hub economy, Harvard Business Review, pg. 85-92, Sep/Oct 2017

Consideringvalueexchangeandinvolvedriskraisesthemainresearchquestion:

Howcan(big)dataassetsbesharedbetweendatasuppliersandalgorithmsdevelopersin1) Afairandeconomicway,2) whilstprovidingadequatemeanstoreducerisk?

DATAISINCREASINGLYCONSIDEREDANASSET

CURRENTALGORITHMDEVELOPMENTCONTEXT

DataLake/DataWarehouse

Periodicstorage:raworwithenhancedquality

(Near) Real TimeOperational Data

Decision Support Systems

Planning, Prediction,Prevention,

Effectiveness,Efficiency,

etc.

Algorithm

sAlgorithmSupplierRealTimeusingowndata

System EngineerMaintenance Planner

Howcanaircraftoperateatmaximumsafety- andreliability

levelsatminimalcost?

RESEARCHCONTEXTARRANGEADDITIONALDATATOIMPROVEALGORITHMQUALITY&INNOVATION

AlgorithmDevelopersownorthirdparty

Historic(Big)Data

(Near)RealTimeOperationalData

Decision Support Systems

Planning, Prediction,Prevention,

Effectiveness,Efficiency,

etc.

Datasuppliedbyotherorganizations

Compe

titive

Algorithm

Choice

Competitive

OwnOrganizationData

OwnOrganization

Periodicstorage:raworwithenhancedquality

Dat

a Ex

chan

ge

B2BDATASHARINGAPPROACHESANEUSTUDYBYEVERISJAN2018

Open vs Closed

DifferencewithDataMarketplaces:GovernancebyamembershiporganizationDifferencewithIndustrialDataPlatforms:Dataisstoredoutside dataplatformstoallowmultipleplatformstousesamedataContractsdetermineaccess/useMarketrulesarrangepre-contractualelements

EXAMPLE USE:DEVELOP A DIGITAL TWIN TO ESTIMATE MAINTENANCE CREDITSDATASHARINGCHALLENGESWHENTRAININGMODELSWITHASMUCHDATAASPOSSIBLE

Manyorganizationswanttokeeptheirhistoricaldataintheirsovereigndatazones.

Manyimplicationsneedtobeconsidered:

Datalevel

ProcessingStorageManagementTransportTransformSecurity

Business level

ValueCostBenefitsAgreementsExchangeTrade

Legal level

OwnershipAccessUsageCompliancyLiabilityMarketRules

Worldwide Scale

OVERCOMMINGCHALLENGESELEMENTSTOORGANIZETRUSTASMEANSTOREDUCERISK

COMMON BENEFIT

Defineandagreecommonbenefitnosingleorganizationcanachieveonitsown.

GROUP RULES

Define consortiumrulesconsideringdatause,accessandbenefitsharing

ORGANIZE TRUST

Organizepowerandtrustasameanstoreduceriskforparticipatingmembers

IMPLEMENT INFRASTRUCTURE

ResearchoperationalizationofDigitalDataMarketplace&DataExchangeconcepts

Example:enabledatasharingtoimprovequalityofAI/MLinnovations• Understandneed:themoredatathebetter• Expect:capabilitythatwillhelptransformtheMRObusinessinthedigitalera.

Innovationsthatwillimproveairsafety,passengerexperienceandadditionalcostreductionsby:§avoidingunplannedmaintenance§increasingmaintenanceplanningflexibility§movingfromfixedintervalplanningtomaintenancewhenindicated§lessnetworkdisruptionsbyavoiding‘AircraftOnGround’situations

DEFINEANDAGREECOMMONBENEFIT

TrustisconsideredasameanstoreduceriskDefiningconsortiummembershiprulesisastartingpoint

Legalresearchtopic’sfordiscussion:- Dataassetownership- Dataaccess&usage- Liabilityofowner&user- Non-compliantbehavior- Marketrules- Purposebinding

CONSORTIUMMEMBERSHIPRULES:WHATKINDOFRULESDOWENEED?

DIGITALDATAMARKETPLACECONCEPT:COMBINEDBUSINESS,LEGALANDCOMPUTERSCIENCERESEARCH

Market rules

National Law & Regulations

Member admission

DeploymentSpecification

InfrastructurePatterns

Agreement

Data Exchange Infrastructure

AlgorithmDeveloppers

Registry

DisputeResolution

Accounting & Auditing

Business & Legal ResearchComputer Science ResearchBlockchain/Finance Research

Data suppliers

Digital Data Marketplace Membership Organization

Future Internet Capabilities:Software Definable - No Bandwidth

Limitations, On demand, transaction based

DATAEXCHANGECONCEPTENVISAGEDGLOBALEXCHANGEINFRASTRUCTURE

GlobalDataExchangeInfrastructure

AMDEX

BERDEX

LNDDEX

CHIDEX

NYDEX

SFODEX

SovereignDataOwners(e.g.Airlines)

AutonomousDataSciencePlatformsMarketplaceA MarketplaceB

RESEARCHINGEXCHANGEARCHITECTURES

SovereignDataZones

DataOwnerLayer

AirlineA

DataTransfer&Processing

Node

AirlineB

DataTransfer&Processing

Node

DigitalDataMarketplaceInfrastructureprovidedbyDataExchange

DataTransfer&Processing

Node

DataSciencePlatformLayer

DataScienceDevelopmentPlatform

KLMAmsterdam SiliconValley

DataCage DataCage

Amsterdam

Publiccloud

TrustModelling:Whatistheoptimalinfrastructurearchetype,describingstorageandprocessinglocationsandtheirrelationships,whichbestsuitmemberrequirementswhenconsideringrisk?

See CIENA booth 2847 and demo

ProcessingModels:Whataretheimplicationsofdistributingdataprocessingacrossmembershiporganizationownedinfrastructuresintermsofachievablemodelaccuracyandprocessingperformanceusingfederated/distributedmodelsvscentralizedmodels

MarketplaceReferenceArchitecture:Whatconstitutesamarketplace?Researchingneededfunctions,personas,flows,credentials,contracts&rules,conflictresolution,andmuchmore…

DataSharingInfrastructureModelResearchusing FutureInternetcapabilites

Researchcollaboration

GLOBAL RESEARCHINFRASTRUCTURES GLOBALDATACENTERINFRASTRUCTURES

How to create a Global Digital Data MarketEcosystem via Data Exchanges

AM3 and AM4DatacentersAmsterdamScience Park

SV10Datacenter

Silicon Valley

RESEARCHINGPHYSICALIMPLEMENTATIONINVOLVINGBOTHRESEARCHANDITINDUSTRY

DC4

AP

Internet

DC1 DC2 DC3

Customer P Processing

Algorithm

Result

Dataset

Contract

Filetransfer

Resultoutput

Algorithmcopy

Remotefilesystemmount

ContainerorVM

ContractDrivenSlice

A

Traditionalmodel

DC4actsasplatform:1:createspotentialcompetitivebottleneck/lock-in.and2:raisesdataownerconcernsaboutrisk

DatacenterEcosystem

DMP

DC1 DC2 DC3

DC4

A

PA

Customer P Processing

Algorithm

Result

Dataset

Contract

Filetransfer

Resultoutput

Algorithmcopy

Remotefilesystemmount

ContainerorVM

ContractDrivenSlice

A

DMPprovidesneutralprocessingcapabilities,whichdissolvesafterExecution.

DatacenterEcosystem

DC1 DC2 DC3

DC4

Customer

DatacenterEcosystem

DC5

DMPP P P

A A AP

A

DataExchangeLocationB

DataExchangeLocationA

PA

PA

P Processing

Algorithm

Result

Dataset

Contract

Filetransfer

Resultoutput

Algorithmcopy

Remotefilesystemmount

ContainerorVM

ContractDrivenSlice

A

Enterprisesjoinamembershiporganizationtoachieveacommongoalnosingleenterprisecanachieveonitsown

Membershiprulesaredefinedbyrulemaking&standardsprocesses,subsequentlyexecution,enforcementandjudgementisorganizedbymembershiporganizationasameanstoreducerisk.

Membersarrangedatasharingandprocessingviaagreementsdeployedinaninfrastructure,providedbyasecuredigitalmarketplaceownedbyitsmembers.

Membersachievecommonbenefitsinatransparentway.Memberstrustitsoperationbasedonuseofaccounting&auditingmechanisms,relyingonmarketdisputeresolutionmechanisms.

SUMMARY