Technology for a better society 1

How can international standards contribute to the Big Data V's with simpler management of data Volumes, data Velocity, data Variety

and data Veracity to support data Value?Seminar: Digital Norway – built on international standards

Lillehammer, Norway, November 9th, 2016

Arne J. Berre, SINTEF IKT

Avdeling for Nettbaserte systemer og tjenester

Gruppe for Smarte systemer og data

Leder av GEMINI senter for Big Data, SINTEF, NTNU, UiO

Leder av Big Data Value Association, BDVA.eu, Technical Priorities

arne.j.berre@sintef.no

Technology for a better society

Dr. Arne J. Berre, Chief scientistSINTEFForskningsveien 1, Blindern0314 OSLO, NORWAYPhone: +47 9204 7452E.mail: Arne.J.Berre@sintef.no

• Dr. Arne-Jørgen Berre is chief research scientist at SINTEF. He is responsible for the Big Data area at SINTEF, and leader of the Norwegian GEMINI Center for Big Data with SINTEF, NTNU and UiO and leader of the European Big Data Value Association (www.bdva.eu) task force on Technical Priorities. He is representing SINTEF in the collaboration with the new Telenor AI Lab at NTNU. He has been working in the standardisation communities since 1989 with the Object Management Group (OMG) and since 1994 with CEN/TC287, ISO/TC2111 and OGG. He has been the editor for ISO/TC211/OGC ISO 19103 Conceptual Schema Language and ISO 19119 Geographic services and CEN/TC287 TR 15449-4, Service centric view on SDI – Spatial Data Infrastructures. He is Norwegian representative to ISO 19150-4 Service ontology and ISO JTC1 WG9 Big Data. He is currently involved in projects on Big Data, Linked data and Interoperability for Geospatial data and Earth Observation, Smart Cities, Telecom, Environmental monitoring, BioEconomies (Fishery, Forestry, Agriculture), Transport and Energy Smart Grids. He is a member of the Belmont forum on e-Infrastructure and Data Management for Environmental data.

Technology for a better society

www.bdva.eu

Big Data PPP Horizon 2020Funding, 500 Meuro, 2016-20

Technology for a better society

Technology for a better society

GEMINI Center for Big Data(SINTEF Oslo/Trondheim, NTNU Trondheim/Gjøvik, UiO Oslo)

• Cooperation on Big Data between SINTEF, NTNU og UiO• 12 full professors, 4 associate professors, 10 researcher, 8 PhD candidates, 10+ Master students

• Synergy related to a common tool box, methods/techniques, courses and projects related to Big Data

• Connection to related areas on Applied AI, Data Science and High Performance Computing

• Technical topics for Big Data:– Big Data Architectures– Big Data Management– Big Data Analytics– Big Data Privacy, Protection and Security– Big Data Visualisation– Big Data Standardisation

• Appliction areas/sectors for Big Data:– Industry sectors: Smart Cities, Oil&Gas, Energy&Utilities, Telecom, Manufacturing, Media, Finance/Insurance,

BioEconomies (Fishery/Aquaculture, Forestry, Agriculture), …– EU Social challenges: Health, Food&Agriculture, Energy, Transport, Climate, Inclusive Societies, Secure Societies,

…

Technology for a better society

The Big Data V's

Volume Velocity VeracityVariety Value

Data at Rest

Terabytes to exabytes of existing

data to process

Data in Motion

Streaming data, requiring mseconds to

respond

Data in Many Forms

Structured, unstructured, text,

multimedia,…

Data in Doubt

Uncertainty due to data inconsistency &

incompleteness, ambiguities, latency,

deception

€€

€

€

€

€ €

€

Data into Money

Business models can be associated to the

data

Adapted by a post of Michael Walker on 28 November 2012

Technology for a better society14/11/2016

Sector 3D

ata

Co

llect

ion

&

sto

rage

Pre

par

atio

nC

ura

tio

nD

ata

pro

cess

ing

An

alys

isV

alu

eSector 2Sector 1 Sector n

Data ManagementCollection, preparation, curation, linking, access

Structured, semi-structured, non-structured(Variability, Variety, Volume - Storage)

BIOData

''

Data Processing ArchitecturesBatch, Interactive, Streaming/Realtime

(Volume, Velocity)

Data Visualisation and User Interaction1D, 2D, 3D, 4D, VR/AR

(Value, Visualisation)

Infrastructure

Data AnalyticsDescriptive, Diagnostic, Predictive, Prescriptive

(Value, Veracity)

Resources,

Cloud

Geospatial

WebSocialMedia

Text,Language

Timeseries,Sensor

Basictypes

Image,Video,Audio

Metadata

IoT HPC

Privacy

Pro

tection

, An

on

ymisatio

n, Secu

rity

Stand

ards

Communication

..

Storage

BDVAReferenceArchitecture

www.bdva.eu

Sectors,Application areas

ETP4HPC,Cloud/Services5G ++

Data types,across sectors

ISO JTC1/WG9 –NIST Big Data Reference Architecture

Data Management

Analytics

Data protectionPrivacySecurity

with BDVA Technical priorities

Processing Architecture

Processing Architecture

Data Management

Data Management

Visualisation

Standards

Standards

HPC, Cloud computing

Geospatial

WebSocialMedia

Text,Language

Timeseries,Sensor

Basictypes

Image,Video,Audio

Metadata

..

European Interoperabiliy Framework

14/11/2016

http://ec.europa.eu/isa/documents/isa_annex_ii_eif_en.pdf

Technology for a better society

DataBio project,ICT15 Big Data PPP,Large Scale Pilot(2017-2019)(48 partners,16 Meuro)

SINTEF Fiskeri ogHavbruk, SINTEF IKT med Sildefiskelaget,Fiskefartøy, o.a.

Technology for a better society

Technology for a better society

12