Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

91
Internet Connected Objects for Reconfigurable Eco-systems Tutorial on Internet of Thing (IoT) Paradigm 1 CCNC 2014 Tutorial - 10 Jan 2014 Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications Las Vegas (US), 10 Jan 2014 Raffaele Giaffreda (CREATE-NET) R. Venkatesha Prasad (TU Delft) Michael Koster (OSIOT / ARM)

description

Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications given at 11th IEEE Consumer Communication and Networking Conference 2014 - Las Vegas. R.Giaffreda slides subset

Transcript of Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Page 1: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Internet Connected Objects for

Reconfigurable Eco-systems

Tutorial on Internet of Thing (IoT) Paradigm

1 CCNC 2014 Tutorial - 10 Jan 2014

Tutorial on Internet of Thing (IoT) Paradigm

in Consumer Applications

Las Vegas (US), 10 Jan 2014

Raffaele Giaffreda (CREATE-NET)

R. Venkatesha Prasad (TU Delft)

Michael Koster (OSIOT / ARM)

Page 2: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Brief Introduction to the speakers

Raffaele GiaffredaSmart IoT Research Area Head at CREATE-NET, International Research Center located in Trento, ItalyiCore EU Project Coordinator, 3 yrs project on Cognitive IoT

Michael Koster (from remote)From the Open Source Internet Of Things Silicon Valley community and meetup group. Has been modeling and building

2 CCNC 2014 Tutorial - 10 Jan 2014

R. Venkatesha PrasadAssistant Professor at Embedded Software group, Delft University of Technology (Netherlands). He is an active member of TCCN, IEEE SCC41, and reviewer of many IEEE Transactions and Elsevier Journals.

community and meetup group. Has been modeling and building systems in hardware and software for over 20 years. Building the experimental software IoT Toolkit to further develop high level interoperability. Joining the ARM IoT research group next week.

Page 3: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Seminar outline (3h 30min)

� Part I – Broad introduction to IoT (45min) RG

� Part II – Protocols for IoT (20min) VP

� Part III – Open Horizontal platforms for IoT (35min) MK

� coffee break (30min)

� Part IV – the iCore Cognitive IoT, rationale and architecture

(30min) RG(30min) RG

� Part V – Academic research issues (50min) VP

3 CCNC 2014 Tutorial - 10 Jan 2014

Page 4: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Part I. Broad introduction on Internet of Things

4 CCNC 2014 Tutorial - 10 Jan 2014

Page 5: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Let’s start with a definition...

from the IERC (the European Research Cluster on Internet of Things http://www.internet-of-things-research.eu/)

� Internet of Things (IoT) is a dynamic global network infrastructure with self-

configuring capabilities based on standard and interoperable

communication protocols where physical and virtual “things” have

identities, physical attributes and virtual personalities and use intelligent

interfaces and are seamlessly integrated into the information network.

Page 6: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

IoT vs. M2M vs. CPS

� not clear cut distinction, these terms are often used interchangeably;

however, based on personal experience...

� M2M – Machine-to-Machine

� TelCo world origins, tied to the network implications of connecting machines

rather than people, explosion of # of connections with limited bit-rate, ETSI is the

main standardisation body); think of telemetry applications

� M2M is the glue of the IoT

� CPS – Cyber Physical Systems� CPS – Cyber Physical Systems

� merging real and virtual (cyber) worlds, focusing on systems that based on duly

sampled representation of the physical world can intervene through digitized

actuators to change behaviours in the physical world; think of car ABS

� CPS is the science bricks behind IoT

� IoT hailed as a broader concept, where the focus is more on wide

applications

6 CCNC 2014 Tutorial - 10 Jan 2014

Page 7: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

a bit of IoT infographics...

Page 8: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

BOSCH

7 bln connected devices by 2015

Page 9: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

SAP

24 bln connected devices by 2020

Page 10: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

INTEL

31 bln connected devices by 2020

Page 11: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

CISCO

37-50 bln connected devices by 202099.4%, 1.5tln unconnected!

Page 12: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

others...

Source: IDATE

Page 13: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

1 user – many devices

� looking at mere numbers and statistics

� 1950: 2.5bln people on earth; 2050: 9.3bln!

� 2012: Internet of 2.4 bln connected people

� 20 devices per person on average...easy to think of 200 or

2000 Picture focusing on wearable IoT only!!!

13 CCNC 2014 Tutorial - 10 Jan 2014

http://www.forbes.com/sites/danmunro/2013/05/19/credit-suisse-says-wearable-tech-the-next-big-thing/

wearable IoT only!!!

Page 14: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

take away message

� no question about the fact that IoT will be BIG

� M2M and CPS will contribute to IoT success

� many more people on earth, need for more efficient usage

of resources

� however...problems to be solved until we get there:

� human in the loop� human in the loop

� configuring, using, maintaining

� handling huge amounts of data produced

Page 15: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

how did we get here???

VISIONVISION

Technology trends Technology trends

15 CCNC 2014 Tutorial - 10 Jan 2014

Technology trends Technology trends + +

Internet evolutionInternet evolution

Page 16: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Marc Weiser vision (1991)

� Ubiquitous Computing

� The most profound technologies are those that disappear.

They weave themselves into the fabric of everyday life until

they are indistinguishable from it.

� Timeline

� 1990 – WorldWideWeb first browser invented in by Tim � 1990 – WorldWideWeb first browser invented in by Tim

Berners-Lee

16 CCNC 2014 Tutorial - 10 Jan 2014

the IoT timeline1980 1990 2000 2010 2020

the UC vision

Page 17: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

transistor density / space efficiency

Turing’s Pilot ACE: Automatic Computing Engine

Page 18: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

bandwidth / spectral efficiency

Page 19: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

technology trends vs. vision

the UC vision

tech maturity level to realise

vision

today

IDEAL

how to close this gap?

19 CCNC 2014 Tutorial - 10 Jan 2014

the IoT timeline1980 1990 2000 2010 2020

the UC vision today

Page 20: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

the Internet parallel

� imagine the Internet with no browser, no plugins

� collection of bespoke, non interoperable content specific

applications enabling access and visualisation of connected

files

Page 21: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

The Internet parallel

HTTP/WWW

19821982 19901990 todaytoday

search engines

connect your info

TCP/IP

HTML

represent info / aggregate info

WWWpersonalised knowledge

collections, blogs...

The Semantic Web

find info

VALUE!

Page 22: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

The Internet parallel

early stages for the IoT...

HTTP/WWW

The Semantic Web

VALUE!

personalised knowledge collections, blogs...

represent info / aggregate info

search engines

connect your info

TCP/IP

HTML

WWW

find infoobject

today

Page 23: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Internet vs. Internet of Things

� files vs. objects

� static memory cells vs. energy standalone units

� need to separate data source from data mgmt and operations

� objects virtualisation

� management of object-generated-data in the context of wider

applications

� need for widely adopted “object browsing” apps and for more

Cognitive and Machine Learning supported technologies (too many

connected objects to expect human-users to consistently leverage

on such wealth)

� browser displays content, TCP/IP is the glue, the user’s interest

drives innovative apps (search engines, social networks etc.)

� no widely adopted solutions for “browsing” the IoT, there will be a

higher proportion of “machines” as end-users for IoT compared to

Internet of people23 CCNC 2014 Tutorial - 10 Jan 2014

Page 24: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

take away message

� From Marc Weiser’s vision to IoT passing by Moore’s and

Cooper’s laws

� connecting tiny devices is not an issue anymore

� the internet of people will be ready to integrate “things”

� lack of unified solutions for consistently tapping into such

technology supported wealth of connected devicestechnology supported wealth of connected devices

� but we are getting there...

good rationale for IoT getting stronger and stronger as we evolve our modern lifestyles...CES anyone?? : -)

Page 25: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

let’s start digging deeper

Middleware

Applications

25 CCNC 2014 Tutorial - 10 Jan 2014

Virtualise

Devices

Connectivity

IOT

Page 26: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

got a rough idea about what IoT is now,

why do we need it?

� remote monitoring

� distributed and accurate sensing

� tracking location / presence (inventory, belongings)

� tracking usage / conditions

� statistics data generation

� health, energy, traffic etc.

� actuation� actuation

� human in the loop issue

� time-sharing, location-sharing user attention

� Car example to reinforce the concept here!

26 CCNC 2014 Tutorial - 10 Jan 2014

food for thoughts: it’s all about achieving more efficiency...thousands of objects are around us alr eady...what do we gain from “connecting them” or having remote access t o them???

Page 27: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Health Applications

� Infant monitoring system � provides parents with real-time information

about their baby's breathing, skin temperature, body position, and activity level on their smartphones.

� Monitoring an aging family member� Monitoring an aging family member� Using a wearable alarm button and other

discrete wireless sensors placed around the home to track your loved one's daily routine and alerts you to any serious disruptions detected in their normal schedule

Page 28: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Fitness and Smart Spaces Applications

� Track your activity levels� Using your smartphone's range of sensors and

connectivity options your device can automatically monitor your movements, location, and workouts throughout the day.

� Home Energy Monitor� Home Energy Monitor� Smart thermostats, real-time weather forecasts,

and the actual activity in your home to control the heating of the house

� Smart outlets allow you to instantly turn on and off any plugged in device from across the world or just your living room

Page 29: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Structure, Buildings, Systems …

� Monitoring Structures� uses wireless sensors embedded within

concrete foundation piles to ensure the quality and integrity of a structure. These sensors provide load and event monitoring to the projects both during and after its completion.and after its completion.

� Environment Monitoring� Water distribution

� Air pollution

� Wildlife

� Disaster warning

Page 30: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

IoT applications

� Companies

� http://smartthings.com/ (house)

� http://www.automatic.com/ (car)

� https://nest.com/ (house)

� http://sen.se/ (“mother”)

� http://bounceimaging.com/ (emergency & rescue)� http://bounceimaging.com/ (emergency & rescue)

� pebble (smart watch, personal assistant)

� fitbit (personal trainer, fitness, health monitoring)

� IBM (smart cities, dublinked)

� Cisco (Internet of Everything)

� SAMSUNG (smart-devices, home, personal)

� CES anyone?

� etc. etc.30 CCNC 2014 Tutorial - 10 Jan 2014

Page 31: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Nice apps, how are they realised?

31 CCNC 2014 Tutorial - 10 Jan 2014

Page 32: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

what are “things”?

� objects

� real world things

� can be observed / monitored (through a camera, a scale, a

position tag)

� sensors

� light, acceleration, noise, temperature, heart rate, blood � light, acceleration, noise, temperature, heart rate, blood

pressure etc.

� actuators

� can change status of things

� How can we remotely interact with these objects??

32 CCNC 2014 Tutorial - 10 Jan 2014

Page 33: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Connecting to objects

� GSM (!) – wide coverage

� 802.15.4 – low-power, low-rate (ZigBee)

� Bluetooth – energy efficient, portable devices

� WiFi – widespread, easy

� Ethernet – wideband access

Weightless (exploiting white spaces)� Weightless (exploiting white spaces)

� etc.

33 CCNC 2014 Tutorial - 10 Jan 2014

Page 34: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Using “things”

� “remotely interact”

� communication

� create a “virtual counterpart” – objects virtualisation

� why?

� need for manipulation / interaction

what do we do with Real World Objects? interact with � what do we do with Real World Objects? interact with

them using our senses

� look for them, see them, know what they are good for

� need to recreate that functionality at machine level!

34 CCNC 2014 Tutorial - 10 Jan 2014

Page 35: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Virtualising objects

� objective of achieving more automated and

widely adopted solutions: need to make a clean

break between physical objects and applications /

business logic that use these

� virtual representation of an object, if it has well

defined interfaces for interaction, can be easily defined interfaces for interaction, can be easily

reused

� semantic enrichment, not easy to achieve on

object / constrained devices is more easily dealt

with within object virtual counterparts sitting on

resource intensive machines (i.e. refer to virtual

machines in the Cloud)

� etc.35 CCNC 2014 Tutorial - 10 Jan 2014

Page 36: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

So, what’s in the middle?

� SOUTHBOUND: control and management of objects /

devices

� NORTHBOUND: logic to tailor how data becomes

information and useful knowledge to the applications

� application specific, but there might be invariants

� architectural considerations� architectural considerations

� an overview of the IoT-A ARM (Architecture Reference

Model)

� ref: iot-a EU project www.iot-a.eu

36 CCNC 2014 Tutorial - 10 Jan 2014

Page 37: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

IoT-A Architecture Reference Model

� Minimum set of “functionality groups”

� application

� IoT service

� communication

� device

37 CCNC 2014 Tutorial - 10 Jan 2014

Page 38: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

IoT-A functional model

38 CCNC 2014 Tutorial - 10 Jan 2014

Page 39: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

let’s put that in practice...

39 CCNC 2014 Tutorial - 10 Jan 2014

Page 40: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

how to create a vertical IoT application

� connect a device to a server

40 CCNC 2014 Tutorial - 10 Jan 2014

Page 41: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Open Source Hardware Platforms

ARDUINO

41 CCNC 2014 Tutorial - 10 Jan 2014

OpenPicus Flyport

Page 42: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

� connect a device to a server

� log / read monitored data, do stg with it

how to create a vertical IoT application

42 CCNC 2014 Tutorial - 10 Jan 2014

objects

Page 43: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

how to create a vertical IoT application

� connect a device to a server

� log / read monitored data, do stg with it

� link it to an application and BINGO! here is you

“Hello IoT World!” first application...however:

43 CCNC 2014 Tutorial - 10 Jan 2014

objectsapplication

Page 44: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

how to create a vertical IoT application

� connect a device to a server

� log / read monitored data, do stg with it

� link it to an application and BINGO! here is you

“Hello IoT World!” first application...however:

� infrastructure intensive exercise (need to store

data, need processing power, need connectivity data, need processing power, need connectivity

etc.)

� this is where bespoke applications kits or

HORIZONTAL platforms come in...

44 CCNC 2014 Tutorial - 10 Jan 2014

Page 45: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

IoT Platforms

45 CCNC 2014 Tutorial - 10 Jan 2014

Page 46: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

What do these IoT Platforms have in

common?

objects IoT

platform

applications

value-add (lock-in) features

46 CCNC 2014 Tutorial - 10 Jan 2014

applications

objects IoT

platform

applications

Page 47: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

most of the features of an IoT system

architecture can be factored out...

� different companies have opted for

different choices

� bespoke, vertical, with/out GW

� sen.se

� smartthings.com� smartthings.com

� fitbit.com

� platform, horizontal, cloud-based

� thingworx

� xively

� evrythng

47 CCNC 2014 Tutorial - 10 Jan 2014

Page 48: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

vertical vs. horizontal

Middleware

Applications

V

E

R

the IoT device, the gateway (if used), and the application are all provided and controlled by the same company. Open Horizontal IoT Platform

The horizontal approach makes innovation easier and allows rapid proliferation of new applications and businesses, but it needs

48 CCNC 2014 Tutorial - 10 Jan 2014

Middleware

Virtualise

Devices

Connectivity

IOT

R

T

I

C

A

L

A

P

P

Slittle infrastructure in place to support a horizontal business

businesses, but it needs to gain considerable traction before it can pay off on its promises. There need to be a lot of open gateways in place before third-party developers can count on having an adequate market to serve.

Page 49: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Part II – IoT Protocols

� handover to VP slideset

49 CCNC 2014 Tutorial - 10 Jan 2014

Page 50: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Part III – Open Horizontal Platforms for IoT

� Michael Koster slideset

50 CCNC 2014 Tutorial - 10 Jan 2014

Page 51: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Part IV – the iCore Cognitive IoT, rationale and

architecture

Middleware

Applications

Composite

Service LevelV

E

R

T

51 CCNC 2014 Tutorial - 10 Jan 2014

Virtualise

Devices

Connectivity

Virtual Object

Composite

Virtual ObjectIOT

T

I

C

A

L

A

P

P

S

Page 52: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

the need for Cognitive IoT and EU iCore project

� need for cognitive

and machine

learning based

framework to more

automatically deal

with the Interent of with the Interent of

Things without too

much end-user

know-how and

involvement

Page 53: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

iCore Websitewww.iot-icore.eu

Contacts:Raffaele [email protected]

3 yrs EU FP7 Integrated Project (started 1st Oct 2011)23 Partners with strong industrial representation8.7mEur EU FundingEU + China, Japan, Korea

ID Card

iCore EU-project ID

[email protected]

Abdur [email protected]

EU + China, Japan, Korea

Page 54: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Further info / links

[REF2] P. Vlacheas, R. Giaffreda et al. "Enabling Smart CitiesThrough a Cognitive Management Framework for the Internetof Things“, IEEE Communications Magazine - Special Issueon Smart Cities (June 2013)

[REF1] IERC April 2013 Newsletter – Foreword (see THIS LINK)

[REF3] iCore website (www.iot-icore.eu/latest-news) [REF3] iCore website (www.iot-icore.eu/latest-news) Best Demo Award at FuNeMS 2013

Page 55: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Introducing the VO concept

� talked about

“virtualisation” earlier

� DISCOVER & SELECT

� USE & MANAGE

Page 56: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

VO SW agent

VO APIs

(remote) proprietary API calls

VO SW agent host

the VO concept

� VO exposes several APIs to the upper

layers

� Features, functionalities and resources can

be re-used

� Cognitive control enabled by exposing

APIs which can be used to optimize the

behaviour of the ICT object

Exposed APIs

ICT

object processes

ICT APIs

API calls

ICT object

A simple example: VO SW agent host = laptop with Zigbee dongle

ICT object = Zigbee temperature meternon-ICT object = room

� VO SW agent may or may not be

installed on the ICT object

� Depends on ICT object capabilities

� Association management between ICT

and non-ICT is a real challenge!

� RESILIENCE ASPECTS

Association

non-ICT object

56

Page 57: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

what do VOs achieve: logical level

iCore FW

Application: pure function

VO Front VO Front

End

VO Front VO Front

End

VO Front VO Front

End

57

Gateway

VO Back

End:

Net Driver

VO Back

End:

Net Driver

VO Back

End:

RWO Driver

VO Back

End:

Net Driver

RWO1

Page 58: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

fostering automation - discovery

� description associated with an IoT Object, it better be machine

readable

� i.e. semantic enrichment based on info model for semantic-

based selection

� what is this good for?

� selection “by relevance”: performance and “selection quality” is

dependent upon combination of enrichment + algorithm that exploits it...dependent upon combination of enrichment + algorithm that exploits it...

� assessment of “proximity” is a prerequisite in achieving more automatic

and scalable solutions

Page 59: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

VO Information Model – semantic search

Page 60: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Examples (energy efficiency for sensors)

� besides discovering and selecting

� virtual representative “takes the heat off” real sensors

becoming their actual “manager”

� energy efficiency

� reuse

� resilience� resilience

� self-x for constrained resource devices

� conflict resolution (actuators)

� Examples

� compression algorithms, data caching, pub/sub schemes,

rules for self-x management

Page 61: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

HUMANMACHINE

added value besides sensing efficiency

what happens when it becomes

easier and easier to tap into

object produced data?

cars increasingly more

complex

increasing competition

for owner’s attention

OBD

On Board Diagnostics

Page 62: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

HUMANMACHINE

added value besides sensing efficiency –

Innovation potential

“Innovation”: one

can focus on apps!!!

we make “machines” step-in, assisting us!

MACHINEHUMAN

OBD

On Board Diagnostics

Page 63: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

siloed and bespoke IoT applications

APPS

HO

US

E

APPS

FR

IDG

E

APPS

PA

TIE

NT

APPS

PA

TIE

NT

APPSAPPS

APPSAPPS

APPSAPPS

DATA / INFORMATION OVERLOAD, BUT...

CA

R

SENSORS

HO

US

E

SENSORSF

RID

GE

SENSORS

PA

TIE

NT

SENSORS

PA

TIE

NT

SENSORS

PA

TIE

NT

SENSORS

PA

TIE

NT

SENSORS

PA

TIE

NT

SENSORS

PA

TIE

NT

SENSORS

APPS

PA

TIE

NT

SENSORS

APPS

TR

UC

K

SENSORS

APPS

Page 64: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

IF A WELL-DEFINED INTERFACE INTO CAR

SENSORS BRINGS SUCH INNOVATON POTENTIAL...

APPS

HO

US

E

APPS

FR

IDG

E

APPS

PA

TIE

NT

APPS

PA

TIE

NT

APPSAPPS

APPSAPPS

APPSAPPS

CA

R

HO

US

E

FR

IDG

E

PA

TIE

NT

PA

TIE

NT

SENSORS

PA

TIE

NT

SENSORS

PA

TIE

NT

SENSORS

PA

TIE

NT

SENSORS

PA

TIE

NT

SENSORS

APPS

PA

TIE

NT

SENSORS

APPS

TR

UC

K

SENSORS

APPS

SENSORS SENSORS SENSORS SENSORS

Page 65: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

of course that’s a dream far from becoming true...

http://readwrite.com/2013/06/14/whats-holding-up-the-internet-of-things

Page 66: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

the IoT standardisation jungle

Real-World Information DB

Au

then

tica

tio

n

Au

then

tica

tio

n

Real-World Knowledge Model (RDF Concepts & Facts)

GUI

Service Requester (Technology Agnostic)

Situation Awareness

Situation Projection

Situation Classification

Situation Recognition

Situation Detection

Queried Fact Collector

Natural Language Processing

(NLP)

Service Request

(SPARQL)

API

Service Request Analysis

RDF Rules

Inference

Engine

Semantic

Query

MatcherLearning

Statistics

Service Analysis

User Characterisation

Learning

Mechanisms

Intent Recognition

Service Templates

Repository

CVO FactoryAP

I

Domain

Expert /

Knowledge

Engineer

AP

I

Ad

min

istr

atio

n &

Man

agem

ent

I/F

Authentication

Authentication

CVO Management Unit

Service Execution Request

M2M

M2MM2M

M2M

M2M

CLOUD

P1723

EPCGlobal

SES

W3C PROV

PROV-DM /PROV-O /

PROV-AQ / PROV-XML

W3C PROV

PROV-DM / PROV-O /

PROV-AQ / PROV-LINKW3C PROV

PROV-DM /PROV-O /

PROV-AQ / PROV-XML

W3C PROV

PROV-DM / PROV-O / PROV-

AQ / PROV-CONSTRAINT

ITU-T

IoT-GSI

ITU-T

FG M2M

ITU-T

FG DistractionISO/IEC

JTC1 WG7

CVO Container (Execution)

Au

then

tica

tio

n

Au

then

tica

tio

nA

uth

enti

cati

on

VO Factory

VO Templates Repository

CVOCVO

CVOCVO

CVO

CVO

Situation ObserverCVO

Situation ObserverCVO

Situation ObserverCVO

Situation Observer

System Knowledge Model

CVO Registry

CVO Templates Repository

VO Registry

VO Management Unit

VO Lifecycle

ManagerCoordination

Data Manipulation

/ Reconciliation

Resource

OptimisationVO Container (WS host)

VOVOVOVOVOVOVOVOVOVO

VO Front End

VO Back End: RWO Driver

Approximation &

Reuse

Opportunity

Detection

CVO Composition

Engine

Orchestration /

Workflow

Management

Learning

Mechanisms

Device

manufactu

rer

API

Resource SensorActuator

GTW/Controller

Data

Processing

Domain

Expert /

Developer

Access

Control

Access

Control

Ad

min

istr

atio

n &

Man

agem

ent

I/F

Installer/

User

Installs

Sensor/Ac

tuator

Devices

Resource SensorActuator

GTW/Controller …………..

….. …..

CVO Lifecycle

ManagerCoordination

Quality

Assurance

Performance

Management

CVO Execution Request

M2M

M2M

M2M

CLOUD

CLOUD

CoAP

CoAP

SSN-XG

MQTT

MQTT

3GPP

3GPP

3GPP 3GPP

EPCGlobal

SPS

SOSSES SAS

SPS

SOS

SPS

SASWNS

SPSSOS

SOS

SOR SIR

CSW

O&M

SensorML

W3C PROV

PROV-DM /PROV-O /

PROV-AQ / PROV-XML

W3C PROV

PROV-DM / PROV-O / PROV-

AQ / PROV-CONSTRAINT

W3C PROV

PROV-DM /PROV-O /

PROV-AQ / PROV-XML

EPCGlobal

ITU-T

IoT-GSI

ITU-T

IoT-GSI

ITU-T

IoT-GSI

ITU-T

IoT-GSI

ITU-T

FG M2M

ITU-T

FG M2M

ITU-T

FG Distraction

ISO/IEC

JTC1 WG7

ISO/IEC

JTC1 WG7

ISO/IEC

JTC1 WG7

LWM2M

LWM2M

LWM2M

LWM2M

LWM2M

LWM2M

LWM2M

courtesy of Panagiotis Vlacheas and Vera Stavroulaki (Piraeus University )

Page 67: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

some (good) candidates

� imagine the Internet with no browser, no plugins

� collection of bespoke, non interoperable content

specific applications enabling access and visualisation

of connected files

an IP based web services view from Sensinode

http://www.iot-week.eu/presentations/thursday/02_Shelby-IoT-Smart-Cities.pdf

Courtesy of Zach Shelby (Sensinode)

Page 68: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

fostering interoperability

� at service level (ESBs)

� at communication level (PUB/SUB MQTT bus)

� at device level (GSN)

� no silver bullet...a lot of it will depend on application

context...context...

Page 69: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

useful ingredients?

� common interfaces to interact with objects (i.e.

REST)

� + extra containers for metadata

� let the systems know what the object is good

for, its location (“I am a Temp sensor in Room for, its location (“I am a Temp sensor in Room

A”), its accuracy, its energy levels etc.

take inspiration from HTML and the Semantic Web

“I am a webpage and I talk about Paris (city of France) history”

Integration at “application level” with all pros and cons associated with it

Page 70: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

the iCore story so far...

� increasing number of objects

� discovery and self-management of objects

� connect and virtualise your objects, unlock value

� interoperability across application domains and reliability

still big issues...

Page 71: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

once achieved the means to access

an objects as a service...

� object redundancy would allow me to cope with resource constraint nature of objects as well as with the diversity of interfaces� if I had a bunch of VO temp objects to chose from I would be much

more likely to tell you what the temperature is...

� semantic enrichment allows me to find alternatives, to foster object reuse and achieve service approximation concepts

� here we start entering more the “cognitive-inside” IoT object � here we start entering more the “cognitive-inside” IoT object management territory

� having a logic for choosing the appropriate Virtual Objects according to the application expectations

� having the means to easily connect objects together in a more or less complex graph (CEPs, PUB/SUB channels)

� features of Composite Virtual Objects and associated “CVO Templates”

cognitive mash-ups of semantically interoperable VOs (and their offered services) which render services matching the application requirements

Page 72: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Introducing the CVO

Page 73: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

CVO concept allows for approximate services...

CA

R

APPS

HO

US

E

APPS

FR

IDG

E

APPS

PA

TIE

NT

APPS

HO

US

E

FR

IDG

E

PA

TIE

NT

SENSORS SENSORS SENSORS SENSORS

PATIENT is near the FRIDGE

CAR is near the HOUSE

PATIENT is driving the CAR

objects reuse across domains

KitchenPresDetect PatientStatusDetect

Page 74: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

CVOs allow Automatic Composition

CVOType 1

VOType :: Temp sensor

getTemp()

Subject to constraints:- Dist (Pos, myPos) < 10m

CVO 1

VOx

FIND

getTemp()

VOType :: Press sensor

getPressure()

- Dist (Pos, myPos) < 10m- Not already allocated

Logic:If getTemp() > 20° and getPressure() > 2bar then NiceWeather

VOy

CP Solver to find VO allocations that satisfies all constraints and minimizes network traffic

USE

leveraging on System Knowledge (i.e. VOx is good and fully charged) to maintain IoT-based services...

Page 75: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

CVO templates

� factoring “smart logic algorithms” out of users /

developers concerns

� IF “crash” THEN “alertRSA”

� “crash” (IF VO_x = TRUE THEN crash := TRUE)

� (IF VO_x = TRUE AND VO_y = TRUE THEN crash := TRUE)

TAG:

crash

detect

VO_x

TAG:

crash

detect

VO_yIF (VO_x = TRUE) AND (VO_y = TRUE)

THEN crash := TRUE

IF VO_x = TRUE

THEN crash := TRUE

IF (VO_x > TH_x) AND (VO_y > TH_y)

THEN crash := TRUE

factor out cognitive technologies

• “ready meals” for IoT apps

Page 76: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

workflow-based SEP for CVOs

Car’s sensors/actuators

Open Data (Web)

courtesy of Michele Stecca (M3S)more info: http://www.slideshare.net/steccami/ieee-icin-2011

Page 77: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Event based CVO execution

CVO ContainerCVO Container

CVOCVO CVO CVO

CEP engineCEP engine

Observer

Observer

Machine Learningextensions

Machine Learningextensions

Event / (C)VO Bus (pub/sub based on MQTT)Event / (C)VO Bus

(pub/sub based on MQTT)

CEP engineCEP engine

VO ContainerVO Container

SensorVO

SensorVO

SensorVO

SensorVO

SensorVO

SensorVO

ActuatorVO

ActuatorVO

ActuatorVO

ActuatorVO

courtesy of Walter Waterfeld (Software AG)more info: http://terracotta.org/downloads/universal-messaging

Page 78: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Internet vs. IoT

� a page + a page + a page...connect info

� represent info – HTML

� aggregate info – hyperlink

� a (sensor) feed + a feed + a feed...

represent feeds – VO � represent feeds – VO

� aggregate feeds – CVO

Page 79: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

the story so far...bottom-up

what’s in here?

how to ensure user how to ensure user

friendliness and wide

adoption...

Page 80: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

the story so far...

� increasing number of objects

� discovery and self-management of objects

� connect and virtualise your objects, unlock value

� exploit redundancy pick the most suitable / interoperable /

reliable objects

� VO / CVO services like Lego bricks fostering innovation � VO / CVO services like Lego bricks fostering innovation

from IoT makers

� cognitive inside? so far only application-driven match-

making

� ultimate goal: user-friendly IoT services fostering wide

adoption

Page 81: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

a ‘top-down’ view

� routine jobs: water the plants, feed the fish, take my pills, track sent items etc.

� there are objects, sensors, actuators

� there are people (busy lives, forgetful patients, green fingers vs. fingers that “kill every plant they look after”)they look after”)

� objects can be connected

� objects can be mashed-up

� create your own IoT apps (this is what IoTmakers do) vs. provide some input and have this interpreted so the right actions are set to achieve your goals

� make the IoT easy to use and rely upon...

Page 82: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

unlocking a huge potential

data

data datada

ta

da

ta

datapresence

patterns exist ...

CVOs

derive patterns of ...

interpret

data

da

ta

data data

data

da

ta data

data

da

ta

datadata

data

data

H/WSE

NS

ING

Real World Objects

(RWO)

VOs

data goldmine and lots of

siloedapplications

presence

derive patterns of ...

Page 83: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

it’s a complex IoT world...

Page 84: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

the need for cognitive technologies

� rather than for the selection of appropriate templates,

here focus is on refinement of selected one according

to observed system-reality matching

� Real-World-Knowledge “growing”

Learning and adaptation to the users preferences� Learning and adaptation to the users preferences

TAG:

crash

detect

VO_x

TAG:

crash

detect

VO_yIF (VO_x > TH_x) AND (VO_y > TH_y)

THEN crash := TRUE

assess

QUALITY of

PREDICTION

REFINE

TH_x, and TH_y

Page 85: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Real World and System Knowledge models

Real World Knowledge

(RWK)

Models

derive patterns of ...

interpret

data

System Knowledge

(SK)

Models

presence

derive patterns of ...

What are these

good for?

Page 86: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Cognitive Inside where and why...

� Service Level: gather data relate to actions / situations

� support users (OBSERVE – LEARN – REPLACE)

� routine jobs (watering plants, feeding the fish, taking pills,

switch on/off lights)

� non-expert alerts (a fire, a leak, a fault) � non-expert alerts (a fire, a leak, a fault)

� provide feedback

� improvement of system performance

Page 87: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Some examples please?

� tracking cars in a smart city

� medical equipment tracking and asset management

Page 88: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

tracking cars in a smart city

Best demo

award at

FuNeMS 2013

courtesy of Marc Roelands (Bell Labs – Alcatel Lucent)

more info: http://www.iot-icore.eu/attachments/article/66/iCore_FuNeMS%2713_ALU.pdf

Page 89: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

tracking medical equipment

Validate

Train

Execute

RWO parameter reconfiguration

recommendations to improve energy

efficiency of location sensorsIn the demo implementation,

Database of location

information(spatial &

temporal) of objects

3

4

5

Train efficiency of location sensorsIn the demo implementation,

location data of objects is

simulated

1

2

2a4a

6

7

Page 90: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Trento Hospital S. Chiara CREATE-NET, Trilogis +

ZIGPOS

Page 91: Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications

Part V. Part V – Academic research issues

� handover to VP

91 CCNC 2014 Tutorial - 10 Jan 2014