Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications
-
Upload
raffaele-giaffreda -
Category
Technology
-
view
1.799 -
download
5
description
Transcript of Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications
Internet Connected Objects for
Reconfigurable Eco-systems
Tutorial on Internet of Thing (IoT) Paradigm
1 CCNC 2014 Tutorial - 10 Jan 2014
Tutorial on Internet of Thing (IoT) Paradigm
in Consumer Applications
Las Vegas (US), 10 Jan 2014
Raffaele Giaffreda (CREATE-NET)
R. Venkatesha Prasad (TU Delft)
Michael Koster (OSIOT / ARM)
Brief Introduction to the speakers
Raffaele GiaffredaSmart IoT Research Area Head at CREATE-NET, International Research Center located in Trento, ItalyiCore EU Project Coordinator, 3 yrs project on Cognitive IoT
Michael Koster (from remote)From the Open Source Internet Of Things Silicon Valley community and meetup group. Has been modeling and building
2 CCNC 2014 Tutorial - 10 Jan 2014
R. Venkatesha PrasadAssistant Professor at Embedded Software group, Delft University of Technology (Netherlands). He is an active member of TCCN, IEEE SCC41, and reviewer of many IEEE Transactions and Elsevier Journals.
community and meetup group. Has been modeling and building systems in hardware and software for over 20 years. Building the experimental software IoT Toolkit to further develop high level interoperability. Joining the ARM IoT research group next week.
Seminar outline (3h 30min)
� Part I – Broad introduction to IoT (45min) RG
� Part II – Protocols for IoT (20min) VP
� Part III – Open Horizontal platforms for IoT (35min) MK
� coffee break (30min)
� Part IV – the iCore Cognitive IoT, rationale and architecture
(30min) RG(30min) RG
� Part V – Academic research issues (50min) VP
3 CCNC 2014 Tutorial - 10 Jan 2014
Part I. Broad introduction on Internet of Things
4 CCNC 2014 Tutorial - 10 Jan 2014
Let’s start with a definition...
from the IERC (the European Research Cluster on Internet of Things http://www.internet-of-things-research.eu/)
� Internet of Things (IoT) is a dynamic global network infrastructure with self-
configuring capabilities based on standard and interoperable
communication protocols where physical and virtual “things” have
identities, physical attributes and virtual personalities and use intelligent
interfaces and are seamlessly integrated into the information network.
IoT vs. M2M vs. CPS
� not clear cut distinction, these terms are often used interchangeably;
however, based on personal experience...
� M2M – Machine-to-Machine
� TelCo world origins, tied to the network implications of connecting machines
rather than people, explosion of # of connections with limited bit-rate, ETSI is the
main standardisation body); think of telemetry applications
� M2M is the glue of the IoT
� CPS – Cyber Physical Systems� CPS – Cyber Physical Systems
� merging real and virtual (cyber) worlds, focusing on systems that based on duly
sampled representation of the physical world can intervene through digitized
actuators to change behaviours in the physical world; think of car ABS
� CPS is the science bricks behind IoT
� IoT hailed as a broader concept, where the focus is more on wide
applications
6 CCNC 2014 Tutorial - 10 Jan 2014
a bit of IoT infographics...
BOSCH
7 bln connected devices by 2015
SAP
24 bln connected devices by 2020
INTEL
31 bln connected devices by 2020
CISCO
37-50 bln connected devices by 202099.4%, 1.5tln unconnected!
others...
Source: IDATE
1 user – many devices
� looking at mere numbers and statistics
� 1950: 2.5bln people on earth; 2050: 9.3bln!
� 2012: Internet of 2.4 bln connected people
� 20 devices per person on average...easy to think of 200 or
2000 Picture focusing on wearable IoT only!!!
13 CCNC 2014 Tutorial - 10 Jan 2014
http://www.forbes.com/sites/danmunro/2013/05/19/credit-suisse-says-wearable-tech-the-next-big-thing/
wearable IoT only!!!
take away message
� no question about the fact that IoT will be BIG
� M2M and CPS will contribute to IoT success
� many more people on earth, need for more efficient usage
of resources
� however...problems to be solved until we get there:
� human in the loop� human in the loop
� configuring, using, maintaining
� handling huge amounts of data produced
how did we get here???
VISIONVISION
Technology trends Technology trends
15 CCNC 2014 Tutorial - 10 Jan 2014
Technology trends Technology trends + +
Internet evolutionInternet evolution
Marc Weiser vision (1991)
� Ubiquitous Computing
� The most profound technologies are those that disappear.
They weave themselves into the fabric of everyday life until
they are indistinguishable from it.
� Timeline
� 1990 – WorldWideWeb first browser invented in by Tim � 1990 – WorldWideWeb first browser invented in by Tim
Berners-Lee
16 CCNC 2014 Tutorial - 10 Jan 2014
the IoT timeline1980 1990 2000 2010 2020
the UC vision
transistor density / space efficiency
Turing’s Pilot ACE: Automatic Computing Engine
bandwidth / spectral efficiency
technology trends vs. vision
the UC vision
tech maturity level to realise
vision
today
IDEAL
how to close this gap?
19 CCNC 2014 Tutorial - 10 Jan 2014
the IoT timeline1980 1990 2000 2010 2020
the UC vision today
the Internet parallel
� imagine the Internet with no browser, no plugins
� collection of bespoke, non interoperable content specific
applications enabling access and visualisation of connected
files
The Internet parallel
HTTP/WWW
19821982 19901990 todaytoday
search engines
connect your info
TCP/IP
HTML
represent info / aggregate info
WWWpersonalised knowledge
collections, blogs...
The Semantic Web
find info
VALUE!
The Internet parallel
early stages for the IoT...
HTTP/WWW
The Semantic Web
VALUE!
personalised knowledge collections, blogs...
represent info / aggregate info
search engines
connect your info
TCP/IP
HTML
WWW
find infoobject
today
Internet vs. Internet of Things
� files vs. objects
� static memory cells vs. energy standalone units
� need to separate data source from data mgmt and operations
� objects virtualisation
� management of object-generated-data in the context of wider
applications
� need for widely adopted “object browsing” apps and for more
Cognitive and Machine Learning supported technologies (too many
connected objects to expect human-users to consistently leverage
on such wealth)
� browser displays content, TCP/IP is the glue, the user’s interest
drives innovative apps (search engines, social networks etc.)
� no widely adopted solutions for “browsing” the IoT, there will be a
higher proportion of “machines” as end-users for IoT compared to
Internet of people23 CCNC 2014 Tutorial - 10 Jan 2014
take away message
� From Marc Weiser’s vision to IoT passing by Moore’s and
Cooper’s laws
� connecting tiny devices is not an issue anymore
� the internet of people will be ready to integrate “things”
� lack of unified solutions for consistently tapping into such
technology supported wealth of connected devicestechnology supported wealth of connected devices
� but we are getting there...
good rationale for IoT getting stronger and stronger as we evolve our modern lifestyles...CES anyone?? : -)
let’s start digging deeper
Middleware
Applications
25 CCNC 2014 Tutorial - 10 Jan 2014
Virtualise
Devices
Connectivity
IOT
got a rough idea about what IoT is now,
why do we need it?
� remote monitoring
� distributed and accurate sensing
� tracking location / presence (inventory, belongings)
� tracking usage / conditions
� statistics data generation
� health, energy, traffic etc.
� actuation� actuation
� human in the loop issue
� time-sharing, location-sharing user attention
� Car example to reinforce the concept here!
26 CCNC 2014 Tutorial - 10 Jan 2014
food for thoughts: it’s all about achieving more efficiency...thousands of objects are around us alr eady...what do we gain from “connecting them” or having remote access t o them???
Health Applications
� Infant monitoring system � provides parents with real-time information
about their baby's breathing, skin temperature, body position, and activity level on their smartphones.
� Monitoring an aging family member� Monitoring an aging family member� Using a wearable alarm button and other
discrete wireless sensors placed around the home to track your loved one's daily routine and alerts you to any serious disruptions detected in their normal schedule
Fitness and Smart Spaces Applications
� Track your activity levels� Using your smartphone's range of sensors and
connectivity options your device can automatically monitor your movements, location, and workouts throughout the day.
� Home Energy Monitor� Home Energy Monitor� Smart thermostats, real-time weather forecasts,
and the actual activity in your home to control the heating of the house
� Smart outlets allow you to instantly turn on and off any plugged in device from across the world or just your living room
Structure, Buildings, Systems …
� Monitoring Structures� uses wireless sensors embedded within
concrete foundation piles to ensure the quality and integrity of a structure. These sensors provide load and event monitoring to the projects both during and after its completion.and after its completion.
� Environment Monitoring� Water distribution
� Air pollution
� Wildlife
� Disaster warning
IoT applications
� Companies
� http://smartthings.com/ (house)
� http://www.automatic.com/ (car)
� https://nest.com/ (house)
� http://sen.se/ (“mother”)
� http://bounceimaging.com/ (emergency & rescue)� http://bounceimaging.com/ (emergency & rescue)
� pebble (smart watch, personal assistant)
� fitbit (personal trainer, fitness, health monitoring)
� IBM (smart cities, dublinked)
� Cisco (Internet of Everything)
� SAMSUNG (smart-devices, home, personal)
� CES anyone?
� etc. etc.30 CCNC 2014 Tutorial - 10 Jan 2014
Nice apps, how are they realised?
31 CCNC 2014 Tutorial - 10 Jan 2014
what are “things”?
� objects
� real world things
� can be observed / monitored (through a camera, a scale, a
position tag)
� sensors
� light, acceleration, noise, temperature, heart rate, blood � light, acceleration, noise, temperature, heart rate, blood
pressure etc.
� actuators
� can change status of things
� How can we remotely interact with these objects??
32 CCNC 2014 Tutorial - 10 Jan 2014
Connecting to objects
� GSM (!) – wide coverage
� 802.15.4 – low-power, low-rate (ZigBee)
� Bluetooth – energy efficient, portable devices
� WiFi – widespread, easy
� Ethernet – wideband access
Weightless (exploiting white spaces)� Weightless (exploiting white spaces)
� etc.
33 CCNC 2014 Tutorial - 10 Jan 2014
Using “things”
� “remotely interact”
� communication
� create a “virtual counterpart” – objects virtualisation
� why?
� need for manipulation / interaction
what do we do with Real World Objects? interact with � what do we do with Real World Objects? interact with
them using our senses
� look for them, see them, know what they are good for
� need to recreate that functionality at machine level!
34 CCNC 2014 Tutorial - 10 Jan 2014
Virtualising objects
� objective of achieving more automated and
widely adopted solutions: need to make a clean
break between physical objects and applications /
business logic that use these
� virtual representation of an object, if it has well
defined interfaces for interaction, can be easily defined interfaces for interaction, can be easily
reused
� semantic enrichment, not easy to achieve on
object / constrained devices is more easily dealt
with within object virtual counterparts sitting on
resource intensive machines (i.e. refer to virtual
machines in the Cloud)
� etc.35 CCNC 2014 Tutorial - 10 Jan 2014
So, what’s in the middle?
� SOUTHBOUND: control and management of objects /
devices
� NORTHBOUND: logic to tailor how data becomes
information and useful knowledge to the applications
� application specific, but there might be invariants
� architectural considerations� architectural considerations
� an overview of the IoT-A ARM (Architecture Reference
Model)
� ref: iot-a EU project www.iot-a.eu
36 CCNC 2014 Tutorial - 10 Jan 2014
IoT-A Architecture Reference Model
� Minimum set of “functionality groups”
� application
� IoT service
� communication
� device
37 CCNC 2014 Tutorial - 10 Jan 2014
IoT-A functional model
38 CCNC 2014 Tutorial - 10 Jan 2014
let’s put that in practice...
39 CCNC 2014 Tutorial - 10 Jan 2014
how to create a vertical IoT application
� connect a device to a server
40 CCNC 2014 Tutorial - 10 Jan 2014
Open Source Hardware Platforms
ARDUINO
41 CCNC 2014 Tutorial - 10 Jan 2014
OpenPicus Flyport
� connect a device to a server
� log / read monitored data, do stg with it
how to create a vertical IoT application
42 CCNC 2014 Tutorial - 10 Jan 2014
objects
how to create a vertical IoT application
� connect a device to a server
� log / read monitored data, do stg with it
� link it to an application and BINGO! here is you
“Hello IoT World!” first application...however:
43 CCNC 2014 Tutorial - 10 Jan 2014
objectsapplication
how to create a vertical IoT application
� connect a device to a server
� log / read monitored data, do stg with it
� link it to an application and BINGO! here is you
“Hello IoT World!” first application...however:
� infrastructure intensive exercise (need to store
data, need processing power, need connectivity data, need processing power, need connectivity
etc.)
� this is where bespoke applications kits or
HORIZONTAL platforms come in...
44 CCNC 2014 Tutorial - 10 Jan 2014
IoT Platforms
45 CCNC 2014 Tutorial - 10 Jan 2014
What do these IoT Platforms have in
common?
objects IoT
platform
applications
value-add (lock-in) features
46 CCNC 2014 Tutorial - 10 Jan 2014
applications
objects IoT
platform
applications
most of the features of an IoT system
architecture can be factored out...
� different companies have opted for
different choices
� bespoke, vertical, with/out GW
� sen.se
� smartthings.com� smartthings.com
� fitbit.com
� platform, horizontal, cloud-based
� thingworx
� xively
� evrythng
47 CCNC 2014 Tutorial - 10 Jan 2014
vertical vs. horizontal
Middleware
Applications
V
E
R
the IoT device, the gateway (if used), and the application are all provided and controlled by the same company. Open Horizontal IoT Platform
The horizontal approach makes innovation easier and allows rapid proliferation of new applications and businesses, but it needs
48 CCNC 2014 Tutorial - 10 Jan 2014
Middleware
Virtualise
Devices
Connectivity
IOT
R
T
I
C
A
L
A
P
P
Slittle infrastructure in place to support a horizontal business
businesses, but it needs to gain considerable traction before it can pay off on its promises. There need to be a lot of open gateways in place before third-party developers can count on having an adequate market to serve.
Part II – IoT Protocols
� handover to VP slideset
49 CCNC 2014 Tutorial - 10 Jan 2014
Part III – Open Horizontal Platforms for IoT
� Michael Koster slideset
50 CCNC 2014 Tutorial - 10 Jan 2014
Part IV – the iCore Cognitive IoT, rationale and
architecture
Middleware
Applications
Composite
Service LevelV
E
R
T
51 CCNC 2014 Tutorial - 10 Jan 2014
Virtualise
Devices
Connectivity
Virtual Object
Composite
Virtual ObjectIOT
T
I
C
A
L
A
P
P
S
the need for Cognitive IoT and EU iCore project
� need for cognitive
and machine
learning based
framework to more
automatically deal
with the Interent of with the Interent of
Things without too
much end-user
know-how and
involvement
iCore Websitewww.iot-icore.eu
Contacts:Raffaele [email protected]
3 yrs EU FP7 Integrated Project (started 1st Oct 2011)23 Partners with strong industrial representation8.7mEur EU FundingEU + China, Japan, Korea
ID Card
iCore EU-project ID
Abdur [email protected]
EU + China, Japan, Korea
Further info / links
[REF2] P. Vlacheas, R. Giaffreda et al. "Enabling Smart CitiesThrough a Cognitive Management Framework for the Internetof Things“, IEEE Communications Magazine - Special Issueon Smart Cities (June 2013)
[REF1] IERC April 2013 Newsletter – Foreword (see THIS LINK)
[REF3] iCore website (www.iot-icore.eu/latest-news) [REF3] iCore website (www.iot-icore.eu/latest-news) Best Demo Award at FuNeMS 2013
Introducing the VO concept
� talked about
“virtualisation” earlier
� DISCOVER & SELECT
� USE & MANAGE
VO SW agent
VO APIs
(remote) proprietary API calls
VO SW agent host
the VO concept
� VO exposes several APIs to the upper
layers
� Features, functionalities and resources can
be re-used
� Cognitive control enabled by exposing
APIs which can be used to optimize the
behaviour of the ICT object
Exposed APIs
ICT
object processes
ICT APIs
API calls
ICT object
A simple example: VO SW agent host = laptop with Zigbee dongle
ICT object = Zigbee temperature meternon-ICT object = room
� VO SW agent may or may not be
installed on the ICT object
� Depends on ICT object capabilities
� Association management between ICT
and non-ICT is a real challenge!
� RESILIENCE ASPECTS
Association
non-ICT object
56
what do VOs achieve: logical level
iCore FW
Application: pure function
VO Front VO Front
End
VO Front VO Front
End
VO Front VO Front
End
57
Gateway
VO Back
End:
Net Driver
VO Back
End:
Net Driver
VO Back
End:
RWO Driver
VO Back
End:
Net Driver
RWO1
fostering automation - discovery
� description associated with an IoT Object, it better be machine
readable
� i.e. semantic enrichment based on info model for semantic-
based selection
� what is this good for?
� selection “by relevance”: performance and “selection quality” is
dependent upon combination of enrichment + algorithm that exploits it...dependent upon combination of enrichment + algorithm that exploits it...
� assessment of “proximity” is a prerequisite in achieving more automatic
and scalable solutions
VO Information Model – semantic search
Examples (energy efficiency for sensors)
� besides discovering and selecting
� virtual representative “takes the heat off” real sensors
becoming their actual “manager”
� energy efficiency
� reuse
� resilience� resilience
� self-x for constrained resource devices
� conflict resolution (actuators)
� Examples
� compression algorithms, data caching, pub/sub schemes,
rules for self-x management
HUMANMACHINE
added value besides sensing efficiency
what happens when it becomes
easier and easier to tap into
object produced data?
cars increasingly more
complex
increasing competition
for owner’s attention
OBD
On Board Diagnostics
HUMANMACHINE
added value besides sensing efficiency –
Innovation potential
“Innovation”: one
can focus on apps!!!
we make “machines” step-in, assisting us!
MACHINEHUMAN
OBD
On Board Diagnostics
siloed and bespoke IoT applications
APPS
HO
US
E
APPS
FR
IDG
E
APPS
PA
TIE
NT
APPS
PA
TIE
NT
APPSAPPS
APPSAPPS
APPSAPPS
DATA / INFORMATION OVERLOAD, BUT...
CA
R
SENSORS
HO
US
E
SENSORSF
RID
GE
SENSORS
PA
TIE
NT
SENSORS
PA
TIE
NT
SENSORS
PA
TIE
NT
SENSORS
PA
TIE
NT
SENSORS
PA
TIE
NT
SENSORS
PA
TIE
NT
SENSORS
APPS
PA
TIE
NT
SENSORS
APPS
TR
UC
K
SENSORS
APPS
IF A WELL-DEFINED INTERFACE INTO CAR
SENSORS BRINGS SUCH INNOVATON POTENTIAL...
APPS
HO
US
E
APPS
FR
IDG
E
APPS
PA
TIE
NT
APPS
PA
TIE
NT
APPSAPPS
APPSAPPS
APPSAPPS
CA
R
HO
US
E
FR
IDG
E
PA
TIE
NT
PA
TIE
NT
SENSORS
PA
TIE
NT
SENSORS
PA
TIE
NT
SENSORS
PA
TIE
NT
SENSORS
PA
TIE
NT
SENSORS
APPS
PA
TIE
NT
SENSORS
APPS
TR
UC
K
SENSORS
APPS
SENSORS SENSORS SENSORS SENSORS
of course that’s a dream far from becoming true...
http://readwrite.com/2013/06/14/whats-holding-up-the-internet-of-things
the IoT standardisation jungle
Real-World Information DB
Au
then
tica
tio
n
Au
then
tica
tio
n
Real-World Knowledge Model (RDF Concepts & Facts)
GUI
Service Requester (Technology Agnostic)
Situation Awareness
Situation Projection
Situation Classification
Situation Recognition
Situation Detection
Queried Fact Collector
Natural Language Processing
(NLP)
Service Request
(SPARQL)
API
Service Request Analysis
RDF Rules
Inference
Engine
Semantic
Query
MatcherLearning
Statistics
Service Analysis
User Characterisation
Learning
Mechanisms
Intent Recognition
Service Templates
Repository
CVO FactoryAP
I
Domain
Expert /
Knowledge
Engineer
AP
I
Ad
min
istr
atio
n &
Man
agem
ent
I/F
Authentication
Authentication
CVO Management Unit
Service Execution Request
M2M
M2MM2M
M2M
M2M
CLOUD
P1723
EPCGlobal
SES
W3C PROV
PROV-DM /PROV-O /
PROV-AQ / PROV-XML
W3C PROV
PROV-DM / PROV-O /
PROV-AQ / PROV-LINKW3C PROV
PROV-DM /PROV-O /
PROV-AQ / PROV-XML
W3C PROV
PROV-DM / PROV-O / PROV-
AQ / PROV-CONSTRAINT
ITU-T
IoT-GSI
ITU-T
FG M2M
ITU-T
FG DistractionISO/IEC
JTC1 WG7
CVO Container (Execution)
Au
then
tica
tio
n
Au
then
tica
tio
nA
uth
enti
cati
on
VO Factory
VO Templates Repository
CVOCVO
CVOCVO
CVO
CVO
Situation ObserverCVO
Situation ObserverCVO
Situation ObserverCVO
Situation Observer
System Knowledge Model
CVO Registry
CVO Templates Repository
VO Registry
VO Management Unit
VO Lifecycle
ManagerCoordination
Data Manipulation
/ Reconciliation
Resource
OptimisationVO Container (WS host)
VOVOVOVOVOVOVOVOVOVO
VO Front End
VO Back End: RWO Driver
Approximation &
Reuse
Opportunity
Detection
CVO Composition
Engine
Orchestration /
Workflow
Management
Learning
Mechanisms
Device
manufactu
rer
API
Resource SensorActuator
GTW/Controller
Data
Processing
Domain
Expert /
Developer
Access
Control
Access
Control
Ad
min
istr
atio
n &
Man
agem
ent
I/F
Installer/
User
Installs
Sensor/Ac
tuator
Devices
Resource SensorActuator
GTW/Controller …………..
….. …..
CVO Lifecycle
ManagerCoordination
Quality
Assurance
Performance
Management
CVO Execution Request
M2M
M2M
M2M
CLOUD
CLOUD
CoAP
CoAP
SSN-XG
MQTT
MQTT
3GPP
3GPP
3GPP 3GPP
EPCGlobal
SPS
SOSSES SAS
SPS
SOS
SPS
SASWNS
SPSSOS
SOS
SOR SIR
CSW
O&M
SensorML
W3C PROV
PROV-DM /PROV-O /
PROV-AQ / PROV-XML
W3C PROV
PROV-DM / PROV-O / PROV-
AQ / PROV-CONSTRAINT
W3C PROV
PROV-DM /PROV-O /
PROV-AQ / PROV-XML
EPCGlobal
ITU-T
IoT-GSI
ITU-T
IoT-GSI
ITU-T
IoT-GSI
ITU-T
IoT-GSI
ITU-T
FG M2M
ITU-T
FG M2M
ITU-T
FG Distraction
ISO/IEC
JTC1 WG7
ISO/IEC
JTC1 WG7
ISO/IEC
JTC1 WG7
LWM2M
LWM2M
LWM2M
LWM2M
LWM2M
LWM2M
LWM2M
courtesy of Panagiotis Vlacheas and Vera Stavroulaki (Piraeus University )
some (good) candidates
� imagine the Internet with no browser, no plugins
� collection of bespoke, non interoperable content
specific applications enabling access and visualisation
of connected files
an IP based web services view from Sensinode
http://www.iot-week.eu/presentations/thursday/02_Shelby-IoT-Smart-Cities.pdf
Courtesy of Zach Shelby (Sensinode)
fostering interoperability
� at service level (ESBs)
� at communication level (PUB/SUB MQTT bus)
� at device level (GSN)
� no silver bullet...a lot of it will depend on application
context...context...
useful ingredients?
� common interfaces to interact with objects (i.e.
REST)
� + extra containers for metadata
� let the systems know what the object is good
for, its location (“I am a Temp sensor in Room for, its location (“I am a Temp sensor in Room
A”), its accuracy, its energy levels etc.
take inspiration from HTML and the Semantic Web
“I am a webpage and I talk about Paris (city of France) history”
Integration at “application level” with all pros and cons associated with it
the iCore story so far...
� increasing number of objects
� discovery and self-management of objects
� connect and virtualise your objects, unlock value
� interoperability across application domains and reliability
still big issues...
once achieved the means to access
an objects as a service...
� object redundancy would allow me to cope with resource constraint nature of objects as well as with the diversity of interfaces� if I had a bunch of VO temp objects to chose from I would be much
more likely to tell you what the temperature is...
� semantic enrichment allows me to find alternatives, to foster object reuse and achieve service approximation concepts
� here we start entering more the “cognitive-inside” IoT object � here we start entering more the “cognitive-inside” IoT object management territory
� having a logic for choosing the appropriate Virtual Objects according to the application expectations
� having the means to easily connect objects together in a more or less complex graph (CEPs, PUB/SUB channels)
� features of Composite Virtual Objects and associated “CVO Templates”
cognitive mash-ups of semantically interoperable VOs (and their offered services) which render services matching the application requirements
Introducing the CVO
CVO concept allows for approximate services...
CA
R
APPS
HO
US
E
APPS
FR
IDG
E
APPS
PA
TIE
NT
APPS
HO
US
E
FR
IDG
E
PA
TIE
NT
SENSORS SENSORS SENSORS SENSORS
PATIENT is near the FRIDGE
CAR is near the HOUSE
PATIENT is driving the CAR
objects reuse across domains
KitchenPresDetect PatientStatusDetect
CVOs allow Automatic Composition
CVOType 1
VOType :: Temp sensor
getTemp()
Subject to constraints:- Dist (Pos, myPos) < 10m
CVO 1
VOx
FIND
getTemp()
VOType :: Press sensor
getPressure()
- Dist (Pos, myPos) < 10m- Not already allocated
Logic:If getTemp() > 20° and getPressure() > 2bar then NiceWeather
VOy
CP Solver to find VO allocations that satisfies all constraints and minimizes network traffic
USE
leveraging on System Knowledge (i.e. VOx is good and fully charged) to maintain IoT-based services...
CVO templates
� factoring “smart logic algorithms” out of users /
developers concerns
� IF “crash” THEN “alertRSA”
� “crash” (IF VO_x = TRUE THEN crash := TRUE)
� (IF VO_x = TRUE AND VO_y = TRUE THEN crash := TRUE)
TAG:
crash
detect
VO_x
TAG:
crash
detect
VO_yIF (VO_x = TRUE) AND (VO_y = TRUE)
THEN crash := TRUE
IF VO_x = TRUE
THEN crash := TRUE
IF (VO_x > TH_x) AND (VO_y > TH_y)
THEN crash := TRUE
factor out cognitive technologies
• “ready meals” for IoT apps
workflow-based SEP for CVOs
Car’s sensors/actuators
Open Data (Web)
courtesy of Michele Stecca (M3S)more info: http://www.slideshare.net/steccami/ieee-icin-2011
Event based CVO execution
CVO ContainerCVO Container
CVOCVO CVO CVO
CEP engineCEP engine
Observer
Observer
Machine Learningextensions
Machine Learningextensions
Event / (C)VO Bus (pub/sub based on MQTT)Event / (C)VO Bus
(pub/sub based on MQTT)
CEP engineCEP engine
VO ContainerVO Container
SensorVO
SensorVO
SensorVO
SensorVO
SensorVO
SensorVO
ActuatorVO
ActuatorVO
ActuatorVO
ActuatorVO
courtesy of Walter Waterfeld (Software AG)more info: http://terracotta.org/downloads/universal-messaging
Internet vs. IoT
� a page + a page + a page...connect info
� represent info – HTML
� aggregate info – hyperlink
� a (sensor) feed + a feed + a feed...
represent feeds – VO � represent feeds – VO
� aggregate feeds – CVO
the story so far...bottom-up
what’s in here?
how to ensure user how to ensure user
friendliness and wide
adoption...
the story so far...
� increasing number of objects
� discovery and self-management of objects
� connect and virtualise your objects, unlock value
� exploit redundancy pick the most suitable / interoperable /
reliable objects
� VO / CVO services like Lego bricks fostering innovation � VO / CVO services like Lego bricks fostering innovation
from IoT makers
� cognitive inside? so far only application-driven match-
making
� ultimate goal: user-friendly IoT services fostering wide
adoption
a ‘top-down’ view
� routine jobs: water the plants, feed the fish, take my pills, track sent items etc.
� there are objects, sensors, actuators
� there are people (busy lives, forgetful patients, green fingers vs. fingers that “kill every plant they look after”)they look after”)
� objects can be connected
� objects can be mashed-up
� create your own IoT apps (this is what IoTmakers do) vs. provide some input and have this interpreted so the right actions are set to achieve your goals
� make the IoT easy to use and rely upon...
unlocking a huge potential
data
data datada
ta
da
ta
datapresence
patterns exist ...
CVOs
derive patterns of ...
interpret
data
da
ta
data data
data
da
ta data
data
da
ta
datadata
data
data
H/WSE
NS
ING
Real World Objects
(RWO)
VOs
data goldmine and lots of
siloedapplications
presence
derive patterns of ...
it’s a complex IoT world...
the need for cognitive technologies
� rather than for the selection of appropriate templates,
here focus is on refinement of selected one according
to observed system-reality matching
� Real-World-Knowledge “growing”
Learning and adaptation to the users preferences� Learning and adaptation to the users preferences
TAG:
crash
detect
VO_x
TAG:
crash
detect
VO_yIF (VO_x > TH_x) AND (VO_y > TH_y)
THEN crash := TRUE
assess
QUALITY of
PREDICTION
REFINE
TH_x, and TH_y
Real World and System Knowledge models
Real World Knowledge
(RWK)
Models
derive patterns of ...
interpret
data
System Knowledge
(SK)
Models
presence
derive patterns of ...
What are these
good for?
Cognitive Inside where and why...
� Service Level: gather data relate to actions / situations
� support users (OBSERVE – LEARN – REPLACE)
� routine jobs (watering plants, feeding the fish, taking pills,
switch on/off lights)
� non-expert alerts (a fire, a leak, a fault) � non-expert alerts (a fire, a leak, a fault)
� provide feedback
� improvement of system performance
Some examples please?
� tracking cars in a smart city
� medical equipment tracking and asset management
tracking cars in a smart city
Best demo
award at
FuNeMS 2013
courtesy of Marc Roelands (Bell Labs – Alcatel Lucent)
more info: http://www.iot-icore.eu/attachments/article/66/iCore_FuNeMS%2713_ALU.pdf
tracking medical equipment
Validate
Train
Execute
RWO parameter reconfiguration
recommendations to improve energy
efficiency of location sensorsIn the demo implementation,
Database of location
information(spatial &
temporal) of objects
3
4
5
Train efficiency of location sensorsIn the demo implementation,
location data of objects is
simulated
1
2
2a4a
6
7
Trento Hospital S. Chiara CREATE-NET, Trilogis +
ZIGPOS
Part V. Part V – Academic research issues
� handover to VP
91 CCNC 2014 Tutorial - 10 Jan 2014