Juha-Pekka Soininen, VTT Antti Lappeteläinen, Nokia · Juha-Pekka Soininen, VTT Antti...

Copyright © VTT & Nokia

ARTEMIS JU SP3 / 100017: Smart Objects For Intelligent Applications

SOFIA

M3 smart space infrastructure

Juha-Pekka Soininen, VTT

Antti Lappeteläinen, Nokia



SOFIA

M3 – revolution inapplication development

What if I know thathe is answering

the call? Should Iturn the sound

off?Automatically?

What if I know that hecan not hear the

incoming call? Should Iflash lights?

Automatically?

What if I know thatmusic is loud in the

room? Could Ialarm louder? Use

vibration?Automatically?

With M3 your environmentknows what’s happening!

M3 makes it possible to mash-up andintegrate information between allapplications and domains spanning fromembedded domains to the Web.



SOFIA

Embeddedsystems

Real world objects

BackgroundDistribution ofcomputation intoenvironment

Distribution ofresponsibility of user

experience intoobjects in

environment

Single purposedevices

Networked peripherals

Web servicesPersonalcomputing Internet

Objects withdigital information

Objects withcomputationcapabilities

Solutions

Mobile phones

Networkedservices

RFID, NFC

UPnP, DLNA, NoTA

Camera, printer, TV, etc.

Zigbee, BT, etc.

Smart Cards,Java Cards,etc.

Yahoo, Google, Amazon

iTunes, Ovi, etc.

BrowsersPC

Smart phones

Ubiquitouscomputing

AmbientIntelligence

Internet ofThings

Intelligence intoreal world

Informationworld

Distributedsystems



SOFIA

Vision: fusion of physicaland information worlds

S

S

S

S

S

S

S

S

S

S

S

S

S

S

S

S

SS

SS

S

S

S

S

S

S

S

S

S

S

S

SS S

S

S

S

S

SS

S

S

S

S

S

S

SS

S

S

S

S SS

S

S

S

S

S

S

S

S

S

S

S

S

S

S

S

S S

S

S

S

S S

S

S

S

S

S

S

S

SSS S

S

S

S

S SS

S

SS

S

SS

S

S

S

S

S

SS

SS

S

SS

S

S

S

S

S

S

SS

S

S

SS

S

SS S

S

S

S

SS

S

S

SS

SS

S

S

S

SS

S

S

S

S

S

S

S

S

S

S

S

S

S

S

SS

S

SS

S

S

S

S S

S SS S S

S

S

S

S

S

S

S

S

S

S

S

S

S

S

S

S

S

SS

SS

S

S

S

S

S

S

S

S

S

S

S

SS S

S

S

S

S

SS

S

S

S

S

S

S

SS

S

S

S

S SS

S

S

S

S

S

S

S

S

S

S

S

S

S

S

S

S S

S

S

S

S S

S

S

S

S

S

S

S

SS

S S

S

S

S

S SS

S

SS

S

SS

S

S

S

S

S

SS

SS

S

SS

S

S

S

S

S

S

SS

S

S

SS

S

SS S

S

S

S

SS

S

S

SS

SS

S

S

S

SS

S

S

S

S

S

S

S

S

S

S

S

S

S

S

SS

S

SS

S

S

S

S S

S SS S S

S

Information from physical world…

...easily available fordevices and novelapplications…

M3 smart space

M3OpenSource

…and linkingit to servicesand solutionsin Internet

…and doing all thisvendor independently,device independently anddomain independently



SOFIA

Mission

Open embedded data invarious devices toapplications to createlocal services in millionsof places…

… and monetize it by usingthe web tools and

business models



SOFIA

“Smart EnvironmentAxioms”

• Interoperability is unavoidable step in theevolution of information world

• There is no single technology that canmaster the variety of needs

• World can not be built/changedinstantaneously

• The cost of interoperability agreementsincreases when moving towardsimplementations

• A single company can not build the world



SOFIA

What is needed for smartenvironments

Smartphysicalspaces

Sharing informationfrom the objects and

devices in the physicalspace

Possibility to buildthe environment andservices gradually

Open solutionsfor interoperability

Support for use ofnew innovations

Exploitation ofWeb services

Intuitive useand development

of services



SOFIA

M3 interoperability layers

SmartWorld

ServiceWorld

DeviceWorld

KP

KP

KP

KP

KPKP

SNSN

SNANSN

Smart Spaces

Service Domain

Device Network

Serv ServClient

ServServ Client

Srv

Srv

Srv

Srv SrvClient

Client

Srv Srv

Srv

Client ClientClient

Dev

DevDev

SOI

SOI

SOISOI service ontology

interpreter

Dev

Dev

DevDev

Dev

DevGW

GW

GW Gateway betweennetworks

SIBKP

SIB



SOFIA

M3 principles

• Voluntary sharing of information by objects in physical space

• Publish-subscribe/query architecture

• It is up to information owner only to decide what and howinformation is published

• Interoperability agreements on information level

• Common ontology model and data presentation format are theonly requirements

• Respecting the integrity and independence of devices

• Enabling cross-domain use cases

• Means and techniques must be use case independent

• Support for enforcement to device and smart objectmanufacturers

• Exploitation of existing service and device world solutions



SOFIA

M3 functionalarchitecture

Semanticinformation

broker

Knowledgeprocessor

Knowledgeprocessor

Knowledgeprocessor

Device with embedded systemLocal informationstorage with RDF-storeand informationgovernance functionality

Access protocol (SSAP),with basic operations, e.g.join, leave, insert, remove,subscribe. Etc.

Common ontologymodels for use casesas informationinteroperability enabler

Application logic andinterface supporting the useof common use caseontology and access toinformation broker



SOFIA

M3 - design time view

Bling!

A great idea involving twoprogrammable devices thatneed to share information!

Create a commonontology model foryour use case (orpreferably take anexisting one)

M3tool

support(1

M3tool

support

M3knowledgeprocessor

Generate aconvenience libraryfor your targetenvironment thathides the ontologiesand data formats

ADK fortargetdevice

ADK fortargetdevice

Write M3KPs usinggeneratedlibraries

M3knowledgeprocessor

M3-SIBOpenSource

Use M3 forsharing theinformationand create“The Bling!”

1) Smart-M3 Ontology compiler, published in Open Source

device

device



SOFIA

M3 based smartenvironments

M3-SIBOpenSource

M3M3

M3

M3M3

Centralised smart space Multiple interacting smartspaces

Device witha SIB inside

Devices with knowledgeprocessors inside

SIB

knowledge processors

A smart space (i.e. a SIBwith interacting KPs)



SOFIA

M3 based applications

M3-SIBOpenSource

Informationproviders(publishers)

Application usingthe information

M3-SIBOpenSource

M3-SIBOpenSource

Predesigned set ofapplications creating thedesired functionality

Independent applicationscreating a combinedfunctionality

Traditionalapplicationmodel

Control applicationmodel

Social applicationmodel

The same types can beimplemented with multiple anddistributed SIBs

The applications can beenhanced using service levelinteroperability (e.g. direct useservices from other devices)



SOFIA

M3 enforcement support

• M3 will distributed as Open Source under BSD licence

• Maximum flexibility, simple availability

• Minimum dependencies between organisations and companies

• M3 use will be supported with tools

• Reference implementations to ease up the first experiments

• Convenience library generators for hiding the ontologies anddata storage formats from embedded system developers

• M3 application development support under development

• Ontology model based application development

• Domain dependent supporting function libraries



SOFIA

Architecture of M3 smartenvironment

SIB1 KP3-N

Optional

KP2KP1

use case logic

Ontologyinterpreter and

governance

Informationstorage

Service andcommunicationlevel

Informationlevel

Applicationin smart environment

Ontology(use) support

KPI

Smart space

Ontology model

Data format Common solution

Information access

Existing service and communication solutions (service discovery, service registry,resource manager, protocols, physical layers, etc.)



SOFIA

M3 – Value Offering

• USERS: Freedom of choice

• I want to select my device freely from any vendor knowing that it workswith all devices I already have. – M3 = multi vendor

• DEVICE MANUFACTURERS: Seamless operation with all devices

• I want to create innovative products that consumers want to buybecause they work seamlessly with other devices wherever he goes. –M3 = multi device

• SERVICES COMPANIES: Gaining competitive edge

• My company develops novel services using mash-up approach and wewant seamless data portability to effortlessly create winning solutions forcross domain user experience. - M3 = multi domain

• APPLICATION DEVELOPERS: Focus on consumer ‘wow’

• As an application developer I want to focus on creating consumer ‘wow’instead of porting my code to all different platforms. I also want developcross-domain mash-up services as easy as internet services are createdtoday! – M3 = multi domain



SOFIA

Open Source andEcosystem

M3Open Source

DIEM

Sofia

ConsumerElectronics

AutomotiveBuilding Automation

Mobile QtAndroidiPhone

iTRONT-Kernel

WinCELinuxJava

Others

Projects

Entry

Domain Platform

Commercial

Activities

Commercial

Activities



SOFIA

Path to success

M3Open Information Platform

Smartenvironments toeverywhere…

Mobile deviceswill evolve…

…to multi-part devices(with dynamicallychanging parts)

…to information sensingextension of humansInteraction with spaces

instead of devices

…with local informationto be exploited

…with new kind ofemerging experiences

…with energy andresource saving reuse



SOFIA

Summary

• M3 – multi-vendor, multi-device, multi-domain solution for informationinteroperability

• Link between physical and informationworlds

• Open source distribution with maximumflexibility and easy access and adaptation

• M3 does to smart environments what theHTTP/TCP/IP did for Internet



SOFIA

Thank you

Juha-Pekka Soininen, VTT Antti Lappeteläinen, Nokia · Juha-Pekka Soininen, VTT Antti...

Documents

Transcript of Juha-Pekka Soininen, VTT Antti Lappeteläinen, Nokia · Juha-Pekka Soininen, VTT Antti...