201209 smart objects and semantic web
-
Upload
jun-hu -
Category
Technology
-
view
390 -
download
0
description
Transcript of 201209 smart objects and semantic web
Smart Objects and Semantic Web: A semantic approach to intelligent environments
© 2012 Jun Hu
Department of Industrial Design PAGE 1 26-9-2012
PAGE 2 26-9-2012
PAGE 3 26-9-2012
PAGE 4 26-9-2012
PAGE 5 26-9-2012
PAGE 6 26-9-2012
Semantic Web
• Access to universal knowledge
Department of Industrial Design PAGE 7 26-9-2012
Semantic Web
• Siri
Department of Industrial Design PAGE 8 26-9-2012
Semantic Web
• Siri
Department of Industrial Design PAGE 9 26-9-2012
Semantic Web
• Siri
Department of Industrial Design PAGE 10 26-9-2012
Semantic Web
• Ontology: Access to universal knowledge
Department of Industrial Design PAGE 11 26-9-2012
Semantic Web
• Ontology: Categories of being
Department of Industrial Design PAGE 12 26-9-2012
Semantic Web
• Ontology: in Resource Description Framework
− A collection of subject-predicate-object triples:
• A is B, B is C
• C has D
• …
• A loves B
• B hates A
• (S P O)
Department of Industrial Design PAGE 13 26-9-2012
Semantic Web
• Ontology: in Resource Description Framework
− Artificial Intelligence
• A is B, B is C => A is C
• C has D => A has D
• …
• A loves B
• B hates A => A (can not marry) B
• (S P O)
Department of Industrial Design PAGE 14 26-9-2012
Semantic Web
• Ontology on web => Semantic Web
• (S P O) => (#s #p #o)
Department of Industrial Design PAGE 15 26-9-2012
Semantic Web
• Ontology on web => Semantic Web
• (S P O) => (#s #p #o)
Department of Industrial Design PAGE 16 26-9-2012
Semantic Web
• Ontology on web => Semantic Web
• (S P O) => (#s #p #o)
Department of Industrial Design PAGE 17 26-9-2012
Semantic Web
• Siri
Department of Industrial Design PAGE 18 26-9-2012
Semantic Web
• Ontology on web => Semantic Web
• (S P O) => (#s #p #o)
Department of Industrial Design PAGE 19 26-9-2012
Semantic Web
• Access to universal knowledge
Department of Industrial Design PAGE 20 26-9-2012
Semantic Web
• Access to universal knowledge
− through
− Internet of Knowledge
Department of Industrial Design PAGE 21 26-9-2012
Semantic Web
• Access to universal knowledge
− through
− Internet of Knowledge
− by
− Internet of People
Department of Industrial Design PAGE 22 26-9-2012
Social Networks
• Internet of People
Department of Industrial Design PAGE 23 26-9-2012
Social Networks
• Internet of People
Department of Industrial Design PAGE 24 26-9-2012
A social network is a social structure made up of
individuals (or organizations) called "nodes", which
are tied (connected) by one or more specific types
of interdependency, such as friendship, kinship,
common interest, financial exchange, dislike,
sexual relationships, or relationships of beliefs,
knowledge or prestige.
http://en.wikipedia.org/wiki/Social_network
Social Networks
• Internet of People
Department of Industrial Design PAGE 25 26-9-2012
Social Networks
• Internet of People
• Foursquare
• MySpace
• Renren
• …
Department of Industrial Design PAGE 26 26-9-2012
Social Networks
• Internet of different People
• Foursquare
• MySpace
• Renren
• …
Department of Industrial Design PAGE 27 26-9-2012
Social Networks
• Internet of People
• Why?
Department of Industrial Design PAGE 28 26-9-2012
Social Network
• Internet of People
• Why?
Department of Industrial Design PAGE 29 26-9-2012
Social Networks
• Internet of People
• Why?
Department of Industrial Design PAGE 30 26-9-2012 Maslow's Hierarchy of _Needs
Social Networks
• Internet of People
• Why?
Department of Industrial Design PAGE 31 26-9-2012 Maslow's Hierarchy of _Needs
Social Networks
• Internet of People
• Internet of People Internet of Things
Department of Industrial Design PAGE 32 26-9-2012
© http://www.economist.com/node/15350960
Social Network
• Network of People => Internet of People
• Internet of People Internet of Things
Department of Industrial Design PAGE 33 26-9-2012
© http://www.economist.com/node/15350960
Internet of Things
What is it?
Department of Industrial Design PAGE 34 26-9-2012
© http://www.economist.com/node/15350960
The Internet of Things refers to uniquely
identifiable objects (things) and their virtual
representations in an Internet-like structure.
© Wikipedia
Internet of Things
• Identifiable
Department of Industrial Design PAGE 35 26-9-2012
Internet of Things
• Sensing
Department of Industrial Design PAGE 36 26-9-2012
Internet of Things
• Actuating
Department of Industrial Design PAGE 37 26-9-2012
Internet of Things
• Virtualization and connectivity
Department of Industrial Design PAGE 38 26-9-2012
Internet of Things
• Local Intelligence
• Google I/O
Department of Industrial Design PAGE 39 26-9-2012
• Web 3.0, the future of the internet
• http://youtu.be/FzIwXqqDnOY
Department of Industrial Design PAGE 40 26-9-2012
• Interoperablibility in the interconnected world
• http://youtu.be/FzIwXqqDnOY
Department of Industrial Design PAGE 41 26-9-2012
SOFIA
• Smart Objects for Intelligent Environments
• funded through the European Artemis programme
Department of Industrial Design PAGE 42 26-9-2012
SOFIA
• Smart Objects for Intelligent Environments
• funded through the European Artemis programme
• Context:
• Smart Environment – ecosystem of interconnected and
interoperating smart objects
• Newly developed and legacy devices
• Connections and relations between smart objects
• Shifting from interacting with single products to interaction
with a system of products
Department of Industrial Design PAGE 43 26-9-2012
Internet of Things and semantic Web
Department of Industrial Design PAGE 44 26-9-2012
Service data gathering and mining
Ontology and semantics of the intents, interests and concepts
Internet of things Web of people
Sematic Information
Broker
Ontology
Blackboard
Knowledge
Processor Knowledge
Processor
Knowledge
Processor …
Smart
Object
Smart
Object
Smart
Object
…
Making "information" in the physical world available
for smart services - connecting the physical world
with the information world
SOFIA
• Demo: Semantic connections - Spotlight navigation
• http://youtu.be/bOrIPp-aglg
Department of Industrial Design PAGE 45 26-9-2012
SOFIA
• Pilot: Smart space
• http://youtu.be/NjSwTU9tX4w
Department of Industrial Design PAGE 46 26-9-2012
SOFIA
• Based on Ontologies (Semantic Web)
• And the Blackboard Pattern
Department of Industrial Design PAGE 47 26-9-2012
SOFIA
• Pilot scenario
Department of Industrial Design PAGE 48 26-9-2012
SOFIA
• Ontology: RDF
Department of Industrial Design PAGE 49 26-9-2012
SOFIA
• Ontology: OWL
Department of Industrial Design PAGE 50 26-9-2012
SOFIA
• Ontology: devices
Department of Industrial Design PAGE 51 26-9-2012
SOFIA
• Ontology: interaction events
Department of Industrial Design PAGE 52 26-9-2012
SOFIA
• SIB
Department of Industrial Design PAGE 53 26-9-2012
SOFIA
• SIB Ontology
• Create/Add/Remove/Update
Department of Industrial Design PAGE 54 26-9-2012
SOFIA
• SIB Ontology
• Create/Add/Remove/Update
• Query (SPARQL)
Department of Industrial Design PAGE 55 26-9-2012
SOFIA
• SIB Ontology
• Create/Add/Remove/Update
• Query (SPARQL)
• Reasoning (SPIN – SPARQL Inferencing Notation)
Department of Industrial Design PAGE 56 26-9-2012
SOFIA
• KP
Department of Industrial Design PAGE 57 26-9-2012
SOFIA
• Based on Ontologies (Semantic Web)
• And the Blackboard Pattern
Department of Industrial Design PAGE 58 26-9-2012
Student projects
Department of Industrial Design PAGE 59 26-9-2012
Doormate
Doormate
Doormate
Doormate
Bonsai Garden
Bonsai Garden
• Gaming elements
Bonsai Garden
Resources
• https://github.com/iddi/sofia
• What you would need: • Eclipse for RCP and RAP Developers (Helios)
• EGit
• Android ADK (if Android is used)
• SOFIA ADK
• TUeSIB
• Python (if python is preferred)
• Smart-M3 Python KPI
• SSLS
• …
• More at: https://github.com/iddi/sofia/wiki/Installation
Department of Industrial Design PAGE 67 26-9-2012
Resources
• SOFIA is based on SMART-M3
• M3: multi-vendor, multi-device and multi-part • About SMART-M3:
• http://en.wikipedia.org/wiki/Smart-M3
• SMART-M3 on source forge:
• http://sourceforge.net/projects/smart-m3/
Department of Industrial Design PAGE 68 26-9-2012
Resources
• SOFIA is contunued:
• https://sofia-community.com/
Department of Industrial Design PAGE 69 26-9-2012
References
Department of Industrial Design PAGE 70 26-9-2012
1. G. Niezen, ONTOLOGIES FOR INTERACTION: Enabling serendipitous interoperability in smart environments. PhD Thesis, Eindhoven University of Technology, 2012.
2. B. J. J. van der Vlist, Designing Semantic Connections Explorations, Theory and a Framework for Design. PhD Thesis, Eindhoven University of Technology, 2012.
3. B. J. J. van der Vlist, G. Niezen, S. Rapp, J. Hu, and L. M. G. Feijs, "Controlling Smart Home Environments with Semantic Connections: a Tangible and an AR Approach," presented at the 7th International
Workshop on the Design & Semantics of Form & Movement (DeSForM), Wellington, New Zealand, 2012.
4. B. J. J. van der Vlist, J. Hu, G. Niezen, and L. M. G. Feijs, "Semantic Connections: a New Interaction Paradigm for Smart Environments," presented at the 7th International Workshop on the Design & Semantics
of Form & Movement (DeSForM), Wellington, New Zealand, 2012.
5. J. P. A. Peeters, B. J. J. van der Vlist, G. Niezen, J. Hu, and L. M. G. Feijs, "A Study on a Tangible Interaction Approach to Managing Wireless Connections in a Smart Home Environment," presented at the 7th
International Workshop on the Design & Semantics of Form & Movement (DeSForM), Wellington, New Zealand., 2012.
6. J. Hu, B. van der Vlist, G. Niezen, W. Willemsen, D. Willems, and L. Feijs, "Designing the Internet of Things for Learning Environmentally Responsible Behaviour," Interactive Learning Environments, vol.
Accepted., 2012.
7. W. Willemsen, J. Hu, G. Niezen, and B. van der vlist, "Using Game Elements to Motivate Environmentally Responsible Behaviour," presented at the IADIS Game and Entertainment Technologies 2011 (GET
2011), Rome, Italy, 2011.
8. B. van der vlist, G. Niezen, J. Hu, and L. Feijs, "Interaction primitives: Describing interaction capabilities of Smart Objects in ubiquitous computing environments," presented at the AFRICON, 2011, Livingstone
2011.
9. B. van der vlist, G. Niezen, J. Hu, and L. Feijs, "Desiqn semantics of connections in a smart home environment," Creation and Design, vol. 13, pp. 18-24, 2011.
10. G. Niezen, B. van der vlist, J. Hu, and L. M. G. Feijs, "Using semantic transformers to enable interoperability between media devices in a ubiquitous computing environment," presented at the International
Workshop on Self-managing Solutions for Smart Environments (S3E 2011) at the 6th International Conference on Grid and Pervasive Computing (GPC 2011), 2011.
11. M. Kwak, G. Niezen, B. van der vlist, J. Hu, and L. Feijs, "Tangible Interfaces to Digital Connections, Centralized versus Decentralized," Transactions on Edutainment, vol. V, LNCS 6530, pp. 132-146, 2011.
12. J. Hu, B. van der vlist, G. Niezen, W. Willemsen, D. Willems, and L. M. G. Feijs, "Learning from Internet of Things for Improving Environmentally Responsible Behavior," in Edutainment Technologies.
Educational Games and Virtual Reality/Augmented Reality Applications, M. Chang, W.-Y. Hwang, M.-P. Chen, and W. Müller, Eds., ed: Springer Berlin / Heidelberg, 2011, pp. 292-299.
13. B. van der Vlist, G. Niezen, J. Hu, and L. Feijs, "Design Semantics of Connections in a Smart Home Environment," presented at the Design and Semantics of Form and Movement (DeSForM 2010), Lucerne,
Switzerland., 2010.
14. B. van der Vlist, G. Niezen, J. Hu, and L. Feijs, "Semantic Connections: Exploring and Manipulating Connections in Smart Spaces," presented at the 2010 IEEE Symposium on Computers and Communications
(ISCC), Riccione, Italy, 2010.
15. G. Niezen, B. van der vlist, J. Hu, and L. Feijs, "From Events to Goals: Supporting Semantic Interaction in Smart Environments," presented at the 2010 IEEE Symposium on Computers and Communications
(ISCC), Riccione, Italy, 2010.
Smart Objects and Semantic Web: A semantic approach to intelligent environments
© 2012 Jun Hu