7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
1/76
[email protected] semantic desktop 11.12.2008
In this galaxy,today
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
2/76
The Semantic DesktopA new Hope for
Personal Information
Management
Leo Sauermann
http://www.dfki.de/~sauermann/
mailto:[email protected]://www.dfki.de/~sauermann/http://www.dfki.de/~sauermann/mailto:[email protected]7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
3/76
[email protected] semantic desktop 31.12.2008
Leo Sauermann
Researcher on Semantic Desktop since 2002
At DFKI since 2004
Currently at the Nepomuk EU project
Scientist: workshops, lectures, students, and diploma theses
Open Source: developer, blogger, SWEO member at
W3C.org, aperture.sf.net, Eclipse SMILA
Training: workshops, consulting, keynotes
http://www.dfki.de/~sauermann/
mailto:[email protected]://www.dfki.de/~sauermann/http://www.dfki.de/~sauermann/mailto:[email protected]7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
4/76
[email protected] semantic desktop 41.12.2008
Why do we need a
Semantic Desktop
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
5/76
[email protected] semantic desktop 61.12.2008
Writing: 3200 BC (Sumerian cuneiform)
History slides by Prof. Stefan Decker, DERI.IE
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
6/76
[email protected] semantic desktop 71.12.2008
Printing Press (Gutenberg 1450)
History slides by Prof. Stefan Decker, DERI.IE
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
7/76 [email protected] semantic desktop 81.12.2008
World Wide Web - Tim Berners-Lee 1989
History slides by Prof. Stefan Decker, DERI.IE
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
8/76
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
9/76 [email protected] semantic desktop 101.12.2008
How did Artificial Intelligence evolve?
a short history on artificial intelligence
by Jean Rohmer
1967- 1980: Soft Engineering (Compilers, OS,
databases, VLSI)
1980 - 1993: Artificial Intelligence Research,
Products, Services
1993 2005: IDELIANCE Semantic Networks(personal and collective)
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
10/76 [email protected] semantic desktop 111.12.2008
WHY AI SUCCEEDED IN THE 80 s / early 90s
The situation was stable ( and boring)
in Computer Science: OS, Databases, C, C++
Hardware and systems were valuable professional and industrial assets
which had to be profitable through ambitious applications
Hardware was slow and expensive
IT WAS TIME TO DO MORE EXCITING THINGS
THAN SOFTWARE ENGINEERING
WITH COMPUTERS
Japanese Fifth Generation Computing Program was key
Examples: SACHEM, RAMSES, METAPEDIA multi M in the80s
Jean Rohmer, Thales SA
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
11/76 [email protected] semantic desktop 121.12.2008
WHY AI vanished in the early 90 S
Hardware was slow and expensive (bis)
AI was an expensive way to save money
AI kept fighting and losingagainst Software Engineering
Economical crisis
AI NEEDED HUMAN EFFORT, DISCIPLINE, CONTINUITY AND
INTELLIGENCE
RESEARCHERS NOT INTERESTED IN EVERYDAY LIFE APPLICATIONS
Natural Language / Voice Processing did not deliver
AI applications did not look different for the user !
Jean Rohmer, Thales SA
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
12/76 [email protected] semantic desktop 131.12.2008
Where is the Link between AI and Web?
Oct 1980: Tim Berners-Lee Enquire
ENQUIRE is a method of documenting a system. It
concentrates on the way the system is composed of parts,
and how these parts are interrelated.
This information about a system is difficult to store, and
particularly to update, using paper documents, so
ENQUIRE stores its information on a computer. The
ENQUIRE-WITHIN program allows a person to create and
edit the data, so that others can later extract it as it is
relevant to them.
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
13/76 [email protected] semantic desktop 141.12.2008
Today: three tracks come together
Written Language
and Replication
at ESTCLeo Sauermannpresents Semantic Desktop
Language and Philosophy
Artificial Intelligence
PersonalInformation
Management
Semantic Desktop
computable facts
Language
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
14/76 [email protected] semantic desktop 151.12.2008
In this galaxy,today
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
15/76 [email protected] semantic desktop 161.12.2008
Where does all this text come from?
from People
using mostly desktop computers
to enter information relevant to them
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
16/76
[email protected] semantic desktop 171.12.2008
Knowledge Workplace
Workstation
Archives
News
Services
Data Bases
contacts
partners
products
services
projects
colleagues
role
position
nterests
goals
heterogenous data sources
& complex knowledge work
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
17/76
[email protected] semantic desktop 181.12.2008
But information is chaotic
Thousands of files,
in hundreds of folders,in many applications and formats
Hard-disk space cheap as air,
no one will delete these files
the CIDproject
Documents
Papers
Projects
CID
Research
files emails
Inbox
Todo
SAP
CID-proj
Karlsruhe
contacts
Claudia Stern
Dirk Hageman
Klaus Nord
No desktop
standard torepresent ideas andalign to files
Th h b th b d
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
18/76
[email protected] semantic desktop 191.12.2008
The human user bears the burdento hold everything together
E-MailsTime Schedule
Meeting Presentations Travel Websites
Organising a meeting involved
documents, contacts, time-schedule, organize Meeting
in Belfast
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
19/76
[email protected] semantic desktop 201.12.2008
The approach:
Enhance available information
by formal semantic annotation
to build explicit
personal information models
and facilitate automated services
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
20/76
[email protected] semantic desktop 211.12.2008
Personal Information Model PIMO
represents personal mentalmodel
formal: classes, concepts,relations in RDFS documents, e-mails,
websitesare tagged with concepts
extensible with organizational knowledge ontologies extracted data
unifying model for solvingour problems
PIMO - a Framework for Representing Personal Information ModelsSauermann, van Elst, Dengel (2007)
http://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdf
The CID
Project
Documents
Papers
Projects
CID
Research
Files E-Mails
Inbox
Todo
SAP
CID-proj
Karlsruhe
Contacts
Claudia Stern
Dirk Hagemann
Klaus Nord
CID
Topic
Claudia
Project
Person
Karlsruhe
Management
LocationDirk
CID slides
Document
Ontologies
Data
Person
is a AnnotationRelation
http://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdfhttp://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdfhttp://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdfhttp://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdf7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
21/76
[email protected] semantic desktop 221.12.2008
PIMO Thingsmerge multiple KM systems
Taxonomy
hierarchy
terms
alternative terms
Company
Private
Projects
CID
Research
Topics
Classes and Instances
types
properties of types
CID
Project
CID slides
Document
Ontologies
relations
rules
CIDClaudia
Karlsruhe
Management
Dirk
CID slides
Tagging
flat structure
2008
CIDContract
Wikis
description and hyperlinks
CIDis a Project.Dirk and Claudia work on it.
PIMO
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
22/76
[email protected] semantic desktop 231.12.2008
Example: PIMO about ESTC 2008
outlook://contact/0019E1773D6A56
occurrsin contact
http://www.palais-niederoesterreich.at/
has-location
http://www.dfki.uni-kl.de/~sauermann/
http://www.kth.se/Claudia
http://www.sti2.org/index.php/team2/27-about-usstaff/104-alexander-wahler
organized byhttp://www.estc2008.com/ESTC 2008
Leo SauermannAlexander Wahler
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
23/76
[email protected] semantic desktop 241.12.2008
Personal Information Management PIM
Personal Information PI different interpretations possible: owned, accessed, controlled by the Person directed at a Person
about a Person, but kept by someone else
relevant for Person Personal Space of Information PSI all information elements
within the definition ofPI
tools to interact with the information,Personal Knowledge Workspace
borders unknown, fuzzy,overlaps with others PSI
Background Information about PIM
Book: Personal Information ManagementWilliam Jones and Jaime Teevan (2007)
Book: Keeping Found Things FoundWilliam Jones (2008)
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
24/76
[email protected] semantic desktop 251.12.2008
Background Information about PIM
PIM activities by Knowledge Workers filing information for retrieval and storage
(re) finding information
organizing information and meta-level activities
Personal Information Collection PIC a list (category) of items, used to support activities
Typical behaviours observed in field studies character of workers differ: pilers VS filers walking the same beaten paths to known information
orienteering: looking where you are to know the next step,knowing how you get there
fulltext search as last resort No education for workers provided!
Finding and Reminding: File Organization from the DesktopDeborah Barreau and Bonnie A Nardi (1995)
The perfect search engine is not enough: a study of orienteering behavior in directed searchTeevan, Alvarado, Ackerman, Karger (2004)
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
25/76
[email protected] semantic desktop 261.12.2008
Personal Information Model
represents Personal Information Models of
individuals.
consists of RDF Vocabulary
class:PIMO class:Thing identifiers relations information fusion
Upper Ontology
basic concepts inPIM
Person, Location,Event, Organization,Topic, Document,Time
The knowledge workers
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
26/76
[email protected] semantic desktop 271.12.2008
The knowledge workers
world-view on information
Mental Model
Documents
Papers
Projects
CID
Research
Files
PersonalInformationModel
Personal Spaceof Information
file://C:/home/claudia_stern/documents/projects/CID/ProjectDescription6.doc
< >
DirkThe CIDProject
claudia:CID
claudia:Dirk
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
27/76
[email protected] semantic desktop 281.12.2008
RDF on theSemantic Desktop
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
28/76
[email protected] semantic desktop 291.12.2008
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
29/76
[email protected] semantic desktop 301.12.2008
@prefix nco: .
@prefix nie: .
a nie:InformationElement, nco:Contact;
nie:title "Claudia Stern";nco:fullname "Claudia Stern";
nco:nameFamily "Stern";
nco:nameGiven "Claudia";
nco:hasEmailAddress ;
nco:hasPostalAddress
;
nie:dataSource
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
30/76
[email protected] semantic desktop 311.12.2008
@prefix nco: .
@prefix nie: .
a nie:InformationElement, nco:Contact;
nie:title "Claudia Stern";nco:fullname "Claudia Stern";
nco:nameFamily "Stern";
nco:nameGiven "Claudia";
nco:hasEmailAddress ;
nco:hasPostalAddress
;
nie:dataSource
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
31/76
[email protected] semantic desktop 321.12.2008
@prefix nco: .
@prefix nie: .
a nie:InformationElement, nco:Contact;
nie:title "Claudia Stern";nco:fullname "Claudia Stern";
nco:nameFamily "Stern";
nco:nameGiven "Claudia";
nco:hasEmailAddress .
a nco:EmailAddress ;nco:emailAddress "[email protected]" .
Statements nie:title to be able to show
anything in a GUI (= the label)
nameFamily, nameGiven
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
32/76
[email protected] semantic desktop 331.12.2008
Aligning a Thing to Information Elements
Claudiaclaudia:Claudia a pimo:Person.
Contact
fullname Claudia Stern
groundingOccurrence
TextDocument
title The CIDProjectcreator
fullname Claudia Stern
occurrence of Claudia
PIMO
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
33/76
[email protected] semantic desktop 341.12.2008
Hands-on: Annotating a filePIMO
Section 11.7
a nie:TextDocument;nie:title "Belfast Bus Timetable".
claudia:BelfastBusTimetable
a pimo:Document;nao:personalIdentifier "Belfast Bus Timetable";
pimo:isDefinedBy claudia:PIMO;pimo:groundingOccurrence
;
pimo:groundingOccurrence
claudia:Belfasta pimo:City;
nao:personalIdentifier "Belfast";pimo:isDefinedBy claudia:PIMO.
pimo:hasTopic
pimo:hasTopic claudia:Belfast.
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
34/76
[email protected] semantic desktop 351.12.2008
Ontologiesaround PIMO
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
35/76
All Concepts a Userof the Semantic Desktop deals with
All Concepts anApplication Programmerof the Semantic Desktop deals wit
RDF
RDFS
NRL
NAO
NIE PIMO
Foundational
Group-level
Personal-Level
Upper-Level Layer
Lower-Level Layer
Representational Layer
NEPOMUK Ontologies
Knowledge Worker
Individual
activities in PSIworkflows: filing finding
thinking
Ontologies are the formal basis for
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
36/76
[email protected] semantic desktop 371.12.2008
Ontologies are the formal basis forshared understanding
Between humans:
Several users explicate their specific views and
interpretations by annotating information
elements
Relying on ontologies ensures consistent use of
concepts
For machines:
Formal annotations allow the invocation of
computer services
Ontologies serve as reference for the developer
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
37/76
[email protected] semantic desktop 381.12.2008
NEPOMUK Ontologies
Representation Language (NRL) built on top of RDF/S
RDF triple, Named Graph and Graph Views
Graph Roles Vocabulary
Annotation Ontology (NAO) Tagging, semantic annotation,
nao:hasTag, nao:hasTopic, nao:isRelated, ...
Graph Metadata Vocabulary
Information Elements (NIE) files (Word documents, images, PDFs),
address book, entries, emails, etc.
Personal Information Model(PIMO)
available free at
www.semanticesktop.org/ontologies
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
38/76
[email protected] semantic desktop 391.12.2008
NEPOMUK Information Elements NIE
existing data
needed for
knowledge work
domain independent
Information Elements
ttp://www.flickr.com/photos/uniqueo/2667162885/
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
39/76
[email protected] semantic desktop 401.12.2008
NEPOMUK Information Elements NIE
NIE identifies both the NIE ontology and
the NIE framework of ontologies
builds on NRL NepomukRepresentational Language (= RDFS +
extensions) Representing existing information, not
replacing existing file formats
Integration and reuse amongst ontologiesin the framework
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
40/76
[email protected] semantic desktop 411.12.2008
DataObjects representphysical entitiesthat contain data.
files, mailboxes etc.
Bitstreams which need
to be interpreted asInformationElement.
InformationElement is a
piece of informationstored within a dataobject.
Two Parts
O l i b if d
http://www.semanticdesktop.org/ontologies/nie/http://www.semanticdesktop.org/ontologies/nie/http://www.semanticdesktop.org/ontologies/nie/http://www.semanticdesktop.org/ontologies/nie/7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
41/76
[email protected] semantic desktop 421.12.2008
Ontologies get better if used
NIE is used by Aperture, Beagle++
(+10000 downloads) PIMO is used by
Thai, V.; Handschuh, S. & Decker, S.
IVEA: An Information Visualization Tool for Personalized
Exploratory Document Collection Analysis, ESWC2008
Fernandez-Garcia, N.; Sauermann, L.; Sanchez, L. &
Bernardi, A.
PIMO Population and Semantic Annotation for the
Gnowsis Semantic Desktop, 2006 ISWC WS Woerndl, W. & Woehrl, M.
SeMoDesk: Towards a Mobile Semantic Desktop
CHI 2008 WS
Data-flow between NEPOMUK services:
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
42/76
[email protected] semantic desktop 431.12.2008
Data flow between NEPOMUK services:from data to PIMO
DataPersons files and
e-mails
RDF
adaptingto RDF
matchingto PIMO
PIMO
Aperture.sf.net
crawling framework
converts all data to
RDF
Alignment
analyzes files and e-mails
(and more)
matching to existing things
creating new things
User Interfaces
read/write PIMO
Documents
Papers
Projects
CID
Research
Files E-Mails
Inbox
Todo
SAP
CID-proj
Karlsruhe
Contacts
Claudia Stern
Dirk Hagemann
Klaus Nord
T d h k h
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
43/76
[email protected] semantic desktop 441.12.2008
Today: three tracks come together
Written Language
and Replication
at ESTCLeo Sauermannpresents Semantic Desktop
Language and Philosophy
Artificial Intelligence
Personal
Information
Management
Semantic Desktop
computable facts
Language
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
44/76
[email protected] semantic desktop 451.12.2008
www.flickr.com/photos/wonderferret/1447024668
How did the Semantic Desktop
change knowledge work?
R lt C t li k d t ti ll
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
45/76
[email protected] semantic desktop 461.12.2008
Leo
Leo with
Mobile_phone,
Laptopnear
Enschede,
Netherlands.
Result: Concepts are linked automatically
Leo Sauermanndesktop://outlook/contact/ECD4B993
a Person
Enschedehttp://www.dbpedia.org/resource/Enschede
a City
Services on the personal desktop support
http://www.kwark.org/x/person.pl?q=eaa363e2b75a11db14e62afb8995340a198e8b9e;name=Leohttp://www.kwark.org/x/person.pl?q=http://xmlns.com/wordnet/1.6/Mobile_phonehttp://www.kwark.org/x/person.pl?q=http://xmlns.com/wordnet/1.6/Laptophttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://www.dbpedia.org/resource/Enschedehttp://www.dbpedia.org/resource/Enschedehttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://www.kwark.org/x/person.pl?q=http://xmlns.com/wordnet/1.6/Laptophttp://www.kwark.org/x/person.pl?q=http://xmlns.com/wordnet/1.6/Mobile_phonehttp://www.kwark.org/x/person.pl?q=eaa363e2b75a11db14e62afb8995340a198e8b9e;name=Leo7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
46/76
[email protected] semantic desktop 471.12.2008
Services on the personal desktop supportpersonal semantic information management
Connect, structure, retrieve
information
Personal RDF store as universal
fact repository
Personal Task Management makes
context explicit
Personal Information Model (PIMO)
explicates concepts used within the
personal information space
Result: Your personal information
space at a glance!
Search
Current Task
Information relevant
in this context
semantic relations / links
categories
persons
projects
Tasks, data,
concepts
Mi i i Sid b
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
47/76
[email protected] semantic desktop 481.12.2008
Miniquire Sidebar
Search
PIMO Ontology
viewer and editor
Filtering
keeping orientation
PIMO Edit
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
48/76
[email protected] semantic desktop 491.12.2008
PIMO Editor
wiki name = short
unique name for
things
semantic wiki text
Text-Attributes:
key/value pairs for
datatype attributes
Relations
to other things
Link to filesystem,
email, outlook
entry,
anything
integrated throughAperture.sf.net
L i f th b h i
PIM Basic
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
49/76
[email protected] semantic desktop 501.12.2008
Learning from the users behavior
Plugins gather user actions
Elicitation of task concepts
Notification of GUI
Applications
shows documents, people, projects,
topics relevant to current work
search documents via context:
I saw it after working with Dirk pro-active non-obtrusive assistance
Bayesian Network
UA UA
Domain
Wf Task
NOP NOP NOP NOP
Wf Task
TaCo
Domain
UA
NOP
PIMMaus
PIM MidDFKI KM
PIM Upper
A Context Model for Personal Knowledge Management ApplicationsSven Schwarz (2006)
Application plugins, mini-applications,
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
50/76
[email protected] semantic desktop 511.12.2008
Application plugins, mini applications,mashups
tagging e-mails drop-box
Idea: Let people use their existing applications
to get their knowledge work done
Application: Drop Box
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
51/76
[email protected] semantic desktop 521.12.2008
Application: Drop Box
Helps filing information
uses PIMO structuresconcepts and folders
Knows the users model and istrained by using it
process flow files are stored into a Drop-Box folder
files are text-analysed and possibletarget folders are suggested
Drop-Box user interface shows
user selects a folder, classify
files are moved and classified
Learns from the user
doc:
EPOS
Project:Epos
EPOS, DFKI,
Maus,
PIMO of Paul
=
Sauermann, L.; Grimnes, G.A.; Kiesel, M.; Fluit, C.; Maus, H.; Heim, D.;
Nadeem, D.; Horak, B. & Dengel, A.
Semantic Desktop 2.0: The Gnowsis Experience
ISWC 2006
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
52/76
[email protected] semantic desktop 531.12.2008
search
Siebert, M.; Smits, P.; Sauermann, L. & Dengel, A.Increasing Search Quality with the Semantic Desktop
in Proposal Development
PAKM 2006
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
53/76
[email protected] semantic desktop 541.12.2008
Human Access
Search for Information: documents and facts
Enable Free-text queries
to keep knowledge overhead away from the user
NLP problems, e.g. syntactic, structural ambiguity
form the search engines point of view
phone number of the KM-Group secretaryseminar topics
+49 631 205 75 101
Schuhmacher, K.; Sintek, M. & Sauermann, L.Combining Metadata and Document Search with Spreading Activation for Semantic Desktop Search
ESWC 2008
Fact Retrieval Example
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
54/76
[email protected] semantic desktop 551.12.2008
Fact Retrieval Example
Property Class Instance
(no result)(no result)
0049 631 205 75 101
[1] [2]
[3]
[4]
instances:
,
phone number of the KM-Group secretary
[5]
get instances
Schuhmacher, K.; Sintek, M. & Sauermann, L.Combining Metadata and Document Search with Spreading Activation for Semantic Desktop Search
ESWC 2008
Personal Semantic Wiki for note taking
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
55/76
[email protected] semantic desktop 561.12.2008
NepomukNepomuk is an EU project .
Its topic is the
Social Semantic Desktop .
DFKI coordinates .
Personal Semantic Wiki for note-taking
Terms
Types
Relation types
Relations
RDF
We can use a personal semantic wikieverywhere: comments, notes, documents,
websites, blogs, e-mails, Sauermann, L.
The Gnowsis Using Semantic Web Technologies to build a Semantic Desktop
Diploma Thesis, Technical University of Vienna, 2003
Semantic Wiki User Interface
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
56/76
[email protected] semantic desktop 571.12.2008
Semantic Wiki User Interface
Kaukoluwiki
open source
Assistance systemAutomatic annotation
Malte Kiesel, Kaukolu: Hub of the Semantic Corporate Intranethttp://www.dfki.uni-kl.de/~kiesel/2006-06-12-Kaukolu-SemWikiESWC2006.pdf
http://kaukoluwiki.opendfki.de/
Express thoughts using free text
Evaluations of these applications showed
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
57/76
[email protected] semantic desktop 581.12.2008
Evaluations of these applications showed
We evaluated the approach in a two month case
study in 2006 with eight participants, and 2 year-useuntil 2008
Result
For Personal Information Management, classes andtyped properties are not needed for browsing
I dont model the world, only what is important
Drop-Box enabled multi-tag annotations
A little semantics goes a long way
Sauermann, L. & Heim, D.Evaluating long-term use of the Gnowsis Semantic Desktop for PIM
ISWC 2008
CID CID slides
Orienteering Behavior
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
58/76
[email protected] semantic desktop 591.12.2008
Orienteering Behavior
Teevan, Alvarado, Ackerman, Karger
users go somewhere, look around, know wherethey are, go on
Teevan, J.; Alvarado, C.; Ackerman, M.S. & Karger, D.R.
The perfect search engine is not enough: a study of orienteering behavior in directed search
CHI2004, pp.415-422
Filtering
keeping orientation
Long-term users stopped
using web-search interface
Besides being shown
differently, hasPart and
isRelated have no
programmatic difference.
For orienteering,
click somewhere to the
right is enough
Interpretation
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
59/76
[email protected] semantic desktop 601.12.2008
Interpretation
A little semantics goes a long way
The Semantic Desktop helps in PIMs typicalactivities:filing, finding, thinking
Limited RDF: No computation, no social exchange Classes were only needed when the pain was too big
Typed relations were not needed: related would beenough for personal orienteering
Personal Semantic Desktop Wiki was used as ageneral knowledge tool
PIM research was confirmed: orienteering
first navigating, then searching
CID CID slides
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
60/76
[email protected] semantic desktop 611.12.2008
www.flickr.com/photos/wonderferret/1447024668
How did the Semantic Desktop
change the world?
Well-established communities
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
61/76
[email protected] semantic desktop 621.12.2008
adopt and support NEPOMUK
KDE 4.0 beta released contains basic NEPOMUK
architecture components
ECLIPSE community
supports OSGI-basedNEPOMUK implementation
PSEW alpha available
Demonstrated at IBM
Lotusphere 07
Open Source development platform available
dev.nepomuk.semanticdesktop.org
Public mailing list: [email protected]
NEPOMUK Architecture
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
62/76
[email protected] semantic desktop 631.12.2008
NEPOMUK Architecture
The KDE Desktop provides NEPOMUK
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
63/76
[email protected] semantic desktop 641.12.2008
The KDE Desktop provides NEPOMUKmodels and annotations as an OS service
manual tagging of files, folders,
emails, etc. Representation of tags within
PIMo
nepomuk.kde.org~1mio potential users
PIMo
Java
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
64/76
[email protected] semantic desktop 651.12.2008
nepomuk.KDE.org1-4 million desktop users
The NEPOMUK project
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
65/76
[email protected] semantic desktop 661.12.2008
The NEPOMUK project
EU integrated project Duration 1.1.2006 31.12.2008
Funding 11.5 M
Overall 17.1 M
Goals Standardization of Social
Semantic Desktop Contribute to European Vision
of a capable knowledge society
Combines and integrates severalareas of research
Contact Website http://nepomuk.semanticdesktop.org E-Mail [email protected]
Coordinator Dr. Ansgar Bernardi
SeMouse
http://nepomuk.semanticdesktop.org/mailto:[email protected]:[email protected]://nepomuk.semanticdesktop.org/7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
66/76
[email protected] semantic desktop 691.12.2008
SeMouse
Annotation of documents using the middle mouse
button Works with Word, Browser, PDF,
Can be integrated with other frameworks (gnowsis)
Sergio F.Anzuola
click!
DBin
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
67/76
[email protected] semantic desktop 701.12.2008
DBin
ein verteilter Semantic Desktop
Suche nach Information
Kollektiv arbeiten
Open IRIS
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
68/76
[email protected] semantic desktop 711.12.2008
Open IRIS
verwandte Daten
Ideliance
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
69/76
[email protected] semantic desktop 721.12.2008
Ideliance
What connects Jerome
Euzenat with Ireland
Multiple Data Entry
Options
Industry Cooperations
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
70/76
[email protected] semantic desktop 741.12.2008
Industry Cooperations
Aperture.sourceforge.net
a Java framework to extractdata and metadata
In production, 6000 downloadsmany users
DFKI and Aduna (Jeroen Wester) Converts your files (MSOffice, PDF,
Multimedia) and more to RDF
Compatible with ADUNA products
also in dynaq.opendfki.de
Industry Cooperations
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
71/76
[email protected] semantic desktop 751.12.2008
Industry Cooperations
www.eclipse.org/smila/
SMILA is an extensible framework forbuilding search solutions to accessunstructured information in theenterprise.
uses Aperture
Empolis (Arvato) Igor Novakovic
Jasmin Franz
Brox August Georg Schmidt
DFKI Leo Sauermann
DFKI Competence Center Semantic Web
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
72/76
[email protected] semantic desktop 761.12.2008
DFKI Competence Center Semantic Web
Communicates between DFKI
Experts and customers
Ontology creation and
maintenance
Support for annotation anddata analysis
Contract research
Consulting, Training, Talks
http://semanticweb.dfki.de
Michael Sintek
Paul Buitelaar
Involved Scientific Community
http://semanticweb.dfki.de/http://semanticweb.dfki.de/7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
73/76
[email protected] semantic desktop 771.12.2008
Involved Scientific Community
Community resources
www.semanticdesktop.org community websitewith wiki and many projects
[email protected] mailinglist
Scientific events ISWC workshop 2005
ISWC workshop 2006
i-Semantics Special Track 2007 ESWC workshop 2007
Nepomuk Summer School 2008
Future
http://www.semanticdesktop.org/mailto:[email protected]:[email protected]://www.semanticdesktop.org/7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
74/76
[email protected] semantic desktop 781.12.2008
Future
follow-up project OrganiK
Personalized Semantic Web for SMEs Planned commercialization of Semantic
Desktop services in 2009 (contact me)
Stefan Decker from DERI,our team from DFKI, and
others are initiating
a standardization foundation at least a million KDE users,
do your own research
Summary - The Semiotic Triangle
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
75/76
[email protected] semantic desktop 791.12.2008
Summary The Semiotic Triangle
NEPOMUK gives tools to express knowledge
in Semantics,beyond stones.
try KDE4.0 Meetingin Belfast
Informationin mind
Artifactsstones + RDF
triggers references
represents
Real World
CID
Meeting
Belfast
d
d
asdf
Semantic Web
7/31/2019 Semantic Desktop - History, Ideas, Details (2008)
76/76
asdf
asfd
sadf
asfd
asdf
sadf
asdf
asdf
asdf
asdfasdf
asdf
asdf
asdf
sda
fd
dfs
dfs
sda
df
da
sfd
asdf
f
fad
dsfsfd
fds
d
sfd
dfs
fds
questions?
Leo Sauermann
[email protected]://www.dfki.de/~sauermann/
Thanks to Jesus, Ingrid Brunner-Sauermann, Heiko Maus, Sven Schwarz, Ansgar Bernardi,Andreas Dengel, Frank Osterfeld, Dominik Heim, Man Luo, Jeen Broekstra, GiovanniTummarello, Michael Zeltner, Stephan Baumann, Gunnar A Grimnes, Ludger Van Elst,Harald Holz, Stefan Decker, Malte Kiesel, timbl and the bunch from #swig
Semantic Webin Application
mailto:[email protected]://www.dfki.de/~sauermann/http://www.dfki.de/~sauermann/mailto:[email protected]Top Related