Foundation Ontology and Semantic Language for Distributed...

32
Copyright © 2019 Anton Kolonin, Aigents® 1 Foundation Ontology and Semantic Language for Distributed Agents Anton Kolonin [email protected] https://singularitynet.io AIGENTS ® https://aigents.com

Transcript of Foundation Ontology and Semantic Language for Distributed...

Page 1: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 1

Foundation Ontology and Semantic Language

for Distributed AgentsAnton Kolonin

[email protected]

https://singularitynet.io

AIGENTS®

https://aigents.com

Page 2: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 2

Bridging the Symbolic-Subsymbolic gapfor “explainable AI” and “transfer learning”

Hooves Tail White Black Brown

AND AND

AND

OR

Red

Σ Σ Σ

Σ Σ

Σ

(Hooves AND Tail) AND ((White and Black) OR Brown)

=> Horse

0.5

0.5

1.01.0

1.0

0.5

0.5 0.5 0.5

Transfer

Explain 1.0

Page 3: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 3

Foundation Ontologies for Distributed (Multi-Agent) Systems

Agent A Agent B

Thing Has

Drug

Substance

Property Thing HasProperty

BrandHasDrug BrandHas

Has

Ibufen

Ibuprofen

MedanaBrand

Substance

Ibufen MedanaBrand

FoundationOntology

UpperOntology

Page 4: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 4

Data4: 1995 Freebase: 2007Knowledge Graph: 2013

Foundation Ontologies - History

Page 5: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 5

CRMGeneralLedger

Inventory PayrollData4: 1995

Foundation Ontologies - Applications

Shop

Page 6: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 6

Lessons Learned:1. Class is an Object2. Object may be a Class3. Link can be a Node

London, UKMay 12, 2018

John Doe

Address

Mary Ann

Time Interest

John Doe

Consumer

Object

Dr. John Doe

Is

Is

Supplier

Is

IsIs

Mr. John Doe

Is

Page 7: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 7

UFO/ORL: 1997-1999Semantic Modeling of Business Processes

Project: ProPro Group obtains the order from RTS Stock Exchange to develop Back-Office automation system.Requirements: Tremendous amount of initial business rules and forms. Possibility to amend and extend thebusiness rules and forms during the system life cycle.Problem: The RTS analysts are not capable to supply the representative scope of initial business rules andforms timely enough so develoment can start fitting the given time frameDecision: ProPro gives RTS analysts a language to encode the business rules and forms so the rules and formscan be quickly uploaded into the system when done. ProPro develops a system which can upload business rulesand forms, play them in the course of system operation and provide an UI for the amendment and extension ofrules and forms on the fly.Solution: Object-Relational Language (ORL) effectively usable by analysts and software system at the sametime. Universal Financial Object (UFO) three-tier (client, middleware and server) system using ORL forbootstrapping as well as intra-tier communications (instead of DCOM).

Project: ProPro Group obtains the order from RTS Stock Exchange to develop Back-Office automation system.Requirements: Tremendous amount of initial business rules and forms. Possibility to amend and extend thebusiness rules and forms during the system life cycle.Problem: The RTS analysts are not capable to supply the representative scope of initial business rules andforms timely enough so develoment can start fitting the given time frameDecision: ProPro gives RTS analysts a language to encode the business rules and forms so the rules and formscan be quickly uploaded into the system when done. ProPro develops a system which can upload business rulesand forms, play them in the course of system operation and provide an UI for the amendment and extension ofrules and forms on the fly.Solution: Object-Relational Language (ORL) effectively usable by analysts and software system at the sametime. Universal Financial Object (UFO) three-tier (client, middleware and server) system using ORL forbootstrapping as well as intra-tier communications (instead of DCOM).

Page 8: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 8

UFO/ORL: 1997-1999Semantic Modeling of Business Processes

Object

Class

Attribute

Process

Method

Owner

Parent

Is

Has

Domain

This

Is

InstanceOf

InstanceOf

Is

Call

Stack

Foundation Ontology

Page 9: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 9

Lesson Learned:Can have only one,language for DDL, DML,PL, QL instead of many.

SemanticLanguage

SQL-DDL

SQL-DML

SQL-TSV PL-SQL

OWL

RDF

SPARQL

Page 10: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 10

Object Relational Language (ORL)Object Relational Language (ORL)English ORL

Here are the items A, B and C where A hasproperties X and Y while B and C are inrelationship Z.

ITEM A,B,C;;A HAS (X), (Y);;B Z(C);;

In order to reach goal 1 one needs condition 2and 3 to be held true while 2 can be true only ifcondition 4 happens.

CONDITION C2,C3,C4;;GOAL G1 REQUIRES (C2),(C3);;CONDITION(C2) REQUIRES (C4);;

Each morning need to perform this and that inorder, having such and such done at oncenext.

PROCESS TIME “8:00”; REPEAT (DAILY);ORDER DO THIS, DO THAT;, FORK DO SUCH, DO SUCH;;;

What is that my stuff you mentioned yesterdayor the day before?

STUFF(OWNER (ME), UPDATE (AUTHOR(YOU), {TIME “2013-03-22”, TIME “2013-03-21”}).TELL;

What were the relationships between P and Qlast year?

PROPERTY(OWNER (P), THING (Q), TIME“2012”).TELL;

Let me know once they roll out next version ofthe product.

DO EMAIL TO “[email protected]”;; WHENPRODUCT(VENDOR (THEY)).VERSIONCHANGE;;

Semantic Modeling of Business Processes

Page 11: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 11

Distributed Knowledge EditorWebstructor: 2001-2006

Agent A Agent B

Has

FoundationOntology PropertyThing

IsHas IsIsHas

Has

PropertyThing

Is

Has IsIsHas

Applet|Server|DesktopAgent

Applet|Server|DesktopAgent

2D/3DOntology

GraphEditor

2D/3DOntology

GraphEditor

ORLInteractiveConsole

ORLInteractive

Console

Applet|Server|DesktopAgent

Applet|Server|DesktopAgent

2D/3DOntology

GraphEditor

2D/3DOntology

GraphEditor

ORLInteractiveConsole

ORLInteractive

Console

KnowledgeExchange

Page 12: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 12

Visual ontology editor - representing Cyc «micro-theory»Visual ontology editor - representing Cyc «micro-theory»

Fragment of «biological kingdom» of Cyc «upper ontology»

Webstructor: Distributed Knowledge Editor

Page 13: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 13

Visual ontology and predicate logic formula editorVisual ontology and predicate logic formula editor

Expression: «If tuna is a fish, that implies it is not an insect or a bird.»

Webstructor: Distributed Knowledge Editor

Page 14: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 14

Visual 2D/3D editor of logical assertions (e.g. CycL)Visual 2D/3D editor of logical assertions (e.g. CycL)

(implies (isa ?A Animal) (thereExists ?M (and (mother ?A ?M) (isa ?M FemaleAnimal))))=

Mother of an animal is a female animal.

Webstructor: Distributed Knowledge Editor

Page 15: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 15

Lessons Learned:1. 2D graphs are fun but notalways practical 2. 3D graphs are even more fun but even more less practical3. Distributed removal ofknowledge (and its truthassessment) needs account forevidence and social reference

Page 16: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 16

Aigents® Platform for Distributed Personal Agents

Monitoringcontent andsocial dynamicsin onlinenetworksAnton [email protected]

FollowerEvery thingfor every oneAIGENTS.COM

FriendColleague

Leader

Facebook

ВКонтаке

Google+

Golos.ioSteemit

Ethereum

Messenger

SlackTelegram

Page 17: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 17

Social-Evidence based Knowledge Representation Model

Shor

t-te

rm

Long

-ter

m

Non-SocialSocial

Foundation

Imagination

Evidence Inference

Forg

etting

Inf e

renc

e

Har

dwi ri

ng Focu

sing

Top layer - “foundation graph” of basic knowledge, which is necessary forsocial system to be shared by all of its members in order to communicate.Middle layer - “imagination graph” keeping “inferred” knowledge. Bottom layer - “evidence graph” containing everyday life-time experiences.

Page 18: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 18

Using “Semantic Language” for Knowledge Transfer between Software Agents and Human Users

ArtificialAgent

Lisp, AIML/XML, RDF/OWL/XML + SPARQL,

Turtle, JSON-LD

Lojban, Esperanto,

English

“Interlingua”“Controlled language”“Semantic language”

Too complex and unfriendly?

HumanUser

Too complex and ambiguous?

Just right!

Page 19: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 19

Agent Language (AL) for Home Automation and Internet-of-Things (IoT) – multilingual example

A: My is appliance, agent, thermostat, device. A: My has shape, color, voltage. A: My has location. A: My shape rectangular, color white, voltage 220, location kitchen.A: My has temperature, humidity, CO2, feeling. A: Temperature, humidity, CO2 is number. A: Feeling is good or bad.H: What your feeling, temperature, humidity?A: My feeling good, temperature 20, humidity 72.

A: Моя это прибор, агент, термостат, устройство.A: Моя иметь форма, цвет, питание.A: Моя иметь место.A: Моя форма прямоугольный, цвет белый, питание 220, место кухня.A: Моя иметь температура, влажность, CO2, самочувствие. A: Температура, влажность, CO2 это число.A: Самочувствие это хорошо или плохо.H: Как твоя самочувствие, температура, влажность?A: Моя самочувствие хорошо, температура 20, влажность 72.

Page 20: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 20

$nam

e

English name space

Russian name space

Common domain-specific ontology for “controlled interlingua”

$humidity$thermostat_13 $number

число

number

влажность

humidity

это

is

моя

my

иметь

has

Agent Language (AL) as a “Labeled Turtle”

Page 21: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 21

?

thermostat

Interrogation:What is thermostat, location kitchen real temperature, target temperature?

kitchen location

20

25

30

Declaration:Is thermostat, location kitchen real temperature 30, target temperature 25.

Direction:Is thermostat, location kitchen target temperature 20!

Agent Language (AL) as a Graph Manipulation

Page 22: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 22

Agent Language - EBNF<message> := ( <statement> | <acknowledgement> )*<acknowledgement> := ( 'ok' | ('true' | 'yes' | <number>) | ('no' | 'false' | 0) ) '.' <statement> := <interrogation> | <confirmation> | <declaration> | <direction><interrogation> := 'what' ? <expression> '?' (* “open” incomplete graph *)<confirmation> := 'if' ? <expression-set> '?' (* “closed” complete graph *)<declaration> := ( <expression-set> ) '.' (* “closed” complete graph *)<direction> := 'do' ? <expression-set> '!' (* “closed” complete graph *)<expression> := <term> (' ' <term>)* (* separated by spaces *)<expression-set> := <all-set> | <any-set> | <seq-set> (* different kinds of sets *)<term> := <negation>? ( <anonymous>? | <self> | <peer> | <id> | <name> | <value> | <qualifier> )<qualifier> := <expression> | <expression-set><any-set> := <or-list> | ( '{' <or-list> '}' )<all-set> := <and-list> | ( '(' <and-list> ')' )<seq-set> := <next-list> | ( '[' <next-list> ']' )<or-list> := <expression> ( (',' | 'or' ) <expression> )*<and-list> := <expression> ( (',' | 'and' ) <expression> )*<then-list> := <expression> ( (',' | 'next' ) <expression> )*<negation> := 'not' | 'no' | '~'<anonymous> := ('there' ('is'|'are')) | 'any' | 'anything' ?<self> := 'my'|'i'|'we'|'our' <peer> := 'your'|'you'<value> := <number> | <date> | <time> | <string>

That is all!There rest is done bymeans of domain-specific ontology andproviding national-specific name space

Page 23: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 23

Agent Language - comparisons

EnglishWhat is your feeling? If your feeling is good?Your feeling is good.Have your feeling good!

Agent Language - writtenI (can (eat, sleep), want (dance, sing)). I {can (eat, sleep), want (dance, sing)}. I (can {eat, sleep}, want {dance, sing}). You [eat (rice, meat), drink {tea, beer}]!

Agent LanguageA C (D,E). A (C D, F G). A (C (D,E), F (G,H)). (A,B) C D. (A,B) (C (D,E), F (G,H)).

TurtleA C D,E.A C D; F G.A C D,E; F G,H.

Term logicA C D. A C E. A C D. A F G. A C D. A C E. A F G. A F H. A C D. B C D.A C D. A C E. B C D. B C E. A F G. A F H. B F G. B F H.

Agent Language - spokenI can eat and sleep and want dance and sing.I can eat and sleep or want dance and sing.I can eat or sleep and want dance or sing.You eat rice and meat next drink tea or beer!

Agent LanguageYour feeling?Your feeling good?Your feeling good.Your feeling good!

Russian (with tonal modulation)Твое ощущение? (rising tone)Твое ощущение хорошее? (rising tone)Твое ощущение хорошее. (neutral tone)Твое ощущение хорошее! (lowering tone)

Page 24: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 24

TimesThings

User

Time

TopicsOrigins

Thing(Entity)

Things Users Shares Likes

Site

Things Users Shares Likes

Things Users Shares Likes

Patterns(Templates)

Pattern

Patterns(Templates)

FollowersSharers

Linguistic/Symbolic Graph – language-boundnetwork of hierarchicaltokens/symbols linked to sitesand things (type-symbol-symbol,type-uri-symbol, type-object-sybbol)

Temporal Graph –time-to-object experiences (type-object-time):-timestamps-beginnings-endings

Social Graph – person-to-person trust/confidencerelationships (type-subject-subject):- Followers/Takes- Sharers/Gives

Personal Graph - person-toobject relationships map(type-subject-object):- Topics (in Things)- Shares- Likes

Objective Graph ofinterconnectedclasses, objects,attributes and values- Properties (type-object-object)

TimesThings

Web Graph – linked webpages and things on them(type-uri-uri, type-uri-object):- References- Subdomains- Snapshots- Sources

Patterns(Templates)

ReferencesSubdomainsSnapshots

Properties(Relationships)

- owners/properties- classes/instances- parents/children

Language

Timetime- Subinterval- Equivalence

TimesThings

Aigents® Upper Ontology for Online Media Monitoring & Studies

Page 25: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 25

Me Friend

Topic

Post Word, phrase

Like, Vote, Comment

Like, Vote, Comm

ent

Comment Use

Follow, Unfollow, Pay, Comment

My interestsInterests o

f friends

Similar to meBest friends

Fans; Like and comment me Authorities; Liked by me

My karm

a

by periods

My

lingu

istic

&ps

ycho

mod

el

My attention

1Calendarperiod

Aigents® Personal Social Analytics Domain Model

FacebookVKontakte

Google+Golos.io

SteemitEthereum

Messenger

Slack

Telegram

Page 26: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 26

Case 1: Collaborative News Filtering: Monitoring web pages and extracting textual

information with account toPersonal and Social relevances

Me

Friends

Page 27: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 27

Case 2: Helping users to understand themselves better and perform more efficiently online – using their tracks in socialnetworks and online resources, capture their interests,relationships, communication patterns and social structures.

Social type:follower

Social type:opinion leader

Social type:peer

Social type:connector

Page 28: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 28

Case 3:

Page 29: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 29

Friend

AigentsAigents®®: Graph Builder and Filter: Graph Builder and Filter

Bob♂

Friend

Alice♀

Ann♀

Jane♀

Cate♀

Jim♂

Ian♂

FriendFriend

Colleague

Colleague

Colleague

Colleague

Designer

Programmer

Colleague

Colleague

Profession

Profession

Prof

essio

n

Prof

essio

n

Profes

sion

Filtering optionsSeed: Alice, BobLink Type: ColleagueLink Property: Strength=HighNode Type/Property:♀Other Links: Profession=DesignerLink Range: 1

Page 30: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 30

AigentsAigents®®: Ethereum cash flow graph study : Ethereum cash flow graph study

Page 31: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 31

AigentsAigents®®: Steemit social network graph study : Steemit social network graph study

Page 32: Foundation Ontology and Semantic Language for Distributed ...nbmz.ru/wp-content/uploads/2019/06/А.Колонин-1-1.pdf · Project: ProPro Group obtains the order from RTS Stock

Copyright © 2019 Anton Kolonin, Aigents® 32

Anton [email protected]

Thank you for attention!Questions?

Contacts:Phone: +7-913-925-0058E-mail: [email protected]: https://aigents.comFacebook: https://www.facebook.com/aigentsYoutube: https://www.youtube.com/aigentsMedium: https://medium.com/@aigentsSteemit: https://steemit.com/@aigentsFacebook Messenger: Aigents Telegram Messenger: @AigentsBot

AIGENTS®