Jem Rayfield, March, 2017

Smarter Content with Dynamic

Semantic Publishing

Outline

What is Dynamic Semantic Publishing [DSP]Who is using the DSP ApproachHow can I get DSPRecommendationSmart search

What is DSP?

Overview

“DSP uses linked data technology to automate the aggregation, publishing and re-purposing of interrelated content objects according to an ontological domain-modelled information architecture, providing a greatly improved user experience and high levels of user engagement”

Architecture

Unstructured Content

Users + Events

ContentSearch

AnnotationUser Events

Text AnalyticsRecommendationKnowledge Graph

SemanticFingerprint

Structured Reference data

DSP APIs Visualisations

Components

Content Indexing Search Domain Vocabulary Users + Events Text Analytics [TA] RecommendationContent Annotation

ElasticSearch

GraphDB

Content Vocabulary Annotation Graph

Content

Apple

Organisation

SamsungAnnotationtextpos:123,142

relevance:56%mentions

Annotationtextpos:123,142

relevance:68%about

Tim Cook Person

target

target

tag

tag

ceo

type

type

competitor

Annotationtextpos:123,142

relevance:87%about

target

tag

USA

NASDAQ

Computer Hardware

location

exchange

sector

Graph DB

Graph DB

Graph DB

TA: Vocabulary Aware Semantic Disambiguation

GraphDBVocabulary

Vocabulary Gazetteer

Disambiguation

NLP Pipeline

Language Detection

POS

...

...

...

Relevance Ranking

...

Dynamic Vocabulary

Get Suggestions

Annotate Content

Apple : OrganisationTim Cook : Person, CEOTim Cook : Person, FootballerSamsung : Organisation

Apple : OrganisationTim Cook : Person, CEOTim Cook : Person, FootballerSamsung : Organisation

87% - Tim Cook : Person, CEO68% - Apple : Organisation56% - Samsung : Organisation

Apple CEO Tim Cookwas at a conference with the CEO of Samsung. Timexplained how smart phones are changing the consumer electronics market.

Suggestions

Entity Detection from Vocab

Disambiguation

Relevance

http://144.76.25.166:9107/#document?uri=http://www.bostonherald.com/business/business_markets/2017/03/booting_up_for_apple_its_mac_to_the_future

Who is using the DSP Approach?

How can I get DSP?

Deployment

on premise hybrid SaaS

+

LDSR out of the box

Business Domain

Graph and Text Analytics

Life Science Domain

Graph and Text Analytics

Customer/Client specific Domain Graph and Text

Analytics

Out of the Box LDSR Domain

Graph

Future…..

fork

Developer

+ Domain NLP plugin

+ Domain NLP plugin

+ Domain NLP plugin

Recommendation

Objective

Serve relevant content to increase user engagement, reach and improve usability

ComponentsRelevance:

(a) relevance with respect to the user's momentary context

(b) relevance with respect to the user (history)

Freshness:

the recency of the proposed content

Popularity:

(a)popularity among peer users (thus becoming part of a collaborative

filtering scheme)

(b)popularity with respect to other content similar to the PageRank

scheme)

DSP analyses content

AnalyticsAPIContent

Concept Suggestions

curl -X GET --header 'Accept: application/vnd.ontotext.ces+xml'

'http://88.99.91.220:9101/worker/extract?url=http%3A%2F%2Fwww.bbc.co.uk%2Fsport%2F

football%2F39262399&debug=false'

Concept Suggestion

Concept Suggestion

AnalyticsAPI

Concept Suggestions

<ExtractionResults><mentions><mentions><name>assistant manager Ray Wilkins</name><startOffset>6780</startOffset><endOffset>6809</endOffset><type>RelationPersonRole</type><features><roleInst>http://data.ontotext.com/publishing/roles#manager</roleInst>

<personInst>http://ontology.ontotext.com/resource/tsn5dytas6bk</personInst><string>assistant manager Ray Wilkins</string>

</features></mentions><mentions>

DSP annotates content with knowledge

AnnotationAPIContent

ContentSemantic

Fingerprint

DSP Understands content

Content

Knowledge Graph

UK

Apple

Samsung

USA

located in

mentions

about

Tim

Cook

USA

NASDAQ

exchange

headquarters

Tim Cook

Computer Hardware

ceo

industry

about

Content

Content annotation

Content Semantic fingerprint

R(A) = vector of the top N

concepts, weighted with their tf-

idf scores

Contextual Recommendation

Contextual

similarity

Contextual

similarity

NOW Recommendation

API Contextual Recommendation

DSP Understands users

1st PartyUser Data

Knowledge Graph

User

UK

Apple Inc

Samsung

USA

NASDAQlives in

employed by

interested in

Tim Cook

Computer Hardware

located in

headquartered in

exchange

ceo

industry

DSP Captures behaviour

EventAPIEvents User

Event Index

DSP Understands behaviour

User

SocialBehaviour

User

content:view

content:scroll

content:dwell

concept:follow

hashtag:followtweet:view

UserBehaviour

User history (Get User Id)

Behavioral recommendation

Reads

Behavioral

similarity

Behavioral recommendation

Static Users Historical

Fingerprint

Dynamic Transition

Matrix+Popularity

(Collaborative filtering)

Freshness+ +

Behavioral + Contextual Recommendation

Behavioral + Contextual Recommendation

DSP Mines social behaviour

User Behaviour

SocialAPIEvents

UserEvent Index

Social mining

Social feed

Increased Engagement

Content

Knowledge Graph

1st PartyUser Data

Knowledge Graph

+Social

Behaviour

UserBehaviour+ =

Smart Search

Graph Rank Search

Content

Frank Lampard

Frank Lampard

Annotation

Content

Content

Content

Content

tag

targetAnnotation

tag

targetAnnotation

tag

target

Annotation

tag

target

Football Player

role

Annotation

tag

target

Football Player

Graph Rank Search

Frank LampardFootball

Player

Football Player

Frank Lampard

profile

profile

Graph Rank Search

Graph Facet Search

Search Service

Search Service

{"concepts": {"http://ontology.ontotext.com/taxonomy/Person": {"values": [

{"uri": "http://ontology.ontotext.com/resource/tsk9k4aunvgg","type": null,"label": "Frank Lampard","score": 339,"image": null

},

Concept Service{"uri": "http://ontology.ontotext.com/resource/tsk9k4aunvgg",

"preferredLabel": "Frank Lampard",

"shortDescription": "English footballer (born 1978)",

"description": "Frank James Lampard (born 20 June 1978) is an English professional footballer who plays as a central

midfielder…….”,

"thumbnailUrl": "http://commons.wikimedia.org/wiki/Special:FilePath/Frank_Lampard_v_PSG_2014.jpg?width=300",

"pictureUrl": "http://commons.wikimedia.org/wiki/Special:FilePath/Frank_Lampard_v_PSG_2014.jpg",

"types": [

"http://ontology.ontotext.com/taxonomy/Thing",

"http://ontology.ontotext.com/taxonomy/Person",

"http://ontology.ontotext.com/taxonomy/Athlete",

"http://ontology.ontotext.com/taxonomy/Concept",

"http://ontology.ontotext.com/taxonomy/Agent"

],

"exactMatch": [

"http://dbpedia.org/resource/Frank_Lampard",

"http://www.wikidata.org/entity/Q41533"

Concept Extraction RelationPersonQuotation

Concept Extraction RelationPersonQuotation

<startOffset>6206</startOffset><endOffset>6749</endOffset><type>RelationPersonQuotation</type><features>

<personInst>http://ontology.ontotext.com/resource/tsk550fnfym8</personInst><subjects>http://ontology.ontotext.com/resource/tslsht48nsw0</subjects><subjects>http://ontology.ontotext.com/resource/tslsht48nsw0</subjects><quotationStr>

"Lampard says he is very keen on getting into coaching, which is not a path too many English players of his calibre have taken recently when their playing days ended. Part of that is down to them having other options. Punditry is one of them and I am sure he would be very good at it -there would be plenty of people trying to get him to work for them.

"But it would be nice to see someone like Lampard go into the coaching game, with his intelligence and passion and especially because he wants to test himself as a manager."</quotationStr>

</features></mentions>

Content Type Annotations

Content Type Search

Quotation Search API

Experience the power of Dynamic Semantic Publishing

now.ontotext.com

Thank you!