SmartNews: Semantic Searching of News Video Stephen Lynn Brigham Young University CS 652.

SmartNews: Semantic Searching of News Video


Stephen LynnBrigham Young UniversityCS 652


Background Over 2000 News Stations in US 10 Broadcasts a Day About 15 Stories per Broadcast 150 Stories per day per Broadcaster

Many redundant

Over 300,000 Stories a DayEven more redundancy


Interactive News User in Control Only Watch Stories of Interest Dig in to Stories

Problem: How do I find background stories related to some current event?


SmartNews Semantically Enriched Search Interface

Extraction Ontology

Retrieve Past News StoriesRDF Repository

Sensitive to Inter-story Relationships Simple Search Mechanism


ExampleU.S. President Barack Obama visited Iraq Monday in

a stop that was overshadowed by the question of when U.S. troops should go home. Obama made his opposition to the U.S.-led invasion of Iraq five

years ago a centerpiece of his campaign and was in Baghdad to assess security in Iraq, where violence

has fallen to its lowest level since early 2004.

When has Barack Obama visited Iraq?

Which U.S. President’s have visited Iraq?


Adding News Stories Packages

Video/AudioRelated Video SegmentsClosed Captioning Text

Ontology RefinementEnter Objects of InterestGrowing Lexicons


Data Frames and Relationship Sets

“President Barack Obama visited Iraq”

<Person>\w+(visited|born in|lives in)\w+<Country>


Extraction Ontology


RDF Repository<rdf:RDF xmlns:sn="http://dithers.cs.byu.edu/owl/ontologies/SmartNews#">

<ann:CachedResource rdf:ID="Video_1"> <ann:ResourceID>NewsStory1</ann:ResourceID> <ann:CachedURI>http://path.to.news.story/story1.wmv</ann:CachedURI></ann:CachedResource>

<rdf:Thing rdf:ID="Person_1"/><rdf:Thing rdf:ID="Country_1"/>

<rdf:Description rdf:about="#Person_1"> <sn:Person-visited-Country rdf:resource="#Country_1"/> <sn:PersonValue>Barack Obama</sn:PersonValue> <ann:hasComponent rdf:resource="#PersonComponent_1"/></rdf:Description>

<rdf:Description rdf:about="#Country_1"> <sn:CountryValue>Iraq</sn:CountryValue> <ann:hasComponent rdf:resource="#CountryComponent_1"/></rdf:Description>

</rdf:RDF>


Querying Seed with Story of Interest Populated Search Form SPARQL

SELECT *WHERE { ?Resource sn:Person ?Person; sn:Country ?Country. ?Person sn:Person-visited-Country ?Country. FILTER regex(?Person, “Barack Obama”), regex(?Country, “Iraq”)}


Evaluation Query Story Repository 10 “Seed” Stories Quantitative

Expert Provide List of “Related Stories”Compare Results

QualitativePresent Results to Non-expert UsersRate How well Story Relates to “Seed” Story


QUESTIONS?

SmartNews: Semantic Searching of News Video Stephen Lynn Brigham Young University CS 652.

Documents

Transcript of SmartNews: Semantic Searching of News Video Stephen Lynn Brigham Young University CS 652.