Computational Logic General Game PlayingLecture 4 Michael Genesereth / Nat Love Spring 2006.
dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End...
Transcript of dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End...
![Page 1: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/1.jpg)
DexterA Browser-based Data Explorer for End Users
Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth
Stanford Logic Group
Project Page: http://dexter.stanford.edu
![Page 2: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/2.jpg)
Motivation Which Republican senators have
been fined by the FEC?
Name State …
Barbara Boxer CA …
Ted Cruz TX …
congressMembersAd-hoc analysis
More and more structured data made available in the Web
![Page 3: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/3.jpg)
Ad-hoc Analysis of Data
• Too tedious:
• Limited querying capability of sources
• Spreadsheets don’t offer sufficient functionality
• Inability to query private and public data together without uploading the data
![Page 4: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/4.jpg)
http://dexter.stanford.edu
Browser-basedDomain-independent
Explorer for structured data
Ad-hoc “on-the-fly” queries Queries across multiple sources
Dexter
![Page 5: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/5.jpg)
Data = Tables• Tables
• Other sources of data (are mapped to tables)
• CSV, JSON or XML files
• APIs
• DOM elements in Web pages (e.g. <div>, <table> elements)
X Y1 a2 b
rY Za 3c 5
s
![Page 6: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/6.jpg)
Queries = Dexlog Rules
Dexlog = Datalog + Negation (as failure) + Aggregation + Built-ins
X Y1 a2 b
rY Za 3c 5
s
q(X, Z) :- r(X, Y) & s(Y, Z)
Overview: http://dexter.stanford.edu/main/dexlog.html
Aggregation: Special operator setof() for constructing sets
setof(X, r(X, Y), S) ≡ SY = {X | r(X, Y)}
![Page 7: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/7.jpg)
Which Republican senators have
been fined by the FEC?
Example: Ad-hoc Analysis
• Data about administrative fines: http://www.fec.gov/data/AdminFine.do
• Data about members of Congress: https://www.govtrack.us/api/v2/person [Govtrack API]
![Page 8: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/8.jpg)
![Page 9: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/9.jpg)
![Page 10: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/10.jpg)
![Page 11: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/11.jpg)
![Page 12: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/12.jpg)
• Filter misc.fines to get senators who have been fined • Filter misc.congress to get republican members • Join the two filtered tables on member names
Dexlog query to join the two tables: misc.fines and misc.congress
![Page 13: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/13.jpg)
Demo
![Page 14: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/14.jpg)
Query Evaluationq(X, Z) :- govtrack.s(X, “Republican”) &
fec.t(X, “senator”)
Dexter
Query Decomposition
govtrack
![Page 15: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/15.jpg)
Query Evaluationq(X, Z) :- govtrack.s(X, “Republican”) &
fec.t(X, “senator”)
Dexter
fec.t(X, “senator”)
govtrack.s(X, “Republican”)
Source Invocation
govtrack
![Page 16: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/16.jpg)
Query Evaluationq(X, Z) :- govtrack.s(X, “Republican”) &
fec.t(X, “senator”)
Dexter
fec.t(X, “senator”)tuples
govtrack.s(X, “Republican”)tuples⋈
Answer Construction
govtrack
![Page 17: dexterdexter.stanford.edu/dexter.pdf · 2014-11-19 · Dexter A Browser-based Data Explorer for End Users Sudhir Agarwal, Abhijeet Mohapatra, and Michael Genesereth Stanford Logic](https://reader034.fdocuments.us/reader034/viewer/2022042321/5f0ad6ab7e708231d42d970a/html5/thumbnails/17.jpg)
• Browser for supporting ad-hoc queries over structured data
• Create tables (from files, Web pages, DBs, APIs), edit tables, check integrity constraints, query tables using Dexlog rules, visualize tables as charts, share and export tables and rules
• Resources:
• Dexter: Plugging-n-Playing with Data Sources in Your Browser [AAAI ’14 workshop on Semantic Cities]
• Project page: http://dexter.stanford.edu
• Primer: http://dexter.stanford.edu/primer.pdf
• Dexlog Overview: http://dexter.stanford.edu/main/dexlog.html
Dexter