Mantas Zimnickas
atviriduomenys.lt
OpenCon 2016 Lithuania
What is open?
“Open means anyone can freely access, use, modify, and share for any purpose.”
– opendefinition.org
What is open data?
5stardata.info
Open data status in Lithuania
http://ivpk.lrv.lt/lt/ivpk-leidiniai/atliktas-galimybiu-tyrimas-skirtas-apibrezti-atviru-duomenu-iniciatyvos-igyvendinimo-lietuvoje-architekturos-modeli
What atviriduomenys.lt is about?
Dataproviders Data Projects
provides are used by
needsimportance
Users
likes
are used by
atviriduomenys.lt
Data packages
CSV/JSON RDF/DCAT
'2016-11-12' "2016-11-12"^^xsd:date
Datapackage
date(2016, 11, 12)
frictionlessdata.io/data-packages/
HTML data to download first page
extract links
download all links
extract data
transform data
with index.download('http://opendata.gov.lt/'):
with urls.select('table td[3] a@href'):
with pages.download():
with raw_data.select(row.key, [ 'table xpath:tr[count(td)=2]', ('td[1]:content', 'td[2]:content'), ]):
data.call( lambda x: (x.key, dict(x.value)) )
data.export('opendatgovlt.csv')export data
atviriduomenys.lt/data
Data to
Rawvalues
UniformResourceIdentifier
LRS
ld:orgs/gov/42
Canonicalobject
registry
LietuvosRespublikos
SeimasSeimas
LR Seimas
Aliases andtemplates
Lietuvos Respublikos {name} LR{name|abbr} {name} LR {name}
https://github.com/sirex/databot-bots/tree/master/index
Technology moves forwardpeople don’t
225 yearslater
A4 paper data format
Writes onA4 paper
ReadsA4 paper
In a perfect world...
Createsontologies
Createstemplates
Fills intemplateswith data
HTMLrepresentation
Printingon paper
Smartphoneapp
Single source
publishing
WYSIW
YM
Context
Real world examples
AbbyeFormFiller
Akoma Ntoso(LegalDocML)
LegisProBy Xcential
Word processortemplates with
fields
Text data to
Textstream
Patternrecognition
engineTemplates Data
Field: value N-gram magic Field: {value} {'Field': 'value'}
automatization
Text data to
Textsamples
Training Data
big trees machine learning forest
NLP
a tree
Manuscript to
epaveldas.lt
Thank you!
● https://github.com/sirex/atviriduomenys.lt● https://github.com/sirex/databot/● https://github.com/sirex/databot-bots● https://github.com/sirex/gramtool● https://bitbucket.org/sirex/morfologija● https://github.com/frictionlessdata/
Source code of atviriduomenys.lt and related projects:
Top Related