Open data & Open research data: experience from Compass4Dfot-net.eu › wp-content › uploads ›...
Transcript of Open data & Open research data: experience from Compass4Dfot-net.eu › wp-content › uploads ›...
Open data & Open research data: experience from Compass4D
FOT-Net Data Stakeholder Meeting on Data Sharing Activities 08 March 2016 ERTICO, Brussels Dr. Evangelos Mitsakis Associate Researcher Centre for Research and Technology Hellas Hellenic Institute of Transport
Thessaloniki on the map
~1.400.000 inhabitants ~450.000 private cars & 20.000 motorcycles 1.300.000 daily trips 1 (+1) public transport operator for urban trips ~35 public transport operators for extra-urban trips 1.950 taxis 6.433 kms of streets 8,8 kms of dedicated bus lanes 12 kms of dedicated bicycle lanes 89,4 kms of ring road 197.696 parking places
Thessaloniki ITS timeline
•Cooperative technologies •Multimodal integrated services •Personalized traveler assistants •Agent and activity based dynamic models •Eco and climate-friendly mobility (e.g. electro-mobility) •Internet-based services (Internet of things, Future Internet)
2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2014 2015 2016 2017 2018
THESSALONIKI 2020
RAIL4SEE
2013 2019 2020
HIT portal
ΜΟΒΙΝΕΤ
Intelligent Urban Mobility Management
and Traffic Control System
EASYTRIP
SEE-ITS
COMPASS4D
Future internet
Electromobility
Multimodal
Smart cities
Telematics public transport system
Peripheral ring road surveillance
system
Equipment
Services
Studies
Policy
COGISTICS
LOGIMATIC
Related local stakeholders
Region of Central Macedonia Municipality of Thessaloniki CERTH-HIT THEPTA Transport services providers - operators: OASTH,
TRAINOSE, taxis, metro Private sector: passenger infomobility, city logistics
CERTH probe data
Stationary sensors: Point-to-point tracking of MAC IDs with Bluetooth detectors (43).
Dynamic sensors: Floating Car Data provided in real time by a professional fleet (more than 1200 vehicles).
Cooperative technologies (COMPASS4D and COGISTICS): RSU is a static sensor and OBU is a dynamic sensor (CAM message).
Social media (Twitter & Facebook)
- State-of-the-art platform for data and software related to the Transport sector in Greece - Content aggregator, observatory, research infrastructure, services - Data collection and processing - Data standardization and certification - Data management - Data analytics - Data merging / enrichment - Optimization and routing algorithms - Data analytics and visualization - Transport modeling and simulation - Commercial and research studies
Specialized transport software
Algorithm
Data
Thessaloniki HIT PORTAL
Thessaloniki HIT PORTAL
Thessaloniki HIT PORTAL
• Conventional detectors: Data rate varies between 90 seconds (loops) and 5 minutes (radars and cameras). About 300k entries per day requiring approximately 15 MB of uncompressed storage space.
• Bluetooth detectors: Data from units are being transferred to db server every 15 minutes. About 250k - 300k entries per day requiring approximately 50 MB of uncompressed storage space.
• Floating Car Data: Data are being transferred to CERTH-HIT's server every 2 minutes. About 2m entries per day, requiring approximately 200 MB of uncompressed storage space
• 5000 monthly queries to the HIT PORTAL services
Towards a “Big Data” Portal
- Bluetooth detectors - Floating Car Data - Social media - Conventional detectors (loops, radars and cameras)
- Historical data - Real-time - Near real-time
- Conventional detectors (15MB / day) - Bluetooth detectors (50MB / day) - Floating Car Data (200MB / day)
Volume
Velocity
Variety
A novel Open data platform at CERTH-HIT
Datatank (Back office + restAPIs) CKAN (front end)
Open data platform sections
Open data set catalogue Open data publishing Open linked data Open research data Inspiration: ways developers use open data Comments: section where people can log suggestions for tools
they’d like to see developed with the data sets Open data accelerator: a move to unite government publishers of
data, the businesses that use it, as well as citizens and developers Open data declaration and open data policy (Transparency,
Participation, Collaboration, Innovation, Progress, terms of data use etc)
Open data platform content
Floating car data Congestion (json, xml, php) Speed (json, xml, php)
GPS (json, xml, kml, GeoJSON, WKT, CSV, PHP)
Open data platform content
Bluetooth detections data Detections (json, xml, php) Travel times (json, xml, php) Devices (json, xml, kml, GeoJSON, WKT, CSV, PHP)
Paths (json, xml, kml, GeoJSON, WKT, CSV, PHP)
Open data platform content
Research data (COMPASS4D) Floating car data along two arterials Higher frequency (1 Hz) GPS location, zone ID Timestamp, Speed Qualitative data
Cooperative safety messages Speed advices
Open data platform target groups
Researchers - Academics Public authorities and public transport providers Service providers and private companies Start-ups, independent programmers and web
entrepreneurs Open data communities and data hackathon events
Dr. Evangelos Mitsakis Associate Researcher Centre for Research and Technology Hellas Hellenic Institute of Transport e: [email protected] t: +30 2310 498459
http://www.opendata.imet.gr