Big Data @ Valencia SmartCity project30th_Nov]-04... · Big Data @ Valencia SmartCity project...

#bdvasummit

#bdvasummit

Big Data @ Valencia SmartCity projectDaniel Díaz

VLCi project Manager

Valencia City Hall

#bdvasummit

App Valencia• Even before my presentation starts… please, have a look at this

2

SOCINFO Smart City 2015

CNIS 2015

Real Time notifications- Traffic- Emergencies

Geopositioned information- BUS stops- Public Bikes service- Metro- Taxis- Monuments- Closer & Cheaper Gas Stations, Hospitals, Chemists

Tourism & Culture- Cultural Routes- Augmented Reality features (Historical Monuments)- Audio guide (emblematic monuments)- Virtual reality tours

30-11-2016 3www.bdva.eu#bdvasummit30-11-2016 www.bdva.eu#bdvasummit

o 1 . VLCi Project elevator pitch

o 2 . VLCi platform

o 3 . VLCi Big Data features

o 4 . Data Catalogue – Big Data potential

o 5 . Use Cases

o 6 . Next Steps

Contents

30-11-2016 4www.bdva.eu#bdvasummit

BUDGETSplit in 2 Dimensions:• D1: Platform Service• D2: Professional

Services.

CONTRACTWon in Public bid. Telefonica got the Project assigned amongst other 7 remarkable firms. Contract Date: 08/07/2014

PROJECT SCOPE(D1) PLATFORM SERVICE

Carrier Grade private Cloud Service. Hosted @ Telefonica PoP in Alcalá. All servers are HA and support is 24x7

(D2) PROFESSIONAL SERVICES- Project Management- Integration/Devel Team- Consultancy Team

4M€4Years+(1+1)

STRATEGYStrategy is key to develop a Smart City project

VLCi PlatformIs the strategy enabler.Best approached for building a Smart City (pointed out by several Market Analysts)

VLCi TEAMMultidisciplinary Team:- Developers- Consultants- Designers

Close Contact with the City Hall.

ECOSYSTEMAlways in touch with the ecosystem:- The CITIZEN- The ENTREPRENEUR- The UNIVERSITY

• The VLCi project is direct consequence of the Valencia Smart City Strategy• VLCi platform is the Vertebrating Tool for the City Strategy.

1.-VLCi project


Open Data Portal

• 114 Datasets

• 768 Resources

City Dashboard

• +600 KPIs

• ISO37120 aligned

City Real Time Dashboard

• Real Time Info

• Traffic Status

• Air Quality

• Parking status

• City Hall News &Agenda

BigData Analysis

• Mobility

• Tourism

ISO 37120 Platinum Certif.

• 99 KPIs reported

• 2nd City in Spain

City Activity (UTool)

• Real Time Info

• Gravitatory Potential Map generated every 6h with last 24h

• FIWARE certified connector

1.-VLCi Project (results)


2.- VLCi platform (i)


2.- VLCi platform (ii)

Data collection


3.- VLCi Big Data (i)Big Data Platform Characteristics:

High PerformanceFull ReliabilityHigh Availability

SmartVLCi Capacities:Ambari Server (x2):

4CPU, 8 GB RAMNameNode (x2):

2CPU, 4 GB RAMDataNode (x6):

4CPU, 8 GB RAM


3.- VLCi Big Data (ii)Big Data Distribution & Components

SmartVLCi Big Data Tools:Hue:

– Oozie (Workflow Scheduler)– HDFS (Distributed File System)– Job Tracker (Map-Reduce Manager)– Pig (MapReduce Programming Framework)– Sqoop (Data Transfer Optimizer)


4.- BigData Catalogue

Economy&

TourismMobility

URBAN

InfraestructureSocial

Services

WasteMngmntSafety

50 5

31 18

5 5

+100 Datasetsstored & updated


5.- Use Cases – (i)Mobility Analysis based on Mobile Network information

Mobility Analysis

GoalsQuantify and characterise mobilityfocusing in Path Analysis

in Valencia metropolitan area.

2015Analysis Dates

Data & Methodology

Data: collected CDRs from Telefónica’s mobile Network.Anonymized & Aggregated to allow trend analysis.

Deliverables: online mobility visor and O/D matrixes (entry data to simulation SW).Similar to a survey made to 400Khab. About their mobility routines

Results

http://195.235.93.90/ss/

http://195.235.93.90/ss/

30-11-2016 12www.bdva.eu#bdvasummit 12

5.- Use Cases – (ii)Tourism mobility analysis based on Mobile Network Data

Mobility Analysis (Tourism)

Goals Quantify and characterise touristsbehaviour visiting Valencia.

2015Analysis Dates

Data & Methodology

Data: collected CDRs from Telefónica’s mobile Network.Anonymized & Aggregated to allow trend analysis.

Deliverables: Analysis Report and Data Matrixes

Results

http://telefonica-vlc.cartodb.io/#national

http://telefonica-vlc.cartodb.io/#national

30-11-2016 13www.bdva.eu#bdvasummit 13

5.- Use Cases – (iii)City Activity Analysis

“UTool” – City Activity Analysis

Goals

Obtain online comprehensive data(maps) to understand activity in thecity, and elaborate predictions basedon social networks activityinformation

From Oct, 2016Analysis Dates

Data & Methodology

Data: geolocated twitts continuous stream collection.Analysis scheduled every 6 hours analysing the last 24h activity

Deliverables: - New FIWARE Data Connector- Public Dataset available in CKAN Open Data Portal as well as a

- “Gravitational potential map” updated every 6hours.

Results

Extend it to other Social NetworksNext Steps


6.- Next Steps“Impulso VLCi” will boost the IoT deployment in ValenciaThis implies more useful data to potentially analyse

6M€“Impulso VLCi” is 70% financed by Red.EsAll 17 activities within “Impulso VLCi” will be deployed from 2017 until 2019.

Governance

Environment

Mobility

Society

Wellbeing

- GeoServices Enhancement (GIS))- Mobile City App Enhancements- Replicable SW platform developments

- Municipal Heritage Smart Care- Urban Waste Smart management- Smart Lighting Management in suburbs

- Reduced Mobility Parking Smart Mngmnt- Load/Unload parking Smart Management- Taxi Stage/Areas Smart Management- Regulated Parking Smart Management- E-vehicle Charge pilot

- Social Water Supply Warranty Fund- Local Civic Network

- Urban Noise Smart Management- Smart Tourism- Smart Sensors on board of municipal buses

1.88M€

188K€

2.4M€

455K€

514K€


Remember… App Valencia• Even before my presentation starts… please, have a look at this

15

SOCINFO Smart City 2015

CNIS 2015

Real Time notifications- Traffic- Emergencies

Geolocated information- BUS stops- Public Bikes service- Metro- Taxis- Monuments- Closer & Cheaper Gas Stations, Hospitals, Chemists

Tourism & Culture- Cultural Routes- Augmented Reality features (Historical Monuments)- Audio guide (emblematic monuments)- Virtual reality tours

#bdvasummit

Daniel DíazVLCi project Manager

[email protected]

www.valencia.es

Thank You!

Big Data @ Valencia SmartCity project30th_Nov]-04... · Big Data @ Valencia SmartCity project...

Documents

Transcript of Big Data @ Valencia SmartCity project30th_Nov]-04... · Big Data @ Valencia SmartCity project...