Geo-social media as a proxy for meteorological data for flood monitoring · 2017-06-21 ·...
Transcript of Geo-social media as a proxy for meteorological data for flood monitoring · 2017-06-21 ·...
Geo-socialmediaasaproxyformeteorologicaldataforflood
[email protected] CandidateUniversity of SãoPaulo
thewadilabwater-adaptive design & innovation
São Carlos, SP (November 23th 2015)
Floods
Whatisthat?
Alternativesources
SocialMediaInformation
Waze - Similarconcept
BIGDATA
“Big data usually includes data sets with sizes beyond the ability ofcommonly used software tools to capture, curate, manage, and processdata within a tolerable elapsed time. Big Data philosophy encompassesunstructured, semi-structured and structured data, however the mainfocus is on unstructured data.” source wikipedia
According to IBM: “Big Data is being generated at all times. Every digitalprocess and social media exchange produces it. Systems, sensors andmobile devices transmit it. Much of this data is coming to us in anunstructured form, making it difficult to put into structured tables withrows and columns. To extract insights from this complex data, Big Dataprojects often rely on cutting edge analytics involving data science andmachine learning. Computers running sophisticated algorithms can helpenhance the veracity of information by sifting through the noise createdby Big Data's massive volume, variety, and velocity.”
BIGDATA
BIGDATA
BIGDATA
BIGDATA
BIGDATA
BIGDATA
BIGDATA
BIGDATA
SocialMedia
Personality
- Neuroticism- Extroversion- Kindness- Politicsfiliation
SocialMedia
10
70
150
300
Colleagues
Friends
Family
Partner
Personality
SocialMedia
SocialMedia
SocialMedia
SocialMediaandhydrology
Context
Pluviômetros Satélites
Rede de sensores
Problemstatement
Aricanduva catchment SAISP floods
Relatedgeolocatedtweets
City of São Paulo with related tweets as black points, rainfall gauges as blue triangles and the Aricanduva catchment shaded gray.
KeywordsandwrongkeywordsVariable WordsinPortuguese WordsinEnglish
Keywords %chuv%(chuva,chuvinha,chuvisco)%chov%(chove,chovendo,chover,choveu)
rain,rainy,drizzleItrains,torain,rained
Wrongkeywords
%bolinhodechuva%,%chuveiro%,%chuvanegra%,%chuvadefoto%,%chuvadebenção%,%chuvadegraça%,%chuvadeconfete%,%chuvadearroz%,%chuvadeglitter%,%chuvadeespuma%,%chuvadeamor%,%chuvademec%,%chuvadeabacate%,%chuvadesol%
sweetsnack,shower,rapgroupcallschuva negra,photorain,rainofblessing,rainofgrace,confettirain,ricerain,glitterrain,foamrain,loverain,mec rain,avocadorain,sunrain.
Reinforcement %choveforte%,%chovemuito%,%muitachuva%,%chovendomuito%,%chovemuitoforte%
itrainshard,Itrainsalot,lotsofrain,It'srainingalot,It'srainingverystrong
Weakening %arco íris% rainbow
Preliminaryresults
Transformationfunction
𝑝"#$%&' = 𝛼(1 + 𝜂"./#01 + 𝜂"#2.)𝑓67
𝐴%0.9/9".+: 𝛽%
𝐹67(%)𝐴%0.9/9".
0
%=>
PROBABILITY DISTRIBUTED MODEL (PDM)
Results
Results
References
• Andrade, Sidgley Camargo de, Camilo Restrepo-Estrada, Alexandre C BDelbem, Eduardo Mario Mendiondo, and João Porto De Albuquerque.2017. “Societal Geo-Innovation,” 19–37. doi:10.1007/978-3-319-56759-4.
• Restrepo-Estrada, Camilo; Andrade, Sidgley Camargo de; Albuquerque;João Porto de; Abe, Narumi; Fava, Maria Clara; and Mendiondo, EduardoMario. "Geo-social media as a proxy for meteorological data for floodmonitoring". Computers & Geosciences. (Submitted 2017 - Ref:CAGEO_2017_513).
• BIG DATA | Nerdologia 40.https://www.youtube.com/watch?v=hEFFCKxYbKM
• Dilúvio de dados | Nerdologia 131. https://youtu.be/pNZq8BCS-Bc
• Privacidade na Internet | Nerdologia Tech 07https://youtu.be/wZvDZfO13mA
Thanksforyourattention
CamiloRestrepoEmail:[email protected]
Acknowledgements:Authors thank research funding grants from: CAPES-ProEx, CAPES-ProAlertas # 88887.091743/2014-01(CEPED-"USP ALERTA").