Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data...
Transcript of Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data...
![Page 1: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/1.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
Web Mapping Application for Operative Fireand Water Services
Mostafa ElFouly
Technische Universitat Dresden
German Aerospace Center (DLR)
Supervisors: Prof. Buchroithner ManfredDipl.- Geogr. Stefan Plattner, DLR
Dr. Christian Strobl, DLR
![Page 2: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/2.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
Definitions
MODIS
• MODIS is a sensorcarried on both the Terraand Aqua satellites.
• It allows to obtainimages in the morning(Terra) and in theafternoon (Aqua) for anydistinct location.
• Its data spatialresolution are between250 meters to 1kilometer.
Source: http://aqua.nasa.gov
MODIS-Aqua
Source: http://terra.nasa.gov
MODIS-Terra
![Page 3: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/3.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
Introduction
Motivation
• Fire is an important ecosystemprocess affecting land coverchange
• MODIS Sensor increases theability to monitor fires fromspace
• Archive/Catalog connector hasto be built.
NASA ModelsSource: http://www.nasa.gov/topics/earth/features/fiery-past prt.htm
Monthly Global Fire Activity
![Page 4: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/4.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
MODIS Data Products
• There are 44 MODIS datasets divided into 4 levels.
• MODIS data products are likea biological food web.
• Calibration and Geolocation.
![Page 5: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/5.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
Source: http://modis-atmos.gsfc.nasa.gov/products flow.html
MODIS Data Work Flow
![Page 6: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/6.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
Design
Data Layer
Service Layer Front End Layer
![Page 7: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/7.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
System Workflow
![Page 8: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/8.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
System Workflow
WEB-GIS
Clie
nt
![Page 9: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/9.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
System Workflow
Archive
WEB-GIS
JSON Response
parsed metadata
about them
atched �ilesHTT
P Re
ques
tJS
ON R
eque
stSe
lect
ed a
rea
of in
tere
st
Serv
ices
Clie
nt
Connector
![Page 10: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/10.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
System Workflow
Archive
WEB-GIS
HTT
P/FT
PRe
ques
t
HTTP/FTP
Responsem
etadata aboutthe m
atched �iles
JSON Response
parsed metadata
about them
atched �ilesHTT
P Re
ques
tJS
ON R
eque
stSe
lect
ed a
rea
of in
tere
st
Data
Serv
ices
Clie
nt
Connector
NASA
Catalog(unprocessed data)
Archive
![Page 11: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/11.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
System Workflow
FetcherArchive
WEB-GIS
HTT
P/FT
PRe
ques
t
HTTP/FTP
Responsem
etadata aboutthe m
atched �iles
JSON Response
parsed metadata
about them
atched �ilesHTT
P Re
ques
tJS
ON R
eque
stSe
lect
ed a
rea
of in
tere
st
HTT
P/JS
ONRe
ques
t �ile
s to
be d
ownl
oade
dan
d pr
oces
sed
Data
Serv
ices
Clie
nt
Connector
NASA
Catalog(unprocessed data)
Archive
![Page 12: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/12.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
System Workflow
Fetcher
NASA
Catalog(unprocessed data)
Archive
HTT
P/FT
PDo
wnl
oad
Requ
est
WEB-GIS
HTT
P/FT
PRe
ques
t
HTTP/FTP
Responsem
etadata aboutthe m
atched �iles
JSON Response
parsed metadata
about them
atched �ilesHTT
P Re
ques
tJS
ON R
eque
stSe
lect
ed a
rea
of in
tere
st
HTT
P/JS
ONRe
ques
t �ile
s to
be d
ownl
oade
dan
d pr
oces
sed
Data
Serv
ices
Clie
nt
Connector
ArchiveNASA
Catalog(unprocessed data)
Archive
![Page 13: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/13.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
System Workflow
Fetcher
NASA
Catalog(unprocessed data)
Downloads theelected �iles to theselected destination Pickup
Archive
HTT
P/FT
PDo
wnl
oad
Requ
est
WEB-GIS
HTT
P/FT
PRe
ques
t
HTTP/FTP
Responsem
etadata aboutthe m
atched �iles
JSON Response
parsed metadata
about them
atched �ilesHTT
P Re
ques
tJS
ON R
eque
stSe
lect
ed a
rea
of in
tere
st
HTT
P/JS
ONRe
ques
t �ile
s to
be d
ownl
oade
dan
d pr
oces
sed
Data
Serv
ices
Clie
nt
Connector
ArchiveNASA
Catalog(unprocessed data)
ArchiveFolder
![Page 14: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/14.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
System Workflow
Fetcher
NASA
Catalog(unprocessed data)
Downloads theelected �iles to theselected destination Pickup
Archive
Process Chain
Checks the pickupfolder periodaically
Sends the �ile to beprocessed and exposed
HTT
P/FT
PDo
wnl
oad
Requ
est
WEB-GIS
HTT
P/FT
PRe
ques
t
HTTP/FTP
Responsem
etadata aboutthe m
atched �iles
JSON Response
parsed metadata
about them
atched �ilesHTT
P Re
ques
tJS
ON R
eque
stSe
lect
ed a
rea
of in
tere
st
HTT
P/JS
ONRe
ques
t �ile
s to
be d
ownl
oade
dan
d pr
oces
sed
Data
Serv
ices
Clie
nt
Connector
ArchiveNASA
Catalog(unprocessed data)
ArchiveFolder
![Page 15: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/15.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
System Workflow
Fetcher
NASA
Catalog(unprocessed data)
Downloads theelected �iles to theselected destination Pickup
GeoDB forprocessed
MODIS
Archive
Process ChainSaves the
processed �ile
Checks the pickupfolder periodaically
Sends the �ile to beprocessed and exposed
HTT
P/FT
PDo
wnl
oad
Requ
est
WEB-GIS
HTT
P/FT
PRe
ques
t
HTTP/FTP
Responsem
etadata aboutthe m
atched �iles
JSON Response
parsed metadata
about them
atched �ilesHTT
P Re
ques
tJS
ON R
eque
stSe
lect
ed a
rea
of in
tere
st
HTT
P/JS
ONRe
ques
t �ile
s to
be d
ownl
oade
dan
d pr
oces
sed
Data
Serv
ices
Clie
ntSends the processed �ile back to the user
Connector
ArchiveNASA
Catalog(unprocessed data)
ArchiveFolder
products
![Page 16: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/16.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
Fetching Process
django
DatabaseCelery Workers
events
task for celeryto execute
tasks
Message Brokers
redis
Source: http://www.celeryproject.org/
Celery Architecture
![Page 17: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/17.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
Conclusion
Results
• Web-based modules for the retrieval,processing and exposing ofsatellite-based crisis information to theprocess chain is built.
• Archive Connector maps the user inputparameters to NASA-MODIS DataArchive.
• Fetcher module uses the DistributedTask Queue allowing the downloadprocess for multiple files to be executedasynchronously.
![Page 18: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/18.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
Limitations and Future Work
Limitations
• MODIS is an opticalsensor and not apassive-microwave one.
• Cloud coverage leads toan average annual globalunmapped area of 43%.
• The MODIS active fireproduct will only detectfires that are burning atthe time of satelliteoverpass.
Future Work
• HDF files is to bedistributed across manymachines in a cluster orcloud, which will resultin a faster processing ofthe files.
• The tool should be ableto fetch/retrieve HDFfiles from multiplearchives depending onthe availablity of thearchive servers.
![Page 19: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/19.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
Limitations and Future Work
Limitations
• MODIS is an opticalsensor and not apassive-microwave one.
• Cloud coverage leads toan average annual globalunmapped area of 43%.
• The MODIS active fireproduct will only detectfires that are burning atthe time of satelliteoverpass.
Future Work
• HDF files is to bedistributed across manymachines in a cluster orcloud, which will resultin a faster processing ofthe files.
• The tool should be ableto fetch/retrieve HDFfiles from multiplearchives depending onthe availablity of thearchive servers.
![Page 20: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/20.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
References
• Online Journal of Space Communication. (2013). ’ASTER’,http://spacejournal.ohio.edu/issue3/remote sats2.html (accessed 16December 2013).
• Giglio, L., I. Csiszar, and C. O. Justice. (2006). Global distribution andseasonality of active fires as observed with the Terra and Aqua ModerateResolution Imaging Spectroradiometer (MODIS) sensors, J. Geophys. Res.,111, G02016, doi:10.1029/2005JG000142.
• Janetos, A. C., and Justice, C. O. (2000). ’Land cover and globalproductivity: A measure- ment strategy for the NASA program’,International Journal of Remote Sensing, 21, pp. 1491-1512.
• Brandon Maccherone. ’MODIS Data Product Non-Technical Description -MOD 02, 03’ [on- line],http://modis.gsfc.nasa.gov/data/dataprod/nontech/MOD0203.php (accessed7 August 2013).
• VectorNav Technologies. ’Importance of Industrial Grade Sensor Calibration’[online], http://www.vectornav.com/support/library?id=86 (accessed 18October 2013).
![Page 21: Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data Products Technical Implementation Conclusion References Web Mapping Application](https://reader034.fdocuments.us/reader034/viewer/2022050513/5f9d6c66d539a9786b2f1f39/html5/thumbnails/21.jpg)
Definitions Introduction MODIS Data Products Technical Implementation Conclusion References
References
• Eberle, J. and Strobl C. (2012). ’Web-Based Geoprocessing and WorkflowCreation for Generating and Providing Remote Sensing Products’ -Geomatica Vol. 66, No. 1, pp. 13 to 26.
• Roy, D. P., Lewis, P., and Justice, C. (2002a). ’Burned area mapping usingmulti-temporal moderate spatial resolution data - a bi-directional reflectancemodel-based expectation approach’, Remote Sensing of Environment, 83, pp.263-286.
• D.P. Roy et al. (2008). Remote Sensing of Environment. 112 3690-3707
• Celery. (2013). ’Distributed Task Queue’ [online],http://www.celeryproject.org/ (accessed 11 November 2013).
• Lalit Chandnani. (2013). ’Django Celery: Redis Vs RabbitMQ messagebroker’ [online],http://blog.langoor.mobi/django-celery-redis-vs-rabbitmq-message-broker/(accessed 5 December 2013).