Introduction to Geospatial Data and Analytics on...
Transcript of Introduction to Geospatial Data and Analytics on...
![Page 1: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/1.jpg)
Introduction to Geospatial Data and Analytics on CyberGIS
Yan Liu, Anand Padmanabhan, Shaowen Wang
CyberGIS Center for Advanced Digital and Spatial StudiesCyberInfrastructure and Geospatial Information Laboratory (CIGI)Department of Geography and Geographic Information Sciences
National Center for Supercomputing Applications University of Illinois at Urbana-Champaign
April 2014
![Page 2: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/2.jpg)
Outline
• Introduction to CyberGISo Cyberinfrastructure and Geographic Information Systems (GIS)
o CyberGIS
o CyberGIS & XSEDE
• CyberGIS Data and Analyticso Computational challenges
o CyberGIS applications
• CyberGIS Gatewayo Open service API (hands-on)
o Gateway applications (hands-on)
![Page 3: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/3.jpg)
3
CyberInfrastructure
• “The whole is more than the sum of
its parts.”o By Aristotle in the Metaphysics
Borromean rings, after Daniel E. Atkins
Image source:
http://www.phy.ornl.gov/theory/dean/RIATG/web_pages/structure_one_pager.html
![Page 4: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/4.jpg)
Geographic Information Systems
• “Geographic Information Systems (GIS) are simultaneously the telescope, the microscope, the computer, and the Xerox machine of regional analysis and synthesis of spatial data.” (Ronald F.
Abler 1988)
4
![Page 5: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/5.jpg)
Cyber + GIS > Cyber | GIS
Cyber
GIS
![Page 7: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/7.jpg)
CyberGIS Center Vision
Computing- and
Data-Intensive
Applications
and Sciences
Geospatial
Sciences and
Technologies
CyberGISAdvanced
Cyber-
infrastructure
Discovery & Innovation
Advanced Digital Technologies
7
![Page 8: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/8.jpg)
People
• Director
• Executive committeeo Danny Powell, National Center for Supercomputing Applications
o Stephen Marshak, Director, School of Earth, Society and the Environment
o Sara McLafferty, Head, Department of Geography & Geographic Information Science
o Allen Renear, Interim Dean, Graduate School of Library and Information Science
o Brian Ross, Interim Dean, College of Liberal Arts and Sciences
o Peter Schiffer, Vice Chancellor for Research
o William Shilts, Prairie Research Institute
o Up to two additional faculty or staff user members can be added to the EC by majority vote of the Executive Committee.
• Program coordinator
• Technical coordinator
• Project manager
• Education, training and outreach coordinator
• Faculty and researcher affiliates – 70-100
• Multiple research programmers
• Multiple postdoctoral researchers
![Page 9: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/9.jpg)
Focal Themes and Related Fields
• Sciences and technologies of CyberGIS (e.g., advanced cyberinfrastructure, computer science, computational and data science, geography and geographic information science, library and information science, mathematics, and statistics)
• Research and engineering applications of CyberGIS for enabling creative work, discovery, and innovation (e.g., agriculture, applied health sciences, atmospheric sciences, business, civil and environmental engineering, geography and geographic information science, geology, history, political science, sociology, urban and regional planning, and veterinary medicine)
• Human and societal dimensions of CyberGIS (e.g., business, communication, geography and geographic information science, industrial and enterprise systems engineering, and psychology)
• CyberGIS education, outreach, and training (all of the above fields)
![Page 10: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/10.jpg)
NSF SI2-SSI: CyberGIS Project
$4.43 million, Year: 2010-2015
Principal Investigator
– Shaowen Wang
Project Staff
– ASU: Wenwen Li and Rob Pahle
– ORNL: Ranga Raju Vatsavai
– SDSC: Choonhan Youn
– UIUC: Yan Liu and Anand
Padmanabhan
– Graduate and undergraduate students
Industrial Partner: Esri
– Steve Kopp and Dawn Wright
10
Co-Principal Investigators
– Luc Anselin
– Budhendra Bhaduri
– Timothy Nyerges
– Nancy Wilkins-Diehr
Senior Personnel
– Michael Goodchild
– Sergio Rey
– Xuan Shi
– Marc Snir
– E. Lynn Usery
Project Manager
– Anand Padmanabhan
Chair of the Science Advisory Committee
– Michael Goodchild
![Page 11: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/11.jpg)
CyberGIS Communities
• Science Communities• Advanced cyberinfrastructure
• Climate change impact assessment
• Emergency management
• Geographic information science
• Geography and spatial sciences
• Geosciences
• Social sciences
• Etc.
• User Communities• Biologists
• Geographers
• Geoscientists
• Social scientists
• General public
• Broad GIS users
• Etc.
11
![Page 12: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/12.jpg)
12
![Page 13: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/13.jpg)
CyberGIS on XSEDE
• Geographic Information Science gatewayo 2007 – present
o Science gateways program on XSEDE
• Allocationso Annual allocations awarded by XSEDE
o 8M computing hours for the academic year 2013 - 2014
![Page 14: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/14.jpg)
Discoveries
Questions
Predictions
Grand Challenges?
14
![Page 15: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/15.jpg)
Big Spatial Data
15
![Page 16: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/16.jpg)
Big Spatial Simulation
Image created by Eric Shook
16
![Page 17: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/17.jpg)
Complex Spatial Decision Making
17
![Page 18: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/18.jpg)
![Page 19: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/19.jpg)
Collaborative Knowledge Discovery
19
![Page 20: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/20.jpg)
CyberGIS for What and Whom?
CyberGIS
Gateway
CyberGIS
Toolkit
20
![Page 21: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/21.jpg)
www.opensciencegrid.org www.xsede.org
http://lakjeewa.blogspot.com/20
11/09/what-is-cloud-
computing.html
Integrated Digital and Spatial Sciences
CyberGIS
Gateway
CyberGIS
Toolkit
Space-Time Integration & Synthesis
GISolve
Middleware
21
![Page 22: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/22.jpg)
22
![Page 23: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/23.jpg)
23
![Page 24: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/24.jpg)
24
![Page 25: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/25.jpg)
http://blogs.esri.com/esri/arcgis/2013/10/01/what-is-cybergis/
![Page 26: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/26.jpg)
Big Spatial
Data
Big Spatial
Simulation
Complex
Spatial
Decision
Making
Collaborative
Knowledge
Discovery
CyberGIS
Gateway
Yes
Maybe
Yes
Maybe
Yes
Maybe
Yes
Maybe
CyberGIS
Toolkit
Yes
Maybe
Yes
Maybe
Yes
Maybe
Yes
Maybe
GISolve
Middleware
Yes
Maybe
Yes
Maybe
Yes
Maybe
Yes
Maybe
26
![Page 27: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/27.jpg)
Education
• Curriculum and pedagogy
• Partnerships
• Open ecosystems
![Page 28: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/28.jpg)
Center Services
• CyberGIS Commonso Short courses
o One-on-one training
• CyberGIS Helpdesko Proposal development
o Technical consulting
• CyberGIS Infrastructureo Hardware
o SoftwareP
eo
ple
![Page 29: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/29.jpg)
CyberGIS Data and Analytics
• Computational Challengeso Computational intensity
o Research
o Applications
• Scalable CyberGIS Data and Analyticso Data
o Scalable computing
• Performance
• Scalability
![Page 30: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/30.jpg)
Heterogeneous
• Syntactic
• Semantic
Dynamic
• Spatial and temporal
• E.g. social media
Massive
• Produced by individuals
• Accessible to individuals
30
Large-scale
• Global coverage
Fine granularity
• Individual-level
• High-resolution
Distributed access
• Interoperability
• Privacy
• Security
Theory + Experiment + Computation + Big Data
![Page 31: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/31.jpg)
Digital Environments
Parallel
o Used to be regarded as a way for speeding up GIS
functions and spatial analysis
o Now becoming a must for GIS and spatial analysis to
be built on
• Multi- and many-core
• GPU (graphics processing unit)
Heterogeneous architecture
Mobile
Distributed
o Service-oriented
o Clouds31
![Page 32: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/32.jpg)
Computational Intensity Question
• What is the nature of computational intensity of geographic analysis?
o Why spatial is special?
• Comparable to
o “What is the nature of computational complexity of an algorithm?”
32
![Page 33: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/33.jpg)
Spatial Computational Principles/Theories
Spatial
• Distribution
• Dependence
• Integration
• Representation
• Uncertainty
• Etc.
Computational
• Complexity vs. intensity
• Uncertainty vs. validity
• Performance vs. reliability
• Etc.
SC
AL
E
33
![Page 34: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/34.jpg)
Big Geospatial Data Processing and Analysis
• 1/3 arcsec National
Elevation Dataset
• Resolution: 10m
• Size: 0.5TB
• Data operations
• Downloading
• Clipping
• Reprojection
• Transformation
• Visualization
• DEM-based analysis
• TauDEM
• 3DEP
• Multiple PBs
• NED: http://ned.usgs.gov; 3DEP: http://nationalmap.gov/3DEP/
• TauDEM: http://hydrology.usu.edu/taudem
Is Greenland bigger than US?
![Page 35: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/35.jpg)
Scalable Reprojection• pRasterBlaster (Behzad et. al, 2012)
o A high-performance map reprojection software developed by US Geological Survey (USGS)
o Computational performance improvement
• Collaboration between USGS and CIGI@UIUC
• Parallelismo Spatial data domain decomposition
• Computational bottlenecko Load balancing
• Programming techniques
• Randomized workload distribution
• Resultso 12GB raster projection: ~200 seconds on Trestles supercomputer @ SDSC,
1024 processor cores
![Page 36: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/36.jpg)
Scalability Issue
![Page 37: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/37.jpg)
Profiling
Processor index
![Page 38: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/38.jpg)
Programming for Scalability
38
N rows on P processor cores
When P is small When P is big
int load[P];
load[i] = N / P; // i = 0, 1, 2, …, N-1
load[N-1] += N % P;
![Page 39: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/39.jpg)
Programming for ScalabilityN rows on P processor cores
When P is small When P is big
int load[P];
load[i] = N / P; // i = 0, 1, 2, …, N -1
load[j] += 1; // j = 0, 1, 2, …, (N % P) -1.
![Page 40: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/40.jpg)
Input/Output (I/O) Bottleneck• TauDEM
o Terrain analysis using Digital Elevation Models (TauDEM)
• Scalability Improvement (Fan et. al, submitted)o Before: max DEM size – 6GB. Not scalable to the number of processors
o After: 36GB+
![Page 41: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/41.jpg)
Programming for I/O Performance
Before
On each process:
foreach input DEM file
read spatial metadata
determine input data blocks
read data
After
On root process:
foreach input DEM file
read spatial metadata
broadcast metadata to all other processes
On earch process:
determine input data blocks
read data
![Page 42: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/42.jpg)
CyberGIS Gateway - FluMapper
42
http://flumapper.org/
![Page 43: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/43.jpg)
![Page 44: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/44.jpg)
Redistricting Problem
• Redistrictingo Partitioning a group of indivisible geographic units into a smaller number
of political districts
• Redistricting as A Combinatorial Optimization problemo Objectives and constraints
• Contiguity, competitiveness, equal-population, preservation of
communities of interest and local political subdivisions, Minority
districts
o Computational complexity
• Number of possible solutions
o Stirling number of the second kind: S(n, k)
o Example: S(55, 6) = 8.7 x 1039
• Computationally intractable
o NP-hard
![Page 45: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/45.jpg)
Computational Intractable!
1 2 4 8 16 32 64 128
256 512 1024 2048 4096 8192 … …
263
![Page 46: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/46.jpg)
Genetic Algorithm (GA) Approach• Principles
o Evolutionary process
• “survival of the fittest”
• Iterative algorithm
o Solution population: a diverse set of initial solutions
o GA operators
• Selection, crossover, mutation, replacement
o Stopping criteria
• Solution quality
• Time or the number of iterations
• Spatial GA operatorso Solution generation
o Crossover
o Mutation
![Page 47: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/47.jpg)
Solution Generation
• Randomization-based district formation
• Contiguity and hole-free
Neighborhood graph Growth of seeds
![Page 48: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/48.jpg)
(a) Seeding (b) District expansion (c) Initial solution
![Page 49: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/49.jpg)
Crossover
• Binary crossover
• Spatial crossovero Overlay of two redistricting solutions splits
o Formulation of a finer level (split-level) redistricting problem
o Solution conversion
![Page 50: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/50.jpg)
(a) Selection of
parent solutions
(b) Overlapping
(c) Solution conversion
![Page 51: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/51.jpg)
Mutation
• Exchange of multiple units on district boundary and
beyond
Pick units:
units selected
for changing
district
assignment
![Page 52: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/52.jpg)
High Performance Solution:
Parallel Genetic Algorithm (Liu & Wang, 2014)
Figure 2. Asynchronous PGA framework
![Page 53: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/53.jpg)
CyberGIS Gateway
• Hands-on: Open Service API
• Hands-on: Use Viewshed Analysis for Planning
![Page 54: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/54.jpg)
Hands-on: Open Service API
• Open Service APIo REST Web services
o Document:
• https://wiki.cigi.illinois.edu/display/DOC/GISolve+Open+Service+API+User+
Guide
o Code:
• https://svn2.cigi.uiuc.edu:8443/open-service-api/trunk
• Usageo Develop your own Web or desktop applications that leverage CyberGIS
capabilities
o Results sharing
o Embed analysis results as map layers on Web
![Page 55: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/55.jpg)
Tutorial Server
• tutorial.cigi.uiuc.edu
• Accounts: train1 – train49
• Access:o ssh client
• Mac/linux: ssh [email protected]
o scp
![Page 56: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/56.jpg)
Hands-on: Viewshed Analysis
• Locating fire lookout towerso Study area: Silver Plume City, Colorado
o Requirements
• The visible area (viewshed) from the lookout towers should be as large as
possible to cover the service area identical to the bounding box of the given
DEM (https://dl.dropbox.com/u/21798649/competition/problem1/sp_b10m.tif)
• The number of towers to be built should be four or less, and be as small as
possible (due to budget and maintenance cost reasons)
![Page 57: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/57.jpg)
Acknowledgments
Federal Agencies Department of Energy’s Office of Science National Science Foundation
– BCS-0846655– EAR-1239603– OCI-1047916– IIS-1354329– PHY-0621704– PHY-1148698– TeraGrid/XSEDE SES070004
US Geological Survey (USGS)
Industry Environmental Systems Research Institute (Esri)
57
![Page 58: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/58.jpg)
Acknowledgments – U of I
College of Liberal Arts and Sciences Department of Geography and Geographic
Information Science Graduate School of Library and Information
Science National Center for Supercomputing Applications Office of the Vice Chancellor for Research Prairie Research Institute School of Earth, Society, and Environment
58
![Page 59: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/59.jpg)
Acknowledgements - CyberGIS Center
![Page 60: Introduction to Geospatial Data and Analytics on CyberGIShpcuniversity.org/media/TrainingMaterials/11/xsede... · o Open service API (hands-on) o Gateway applications (hands-on) 3](https://reader034.fdocuments.us/reader034/viewer/2022050212/5f5e12f791d4480fc069948d/html5/thumbnails/60.jpg)
Thanks!
• Comments / Questions? o Science Gateway questions
• Surveyo http:/bit.ly/ASUXSEDE
60