Historical Counties: Visualizing Change with Tracking Analyst MGIS Capstone Kevin Horne Advisor –...

Historical Counties: Historical Counties: Visualizing Change with Visualizing Change with

Tracking AnalystTracking Analyst

MGIS CapstoneMGIS Capstone

Kevin HorneKevin Horne

Advisor – Mark LindbergAdvisor – Mark Lindberg

University of MinnesotaUniversity of MinnesotaMay 13, 2008May 13, 2008

research overviewresearch overview project phasesproject phases tracking analysttracking analyst animation seriesanimation series data preparationdata preparation recommendationsrecommendations questionsquestions

agendaagenda

Historical Counties: Visualizing Change with Tracking Analyst Horne 2008

research overviewresearch overviewmodelsmodels

key dateskey dates• snapshotsnapshot• NHGIS shapefilesNHGIS shapefiles• temporal feature temporal feature

classesclasses

space-time compositespace-time composite• lowest common lowest common

geographygeography• atomic unitsatomic units• reconfigure based on reconfigure based on

atomic historyatomic history• NHGIS developmentNHGIS development


China Historical GIS (Berman 2003)

research overviewresearch overviewvisualizationvisualization

techniquestechniques• ““frozen wardsfrozen wards””• cartogramscartograms

census/election datacensus/election data• temporal symbologytemporal symbology• time seriestime series• animationanimation

applicationsapplications• VoxelViewerVoxelViewer• MapTimeMapTime• Tracking AnalystTracking Analyst


VoxelViewer (Harrower 2002)

2004 U.S. Presidential Election Results by population (Gastner, Shalizi, & Newman, M. E. J., 2004)

project phasesproject phases


script

animation

China Historical GIS Data Model (Berman 2002)

model

project phasesproject phases


animation

tracking analysttracking analyst


time window properties

date field; tracking field

symbology properties

playback manager

playback managerplayback manager

interactive visualizationinteractive visualization default properties for animationsdefault properties for animations available in ArcMap ‘data view’available in ArcMap ‘data view’


current datecurrent date

always changingalways changing can be directly manipulatedcan be directly manipulated


start date & end datestart date & end date

derived from dataderived from data can be adjustedcan be adjusted


playback rateplayback rate

establish rate of change for current dateestablish rate of change for current date• Jan 1, 1790Jan 1, 1790• Jan 1, 1800Jan 1, 1800• Jan 1, 1810…Jan 1, 1810…• Jan 1, 2000Jan 1, 2000


playback managerplayback manager

10 years yields 3600 days (corrected in version 9.2)10 years yields 3600 days (corrected in version 9.2)• use 3652.4 days use 3652.4 days current dates Jan 1, Jan 2, or Jan 3 current dates Jan 1, Jan 2, or Jan 3

extra empty frame at end of animationextra empty frame at end of animation• reduce end date by one time interval (10 years)reduce end date by one time interval (10 years)

speed increases/reduces frame countspeed increases/reduces frame count• should see all frames – just faster or slowershould see all frames – just faster or slower


date field / tracking fielddate field / tracking field

initialize at load timeinitialize at load time

date fielddate field• requiredrequired• January 1, YYYYJanuary 1, YYYY

tracking fieldtracking field• optionaloptional• required for labelingrequired for labeling

ability to modify ability to modify • new in ArcGIS 9.2new in ArcGIS 9.2


time windowtime window

temporal query temporal query • relative to Playback relative to Playback

Manager’s current dateManager’s current date

not requirednot required• grab most current event grab most current event

(new in 9.2)(new in 9.2)

typical time windowtypical time window• 4 days 4 days (ArcGIS (ArcGIS

9.0)9.0) 3652.4-day intervals3652.4-day intervals

• 1 day 1 day (ArcGIS 9.2)(ArcGIS 9.2) 10-year intervals10-year intervals


symbology settingssymbology settings

time windowtime window• ageage

select vs. classifyselect vs. classify

advanced optionsadvanced options• additional labelingadditional labeling

basic symbologybasic symbology data exclusiondata exclusion


animation seriesanimation series


“B” series – Expanded Study Area

“C” series – Change

“A” series – Basic 7-State Study Area

“D” series – Frozen Boundaries

animation seriesanimation series”A” Series – Basic 7-State Study Area”A” Series – Basic 7-State Study Area

clipped study areaclipped study area map typesmap types

• boundariesboundaries• county population county population

issuesissues• clipped feature valuesclipped feature values• what’s over the edge?what’s over the edge?


animation seriesanimation series”B” Series – Expanded Study Area”B” Series – Expanded Study Area

view entire featuresview entire features map typesmap types

• boundariesboundaries• county populationcounty population• county population county population

densitydensity issuesissues

• single decadesingle decade• classificationclassification


animation seriesanimation series”C” Series – Change”C” Series – Change

temporal comparisonstemporal comparisons map typesmap types

• boundaries boundaries • county populationcounty population• county population county population

densitydensity issuesissues

• symbologysymbology• features across features across

decadesdecades


animation seriesanimation series”D” Series – Frozen Boundaries”D” Series – Frozen Boundaries

““frozen wards”frozen wards” map typesmap types

• populationpopulation• population densitypopulation density

issuesissues• interpolationinterpolation• identity identity slivers slivers

tolerance 1 metertolerance 1 meter


data preparationdata preparation


D2 County Population Density(frozen boundaries)

C5 Change in County Population Density (graduated symbols)

data preparationdata preparationC5 Change in County Population Density (graduated symbols)C5 Change in County Population Density (graduated symbols)


(6)select

state & territory features

(12)create county

features based on population

(9)separate

state & territoryfeatures

(10)select

county features

(8)create

date labelfeatures

(4)assign

temporalfields

(5)aggregate features

(7)identify

max extent

(2)download

population tables from NHGIS

(1)download shapefiles

from NHGIS

(3)create

study area

(11)select

statistical data

(14)calculate

populationvalues

(13)add tracking and

change fields

(15)add population density fields

(16)calculate

populationdensity values

layerproperties

layerproperties


Add FieldC_YEAR

Add FieldC_DATE

Add FieldYR_GISJOIN

Calculate Fieldshapefile year

Calculate FieldJanuary 1, [C_YEAR]

Calculate Field [C_YEAR] &

[GISJOIN]

(4)assign

temporal fields

statesby year

with dates

countiesby year

from NHGIS

statesby year

from NHGIS

countiesby year

with dates

(5)aggregate features

MergePython script

statesall years merged

together

countiesall years merged

together



(6)select

state & territory features

ArcMap‘Select by Loc.’

[crossed by outline of]


[are contained by]

MergeArcToolbox

statesall years merged

together

study area

states crossed by/

contained bystudy area

max extent(7)

identify max extent

Dissolve

(9)separate


ArcMap‘Select by Attr.’

[GISJOIN] ends with ‘5’

selected territories

selected states



max extent

(10)select

county features

selected territories

selectedstates


[are contained by]

countiesall years merged

together

Add Jointo territories

Add Jointo states

selectedcounties

[no population](in territories)

selectedcounties

[no population](in states)

mergedpopulation

tables

population tables by year

from NHGIS

(11)select

statistical data

Mergevia model in

Model Builder

Add Jointo selected

counties

selectedcountiesupdated

(in territories)

selectedcounties updated

(in states)


problemwhen excluding features, valid features are also excluded.

work aroundseparate features with population from those without.


selectedcountiesupdated

(in territories)

selectedcounties updated

(in states)

selectedcounties

with population

selectedcounties

without population

Selectcounties with

population

Selectcounties with no

population

(12) create county

features based on population

Mergestate & territory counties with

population

Selectstate & territory counties withno population



selectedcounties

with population

(13)add tracking and

change fields

Add FieldPREV_YR_TRACKID

Add FieldPREV_POP

Add FieldCHG_POP

Add FieldYR_TRACKID

Add FieldTRACKID

Calculate Field(C_YEAR – 10) +

TRACKID

Calculate Field[C_YEAR] +[TRACKID]

Calculate Fieldvalues depend upon featurerelationships

selectedcounties

with population

Calculate FieldPREV_POP =

counties PREV.COUNTY_POP

Calculate FieldCHG_POP =

[COUNTY_POP] – [PREV_POP]

Add Jointo

WITH POP PREV

CopyFeatures

createWITH POP PREV

(14)calculate

populationvalues

Remove Join

selectedcounties

without populationchange

selectedcounties

with populationPREV

selectedcounties

with populationchange


BrookingsCounty


selectedcounties

with population

selectedcounties

with pop density change [NEG]

selectedcounties

with populationPREV

selectedcounties

with pop density change [POS](15)

add population density fields

Add FieldCHG_

SQ_MILES

Add FieldPREV_

SQ_MILES

Add FieldCHG_PERSON_

SQ_MILE

Add FieldPERSONS_SQ_MILE

Add FieldSQ_MILES

Calculate Field[COUNTY_POP] /

[SQ_MILES]

Add FieldPREV_

PERSONS_SQ_MILE

ArcMapCalculateGeometry

Calculate FieldCHG_SQ_MILES = SQ_MILES –PREV_SQ_M…

Calculate FieldPREV_SQ_

MILES = PREV.SQ_MILES

Calculate FieldPREV_PERSONS

_SQ_MILE =PREV.PERS…

Add Jointo

WITH POP PREV

(16)calculate

populationdensity values

Remove Join

Calculate FieldCHG_PERSONS

_SQ_MILE =PERSONS…

Select/ExportCHG_PERSONS_

SQ_MILE >= 0

Select/Export CHG_PERSONS_SQ_MILE < 0


layer propertieslayer propertiesC5 Change in County Population Density (graduated symbols)C5 Change in County Population Density (graduated symbols)


data prep

date label features

(w/date ranges)max extent study area

selectedcounties

with pop density change (+/-)

C_DATETRACKID

4 days

quantities – graduated symbolsCHG_PERSONS_SQ_MILE

POS layer – Jenks (4)NEG layer – Jenks(3)

C_DATEGISJOIN

4 daysfeatures – single symbol

(for boundaries) state & territory

features

data preparationdata preparationD2 County Population Density (frozen boundaries)D2 County Population Density (frozen boundaries)


(2)create

atomic county features

(3)interpolate population

values

(4)dissolve

frozen county features

(5)calculate

populationdensity

(1)selectfrozen

county features

layerproperties

layerproperties


(1)selectfrozen

county features

max extent2000 countyfrom NHGIS

Clipselected

frozen counties

(2)createatomic

county features

Identity

selectedcounties

with population

atomiccounties

atomiccounties

with population

(3)interpolate population

values

Add FieldID_SQ_MILES

Add FieldP_ID_ORIG

Add FieldID_POP


Calculate Field[ID_SQ_MILES]/

[SQ_MILES]

Calculate Field [P_ID_ORIG] * [COUNTY_POP]

D2 County Population Density (frozen boundaries)


atomiccounties

with population

(4)dissolve

frozen county features

DissolveSUM fields:

ID_POPID_SQ_MILES

frozencounties

with population

(5)calculate

population density

Add FieldF_SQ_MILES

Add FieldF_DENSITY


Calculate Field[SUM_ID_POP]/ [F_SQ_MILES]

frozencounties

with population density

D2 County Population Density (frozen boundaries)

layer propertieslayer properties D2 County Population Density (frozen boundaries)D2 County Population Density (frozen boundaries)


data prep


county features without

population

date label features

max extent study area

C_DATEGISJOIN

1 dayfeatures – single symbol

(for boundaries)

frozen county features (f0)

features – single symbol(for all other boundaries)

frozen county features (f4)

withpop. density

C_DATEFRZJOIN

1 dayquantities – graduated colors

F_DENSITYJenks (7)

recommendationsrecommendationsMethodologyMethodology


data preparationdata preparation• download download aggregate aggregate select select

minimize time reformatting base dataminimize time reformatting base data maximize time using/evaluating maximize time using/evaluating formattedformatted base data base data

process developmentprocess development• batch processing available in ArcGIS 9.2 batch processing available in ArcGIS 9.2 • create model and ask…create model and ask…

““does it do the job for a does it do the job for a singlesingle feature class? feature class?”” ““does it automatically assign proper names to output?does it automatically assign proper names to output?””

• Yes Yes DONE DONE• No No export to Python; refactor; test in PythonWin export to Python; refactor; test in PythonWin

• small is goodsmall is good

recommendationsrecommendationsArcGIS – Tracking AnalystArcGIS – Tracking Analyst


feature labelingfeature labeling• provide date labeling capabilitiesprovide date labeling capabilities

created point feature class with datescreated point feature class with dates• provide full complement of label properties for temporal layersprovide full complement of label properties for temporal layers

data classificationdata classification• correct data exclusion problemscorrect data exclusion problems

playback managerplayback manager• handle speed without adjusting current datehandle speed without adjusting current date• correct data selection/data classification discrepancycorrect data selection/data classification discrepancy• handle extra empty frame at the end of animationshandle extra empty frame at the end of animations• allow users to modify time window for multiple layers at onceallow users to modify time window for multiple layers at once

recommendationsrecommendationsNational Historical GISNational Historical GIS


shapefilesshapefiles• add tracking date (e.g. 01/01/2000)add tracking date (e.g. 01/01/2000)

Tracking Analyst date fieldTracking Analyst date field• add year to GISJOIN (e.g. ‘G20005500170’)add year to GISJOIN (e.g. ‘G20005500170’)

link aggregated temporal features to aggregated attribute datalink aggregated temporal features to aggregated attribute data• add tracking identifiers (e.g. ‘T0950135’, ‘T20000950135’)add tracking identifiers (e.g. ‘T0950135’, ‘T20000950135’)

TRACKING_ID, PREV_TRACKING_IDTRACKING_ID, PREV_TRACKING_ID link features across time; link features to temporal neighborslink features across time; link features to temporal neighbors

metadatametadata• document minimum tolerance required to handle sliver polygonsdocument minimum tolerance required to handle sliver polygons

1 meter – for Identity tool1 meter – for Identity tool

web applicationweb application• simplify census data download for base data – simplify census data download for base data – Quick TablesQuick Tables

required required 2222 individual requests for county aggregate data individual requests for county aggregate data

questionsquestions

thank you!thank you!


references citedreferences cited Berman, L. (2002).

Simplified spatio-temporal data model for CHGIS. Unpublished manuscript.

Berman, L. (2003).Data model for historical GIS: The CHGIS time series. Unpublished manuscript

Gastner, M. T., Shalizi, C. R. & Newman, M. E. J. (2004). Maps and cartograms of the 2004 US presidential election results. Retrieved March

13, 2007, 2007, from http://www-personal.umich.edu/~mejn/election.

Harrower, M. (2002).Visualizing change: Using cartographic animation to explore remotely-sensed data.

Cartographic Perspectives, 39, 30-42.

Hunt, L. G., & Chambers, C. D. (1976). The heroin epidemics: A study of heroin use in the united states, 1965-1975. New

York: Spectrum.

Kuby, M., Harner, J., & Gober, P. (2004).Tracking the AIDS epidemic in the united states: Diffusion through space and time.

Human geography in action (pp. 61-83). New York: John Wiley & Sons.


thank youthank you



0950135 TRACKING_IDTRACKING_ID

0950135

select vs. classifyselect vs. classify

time windowtime window classes classes playback rateplayback rate featurefeature

20 years20 years0 to 10 Years0 to 10 Years

10 to 20 Years10 to 20 Years10 years10 years January 1, 1900January 1, 1900

selected on…selected on… classified as…classified as…

January 1, 1900January 1, 1900 0 to 10 years0 to 10 years

January 1, 1910January 1, 1910 10 to 20 years10 to 20 years

January 1, 1920January 1, 1920 NONENONE


temporal symbologytemporal symbology


Peak Heroin Use in the United States: 1968 to 1973 (Hunt & Chambers, 1976)

AIDS rates v distance from source node (Kuby, Harner, & Gober, 2004)

isochrony

multivariate

Historical Counties: Visualizing Change with Tracking Analyst MGIS Capstone Kevin Horne Advisor –...

Documents

Transcript of Historical Counties: Visualizing Change with Tracking Analyst MGIS Capstone Kevin Horne Advisor –...