Hack The Census, Unleash the Power of Data

19
Powering New Orleans Economic Benchmarks Alicia Brown April 13, 2016 hacking the Census API via FME

Transcript of Hack The Census, Unleash the Power of Data

Page 1: Hack The Census, Unleash the Power of Data

Powering New Orleans Economic BenchmarksAlicia BrownApril 13, 2016hacking the Census API via FME

Page 2: Hack The Census, Unleash the Power of Data

The Team

Data AnalystSocrata

Data AnalystSocrata

Program ManagerSocrata

Alicia Brown Daniella Kuttner Chris Rieth

Page 3: Hack The Census, Unleash the Power of Data

New Orleans Mission● Develop & Track performance goals● Benchmark Progress against comparable

cities● Validate findings using federal and 3rd party

data● Use FME to automate indicator data retrieval

Page 4: Hack The Census, Unleash the Power of Data

Census API● Census publishes American Community Survey

yearly● API provides data from 2011 - 2014● Example for Travel Time to work:

http://api.census.gov/data/2014/acs1?get=NAME,B08303_001E,B08303_002E,B08303_003E,B08303_004E&for=place:55000&in=state:22&key=YOUR_API_KEY

Page 5: Hack The Census, Unleash the Power of Data

Let’s look at the Workflow

Page 6: Hack The Census, Unleash the Power of Data
Page 7: Hack The Census, Unleash the Power of Data

Python Caller Transformer

Page 8: Hack The Census, Unleash the Power of Data
Page 9: Hack The Census, Unleash the Power of Data

Attribute Renamer

Page 10: Hack The Census, Unleash the Power of Data
Page 11: Hack The Census, Unleash the Power of Data

Calculate & Aggregate

Page 12: Hack The Census, Unleash the Power of Data
Page 13: Hack The Census, Unleash the Power of Data

Socrata Writer → data.nola.gov

Page 15: Hack The Census, Unleash the Power of Data

Parameters to handle future years

Page 16: Hack The Census, Unleash the Power of Data
Page 17: Hack The Census, Unleash the Power of Data

Lessons Learned● There is a limit of 50 variables for single call● Need to handle missing data for some

variables & geographies● The type of ACS year (1,3,5) is dependent on

the population size of a geographical area so that sample is representative of it

● Categorical measurements may change over years

Page 18: Hack The Census, Unleash the Power of Data

Thanks to Melissa with the City of New Orleans for giving us this amazing task!

Resources● ResultsNOLA● github.com/socrata/connectors/cen

sus● ACS 1 YR API documentation● census.gov/developers

Page 19: Hack The Census, Unleash the Power of Data

Open Data Superhero?

We’re hiring!careers.socrata.com/jobs

Want to become an