Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for...
Transcript of Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for...
![Page 1: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/1.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
Interagency Data Team
January 23, 2019
![Page 2: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/2.jpg)
CUSTOMER SERVICE. ACCOUNTABILTY. EFFICIENCY. SECURITY.
WELCOME, AGENDADATA TEAM NEWS
Michael BentivegnaData Visualization and Analysis Program Manager
Office of the Chief Technology Officer
![Page 3: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/3.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
AGENDA• Welcome, News & Updates
Michael Bentivegna, Data Visualization and Analysis Program ManagerOffice of the Chief Technology Officer
• New GIS Database & Affects to Existing ApplicationsMario Field, Data Curation Program ManagerOffice of the Chief Technology Officer
• Enterprise Data Inventory in ProgressEva Reid, Data Visualization and Analysis Senior AnalystOffice of the Chief Technology Officer
• Data Stewardship & IT Contract Language for Data CollectionJames Graham, GIS and Applications ManagerDistrict Department of Transportation
• Mayor’s Opendata.dc.gov Analytics Hub Pages Alex Santos, Enterprise Mapping GIS IT SpecialistOffice of the Chief Technology Officer
![Page 4: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/4.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
BUSINESS INTELLIGENCE SOFTWARE UPDATES
• Tableau Production version 2018.1.1
• Major upgrade to move to 2018.3• Setting up test servers for the migration
• Targeting the end of February for the upgrade
• Hold off on Desktop upgrades (keep at 2018.1.x if publishing to the server)
• Architecture review session• Sized appropriately and have room for growth with best practices
• Feed back: clean up unused data/work books, use more incremental extracts, 7 am schedule bottleneck. Will be reaching out to select agencies.
• Tableau Public w/automated ETL updates • Hyper not currently supported by Informatica Tableau extension at this time
• Box plug-in will be tested as a public data source
• Tableau Site Administrators Quarterly meetings• First meeting will be held later in this quarter (date TBD)
![Page 5: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/5.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
BUSINESS INTELLIGENCE SOFTWARE UPDATES
• MicroStrategy Production Version 10.11 • Public MicroStrategy Environment (expected end of February)
• Moving MicroStrategy Web servers from Linux to Windows (WebLogic to IIS) – testing done, migration steps planning
• Created public facing MicroStrategy web servers, back end integration is underway.
• MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed.
• New physical servers with more CPU power and memory in the final stages of deployment as the MicroStrategy Production servers, expected FY19 end of Q2.
• Self services BI Best practices guideline including security.
• Beta Testing with DGS
![Page 6: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/6.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
GIS SOFTWAREDC AGOL – ARCGIS ONLINE/PORTAL
• ArcGIS Server Upgraded to version 10.6
• 10.6.1 being tested
• Streaming services
• ESRI GeoEvent will be in production @10.6.1
• Apache Kafka® distributed streaming platform –real time IOT Streaming data (FY 19 Q2 production)
• ArcGIS Portal version at 10.6.1
![Page 7: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/7.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
BI TRAININGHTTPS://OCTO.IN.DC.GOV/PAGE/GIS-AND-BI-APPS-AND-SERVICES
• Tableau Intro & Intermediate (Eventbrite – search Tableau)
• Introductory training (February is wait listed)
• March 20 and 21
• April 3 and 4
• Intermediate training (February is wait listed)
• March 26 and 27
• April 10 and 11
• MicroStrategy Intro Classes (Eventbrite – search MicroStrategy)
• February 12 and 13
• March 12 and 13
• April 30 and May 1
• May 28 and 29
![Page 8: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/8.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
GIS TRAINING
• GIS (PeopleSoft – request training – Search by name “GIS” or course number)
• 230 Overview DC GIS Services February 6, April 10th, May 8th, September 11th
• 233 ArcGIS Online Virtual Sessions to be scheduled in the near future.
• ArcGIS Pro training is under development
• ESRI Federal User Conference (Jan. 29th -30th) https://www.esri.com/en-us/about/events/federal-gis-conference/overview
![Page 9: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/9.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
NEW GIS DATABASE & AFFECTS TO APPLICATIONS
Mario Field, Data Curation Program Manager
Office of the Chief Technology Officer
![Page 10: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/10.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
GIS 2.0 STATUS• Built 2.0 Database Framework
• Setting up FME infrastructure
• Production database on Exadata
• Map services published to AGS 10.6
• Live database Available 3/31/19
![Page 11: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/11.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
GIS 2.0 ARCHITECTUREGEODEV• GIS development database• Versioning, archiving, replication, editor
tracking, standardization• Only geospatial layers• Agency Editing
GEOTEST• GIS Testing database\
GEOPROD (Exadata)• GIS Production/Publication database
FMEReplication
![Page 12: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/12.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
GIS 2.0 ATTRIBUTION RULESOLD COLUMN NAME NEW COLUMN NAME ACTIONADDRID MAR_IDADDRESS_ID MAR_IDADDR_ID MAR_IDX XCOORDX_COORDINATE XCOORDPOINT_X XCOORDY YCOORDY_COORDINATE YCOORDPOINT_Y YCOORDWEB_URL note it as in layerWEBURL note it as in layerURL note it as in layerLAT LATITUDELONG LONGITUDENAME if no name is present in table, note itADDR ADDRESSADDRES ADDRESSLOCATION ADDRESSDESCRIPTIO DESCRIPTIONDIFFX removeDIFFY remove
![Page 13: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/13.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
GIS 2.0: SCREENSHOTS
![Page 14: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/14.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
OPEN DATA HANDBOOK
![Page 15: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/15.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
DATA SUBMISSION PROCESS
Preparation (AGENCY AND OCTO): Initiate and document submission
Consultation (AGENCY AND OCTO): Work with Customer to finalize submission
Curation (OCTO): Perform QA/QC, Data Transformation, Metadata, and Testing
Publication (OCTO): Publish Data
![Page 16: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/16.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
DATASET RULES
![Page 17: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/17.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
METADATA
![Page 18: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/18.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
ENTERPRISE DATA INVENTORYPROGRESS
Eva Reid, Data Visualization and Analysis Senior Analyst
Office of the Chief Technology Officer
![Page 19: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/19.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
![Page 20: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/20.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
DATA STEWARDSHIP & IT CONTRACT LANGUAGE FOR DATA COLLECTION
James Graham, GIS and Applications ManagerDistrict Department of Transportation
![Page 21: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/21.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
MAYOR’S OPENDATA.DC.GOV HUB PAGES
Alex Santos, Enterprise Mapping GIS IT SpecialistOffice of the Chief Technology Officer
![Page 22: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/22.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
• Request for,
• Economic Development
• Housing
• Education
• Public Safety
• Environment
• Transportation
• An exercise in using existing content
1. Quick Stats with Open Data Cards
2. Analytics using Tableau, MicroStrategy & ArcGIS Online
3. Existing Web Apps
4. Highlighted Data (data.dc.gov, dc.gov…)
5. DC Programs for Residents
![Page 23: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/23.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
• DMPED Econ Intelligence Dashboard
• OSSE School Report Card(next get this into data.dc.gov)
• DDOT UFA / VZ / Circulator
• Data.dc.gov
• MPD Crime Cards
![Page 24: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/24.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
• http://opendata.dc.gov/pages/mayor-housing
• -economic-development
• …
![Page 25: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/25.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
LEARNED…
• Inconsistent field types
• Check statistic results
• Tableau embeds
• Large dashboards
• More ArcGIS Insights
![Page 26: Interagency Data Team Meeting - Washington, D.C. · • MicroStrategy integration guidelines for imbedding analytics in Agency websites and SharePoint developed. • New physical](https://reader034.fdocuments.us/reader034/viewer/2022042119/5e992e678e7cb36a5421571b/html5/thumbnails/26.jpg)
CUSTOMER SERVICE. ACCOUNTABILITY. EFFICIENCY. SECURITY.
OPEN DISCUSSION
NEXT MEETING TENTATIVELY SCHEDULED FOR MARCH 2019
THANK YOU