SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT)...
Transcript of SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT)...
![Page 1: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/1.jpg)
SAS Visual Analytics
at Statistics Canada (Statcan)
Cheryl Wang
Statistics Canada, Ottawa
November 17 2016
![Page 2: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/2.jpg)
Agenda
Data Visualisation (DV) Business @Statcan
SAS VA & Existing SAS@Statcan
Statcan SAS VA Architect
Statcan SAS VA with SAS Grid
Statcan SAS VA Deployment
Utilization of Statcan SAS VA
Business to Operation
Examples
![Page 3: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/3.jpg)
Data Visualisation Business @Statcan
Canada’s central statistical agency
Mandate to collect, compile, analyse and publishstatistical information on the economic, social and general conditions of the whole country and its citizens
300+ Surveys: Census (every 5 years), Labor Force, Consumer Price Index, Systems of National Accounts
![Page 4: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/4.jpg)
DV Business @Statcan (Cont’d)
Collection: progress, schedule, response rate, work load
Processing: QA resulting data; alert; drill down
Analysis: summary, tables, charts, regression, variance
Dissemination: KPI, Map Charts, tables and charts
Other: Visualised Reports for HR, Finance, etc.
Large amount of data, large # of users & DV business cases
An Enterprise Solution / Platform: SAS VA with Existing SAS@Statcan
![Page 5: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/5.jpg)
Processing
SAS VA with Existing SAS@Statcan
Collection Dissemination
SAS VA & SAS Grid & SAS Servers
(high performance / availability / scalability / security)
Survey Lifecycle
Analysis
![Page 6: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/6.jpg)
Statcan SAS VA Architect
SAS EG
Management Console
![Page 7: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/7.jpg)
Statcan SAS VA with SAS Grid
Clients
SAS Grid
SAS VA
NFS
CFS/Projects
CFS/Projects
VA HUB
- Management Console- Putty
- FileZilla- SAS EG- MSOffice Add-in- Other BI clients
GIS
Servers
![Page 8: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/8.jpg)
Statcan SAS VA Deployment
SAS VA Version 7.2
No Hadoop, non-distributed, no mobile BI
All tiers on single virtual Linux server with
12 cores; 205 GB memory; 291 GB local disk storage
SAS Grid projects folders mounted to VA server (NFS)
Built by SAS Admin with SAS consultant; single sign-on
Supported by SAS Admin and SAS VA team
Only available on internal Statcan intranet
![Page 9: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/9.jpg)
Utilization of Statcan SAS VA
Since Oct 2014, for learning, research, prototyping,
evaluation, decision making purposes
Promote VA into key business areas: Census, National Accounts,
Income Statistics, Consumer Prices, Data Warehouse
Create polices and guidelines: roles and responsibilities (users,
power users, VA team, SAS admin); metadata folder structures; change
management process; communications; governance
Solve technical challenges: bilingualism, customized geographic
maps (ArcGIS map service), autoLoad, formats, other data source,
APM, EV, etc.
![Page 10: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/10.jpg)
Utilization of Statcan SAS VA (Cont’d)
Integration with other SAS products: SAS EG, MS Office
Add-in, SAS Stored Process, etc.
Automation, batch process, scheduling
Real time reports: refresh data frequently or on demand
Sharing and distribution
Advanced Visual Statistics: Linear Regression, Logistics
Regression, Linear model, Decision Tree, Clustering
Integration with existing SAS environment: non-grid SAS
servers
![Page 11: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/11.jpg)
Business to Operation
Step1: Business needs & modeling (IT&User)
Step2: Build VA-ready data outside SAS VA (IT&User)
o SAS Grid/SAS Servers/Local SAS
o Other processing environments (SQL Server, Oracle, C, etc.)
Step3: Build project specific operational environments
on SAS VA server
o LASR servers (metadata, instance, configuration)
o Project folders at OS level, metadata level
o Project templates and policies
![Page 12: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/12.jpg)
Business to Operation (Cont’d)
Step4: Load VA-Ready Data into LASR server (IT)
o Importing from raw source (dev, exceptions only)
oReload-Unload (source meta -> LASR meta: Predefined relations)
o Auto load (meta folders and auto load configurations)
Step5: Conduct Visual Analytical Tasks in VA (users & IT)
oData Building (Users & IT)
o Building Reports(IT & advanced users)
o Exploration, view, alerts; comments, discussions (users);
![Page 13: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/13.jpg)
Example 1: Hierarchical Map Charts
Province_city_postcode_population
· Province: SAS internal code
· City: Character
- City_latitude: Numeric
- City_longititude: Numeric· postcode:Character - post_latitude: Numeric - post_longititude: Numeric· Demo_population: Numeric
![Page 14: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/14.jpg)
![Page 15: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/15.jpg)
Statcan VA Reports - Examples
![Page 16: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/16.jpg)
Statcan VA Reports - Examples
![Page 17: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/17.jpg)
Example 2 – Dashboard
Population_ISB
· OEID: Character
· NAICS: Numeric
· Province: Character
· StatisticalAreaClassification: Character
· ProfiledRevenue: Numeric· GSTSales: Numeric· IncomeTaxRevenue: Numeric· Year_Birth: Date
…...
![Page 18: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/18.jpg)
Dashboards
![Page 19: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/19.jpg)
![Page 20: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/20.jpg)
21/11/201620 Statistics Canada • Statistique Canada
![Page 21: SAS Visual Analytics at Statistics Canada (Statcan)Step4: Load VA-Ready Data into LASR server (IT) oImporting from raw source (dev, exceptions only) oReload-Unload (source meta ->](https://reader033.fdocuments.us/reader033/viewer/2022051804/5feedde34cf513365928f55c/html5/thumbnails/21.jpg)
Pierre Lafrance
Assistant Director
Yves Deguire
Senior Technical Advisor
Étienne Rouette
Section Chief
Joel Orr
Team Leader, SAS Admin Group
Cheryl Wang
Team Leader
SASTC VA Working Group
SAS VA Evaluation Users
SAS VA Star Team @ Statcan
Questions?