Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research &...
-
Upload
amberlynn-morrison -
Category
Documents
-
view
213 -
download
0
Transcript of Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research &...
![Page 1: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/1.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Paul KentVP SAS Platform Research & Development<[email protected]>
Forthcoming Changes in SAS
![Page 2: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/2.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Where do I come from?
New Hill, North Carolina
Y’all
Johannesburg, South Africa
Julle
Fareham, England
???
![Page 3: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/3.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
R & D :: Loyal Employees
![Page 4: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/4.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
R & D groups, and where I come from
Platform
Clients
Solutions• With Analytics
![Page 5: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/5.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
R & D groups, and where I come from
Platform
Clients
Solutions• With Analytics
![Page 6: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/6.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
What do we programmers do?
Gather Data
Organise Data
Arrange Data for consumption
Facilitate said consumption
Create understanding of Data
Promote understanding of said DataValue
![Page 7: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/7.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Power Reporting
Web Reporting
Information Delivery Framework
Information Consumers Domain Experts Power User
Business Analyst
InfoTech
Large% Small%
Web Report Viewing
Analytic Reporting
Who do we programmers do it for?Audience Continuum
Value
![Page 8: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/8.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Forthcoming Improvements in the SAS Foundation
ODS (and the new ODS statistical graphics)
SAS Database Storage capabilities
The Data Step and Proc SQL
Grid Computing Capabilities
Bits and Pieces
![Page 9: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/9.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
ODS Statistical Graphics
![Page 10: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/10.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Survival Plot Using PROC LIFETEST in SAS 8
J. Zhou, NESUG 2002
Three-page SAS program with macros
Use GPLOT and GREPLAY for graphics
Statistical Metadata
Overlaid Curves
![Page 11: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/11.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Statistical Graphics
Essential for modern data analysis
Difficult to create in SAS prior to SAS 9• Context lost when statistical procedure terminates
• Programmer must recreate context, metadata
Statistical procedures should automatically create graphics
Follow the 80-20 rule – 20% of these might need further tweaking, but for the most part…
![Page 12: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/12.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Life Is Easier in SAS 9 …ods graphics on;
ods html file="lifetest.htm";
proc lifetest data=surv;
time surv*censor(1);
survival plots=(survival hwb);
strata trt;
id patient;
run;
ods html close;
ods graphics off;
![Page 13: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/13.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
LIFETEST Procedure – Survival Plot
![Page 14: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/14.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
LIFETEST Procedure – HWB plot
![Page 15: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/15.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Usage of ODS Statistical Graphics in SAS 9
Experimental in 30 SAS/STAT and SAS/ETS procedures - SAS 9.1
Automates creation of commonly used graphical displays for a particular analysis
Production in SAS 9.2
![Page 16: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/16.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
PROC GLM
![Page 17: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/17.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
PROC GLM (ANCOVA)
![Page 18: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/18.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
GAM Procedure
![Page 19: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/19.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
HPF Procedure
![Page 20: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/20.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
KDE Procedure
![Page 21: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/21.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
KDE Procedure
![Page 22: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/22.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
LOGISTIC Procedure
![Page 23: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/23.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
MIXED Procedure
![Page 24: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/24.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
MIXED Procedure
![Page 25: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/25.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
PHREG Procedure
![Page 26: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/26.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
PLS Procedure
![Page 27: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/27.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
PRINCOMP Procedure
![Page 28: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/28.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
REG Procedure
![Page 29: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/29.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
TIMESERIES Procedure
![Page 30: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/30.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
UCM Procedure
![Page 31: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/31.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Integration with ODS Styles Over 30 different styles
New style elements for statistical graphics• Fitted line
• Confidence lines and bands
• Prediction Lines
• Outliers
• Classification groups
![Page 32: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/32.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Style Demonstrationods html file=“robustreg.htm” style=journal;
ods graphics on;
title “Journal Style”;proc robustreg data=mydata plot=all;
model y = x1 x2 x3;run;
ods html close;
Journal Analysis Default Statistical
(only Summary Statistics and Residual Histogram output shown)
![Page 33: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/33.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Summary
Goal is to automate creation of graphics by statistical procedures• Minimum work for user
• Maximum built-in functionality
Experimental in SAS 9.1
Production in SAS 9.2
![Page 34: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/34.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
SAS Transactional Storage(aka SAS Database Capabilities)
Demo Time
1. Color_table• Remember to start your TableServer
2. Customers• Remember to start your AppServer (tomcat5)
![Page 35: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/35.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
SAS Transactional Storage(aka SAS Database Capabilities)
A more traditional Database Capability
From SAS. (not oracle, ibm, or microsoft)
Based on OpenSource “Firebird”
Real Datatypes – INT, MONEY, VARCHAR
Real Connectors – JDBC, ODBC, SAS Libname
Real Transactions – Rollback and Commit
MultiUser Server
![Page 36: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/36.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
What’s New in SAS Grid Automation
Cheryl DoningerR&D Director, Grid Development
Roger ThompsonRelationship Manager
Merry RabbProduct Manager, Grid
![Page 37: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/37.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Grid Computing Market Size & Growth
Rapid Adoption of Grid Computing Based on Benefits
![Page 38: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/38.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Grid Adoption is Increasing
A high percentage of firms using analytical
applications are considering grid
2/3 of firms surveyed are using or
considering grid technology
![Page 39: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/39.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Benefits of Grid Computing
Faster results
More executions – more data
Time to recover from errors
Better use of resources
Virtualize resources
Incremental IT spend
![Page 40: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/40.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Types of Applications Suitable for Grid Long running
Many replicate runs of same fundamental task• simulation (what if analysis)• optimization (testing lots of scenarios)• BY GROUP processing• data segmentation
Independent tasks running against large data sources• scoring – risk analysis• multiple procedures and data steps
![Page 41: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/41.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
SAS Grid Strategy
Infrastructure benefits SAS applications• large data / complex algorithms
Focus areas• Development
• Run-time
• System management
Incremental Releases
![Page 42: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/42.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
SAS Grid Roadmap Phase I
SAS 8.2 functionality• %Distribute
• SAS/CONNECT
• SAS log
![Page 43: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/43.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
SAS Grid Success Stories
Texas Tech University
Statistics Canada
Large Pharmaceutical Company
![Page 44: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/44.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
SAS Grid Roadmap Phase II
SAS 9.1.3 Q3/2005 functionality• smarter engines for SAS IDEs
• SAS/Platform integration
• SASMC monitoring
![Page 45: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/45.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Business Analytics - Enterprise Miner on SMP
![Page 46: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/46.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Business Analytics - Enterprise Miner on Grid
![Page 47: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/47.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Data Integration – ETL Studio on SMP/Grid
![Page 48: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/48.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Data Integration – ETL Studio on SMP/Grid
![Page 49: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/49.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
SAS Stored Process
Business Intelligence – Enabled on SMP/Grid
SAS Program
ETL Studio
Enterprise Miner
Web Services
![Page 50: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/50.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Grid Manager Plugin – job view
![Page 51: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/51.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Grid Manager Plugin – host view
![Page 52: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/52.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
SAS 9 Grid Computing Components
SAS Applications
Piping
Distribution
Session Spawning
Grid Enabled Code Generation
NEW September 2005 Multi-Processor SAS
Multiple Components Working Together to Provide Grid Computing
SAS 9 Grid Computing
Grid Manager Plug-in
Platform Suite for SAS
Grid Monitoring
Grid Management
Job Termination
Dynamic Load Balancing
Job, Queue & Host Management
Enterprise Miner Stored Processes Data Integration
SAS Connect
![Page 53: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/53.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
General Layout of a SAS Grid
Client Machine
Metadata Server
Grid Control Machine
Grid Node
Grid Node
Grid Node
…
nSAS Grid
Machine Grid Mgr plugin
Platform Suite for SAS
LSF
LSF
LSF
SAS ETLSAS EMSAS Foundation
![Page 54: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/54.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Grid Work Flow…
n
Node1
Node2
Node3
Node1 ! ! 1 () (SASMain)
Node2 ! ! 1 () ()
Node3 ! ! 1 () (SASMain)
…
LSF Cluster File
SASMain – Server Context
Platform Server Component
sas -noobjectserver
SASServers
Metadata Server
Workspace Server
Connect Client
LSF
SAS MC
SAS Metadata
session resource sascmd wl options------------------------------------------------- p1 SASMain sas –noobjectserver
grdsvc_enable(p1, “resource=SASMain”);
ETL Studio
Enterprise Miner
signon p1;
![Page 55: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/55.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Partitioning the Grid…
n
EM grid
ETL grid
Node1
Node2
Node3
Node1 ! ! 1 () (SASMain,EM)
Node2 ! ! 1 () (SASMain,EM,ETL)
Node3 ! ! 1 () (SASMain, ETL)
…
LSF Cluster File
Metadata Server
Workspace Server
Connect Client
LSF
SAS MC
SASServers
SASMain – Server Context
Platform Server Component
sas –noobjectserver
EM, ETL
SAS Metadata
ETL Studio
Enterprise Miner
session resource sascmd wl options-------------------------------------------------------------------------- p1 SASMain sas –noobjectserver ETL
grdsvc_enable(p1, “resource=SASMain, workload=ETL”);signon p1;
![Page 56: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/56.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Grid Provides: Speed and Efficiency
![Page 57: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/57.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Analytics are working, so people…
Build more models• For successively refined segments of customers
Use more data in those models
Integrate the results into operational systems• <near real time>
A SAS9.2 datastep movie
![Page 58: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/58.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Implications
More Multi thread enablement within SAS
Yes, even the DATA STEP
Saved Programs
Multi Threaded Server Capabilities• Same model, parallel data for thruput
• Many models, same data – one off scores in operational systems
Models Management can deploy models to “score servers” without restarting them
![Page 59: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/59.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Bits and Pieces
Reverse Engineer SAS jobs
Checkpoint and Restart SAS jobs
Encode (and protect) your SAS jobs
ZIP functions
CRC …
![Page 60: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/60.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 61: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/61.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Protect your IP
PROC SCRAMBLE
file=‘myfile.sas’
outfile=‘secret.sas’ <expire=> <site=> …
;
Send secret.sas to your customers
%include ‘secret.sas’; • Implies nosource; your macros can reset NOMPRINT…
![Page 62: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/62.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Checkpoint/Restart andParallelization Featuresin the Core SupervisorRick Langston, Core Systems Department
![Page 63: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/63.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Checkpoint/Restart
Craig R.’s request as per user community
Job fails – want to restart where it left off
ETL Studio also wanted a restart facility
![Page 64: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/64.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
A simple solution
Record a checkpoint number, save it in WORK
If restarting, skip PROC / DATA steps to there
Tokenize everything
Execute all global statements
![Page 65: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/65.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
To set up for checkpointing
Use NOWORKINIT, NOWORKTERM
Have WORK refer to a permanent directory
Use the CHECKPOINT option
![Page 66: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/66.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Subsequent restarting
Again use NOWORKINIT, NOWORKTERM
Again use WORK to the permanent directory
Use the RESTART option
Job will restart as of the last successful step
![Page 67: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/67.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Is this what users want?
We can’t do this without user being proactive
data temp / set temp issues
skipped steps may need to be executed
Output files (flat files – DISP=MOD, databases…)
![Page 68: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/68.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
EXECUTE_ALWAYS
CHECKPOINT / EXECUTE_ALWAYS;
Use it for a step that must be executed
For example, SYMPUT and CALL EXECUTE
![Page 69: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/69.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 70: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/70.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Example
Using options debug=‘checkpoint-implicit’;
Option names still to be decided
![Page 71: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/71.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 72: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/72.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 73: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/73.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
data temp1; x=1; run;
data temp2; x=2; run;
data temp3; x=3; run;
data _null_;
if "&sysparm."="1"
then abort abend 999;
run;
data temp4; x=4; run;
![Page 74: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/74.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Invoke once with checkpoint-implicit
Then reinvoke with restart-implicit
![Page 75: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/75.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 76: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/76.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Additional info
Planned for 9.2
Option names still being decided
Wanting additional input
![Page 77: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/77.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Parallelization Efforts
Reading in arbitrary SAS code
Producing metadata in comments
This could be post-processed by ETL Studio
This could be post-processed by Grid Computing
![Page 78: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/78.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Parallelization Efforts
Researching so far
Hooks in dependency opens
Catalogs, flat files, SAS data sets, etc.
Emitting info in comments
Example of use
![Page 79: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/79.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 80: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/80.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 81: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/81.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 82: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/82.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 83: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/83.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
![Page 84: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/84.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Exposure to User
New option, such as DEPMETA=fileref
SAS program with comments written to this file
![Page 85: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/85.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Questions/comments?
![Page 86: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/86.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Ideas for the Future!
How can the software learn?
So the user doesn’t have to learn about the software; they can learn the business!
Some future ETL studio JOB• Remembers data volumes from last weeks run
• Uses that memory to choose a better strategy
![Page 87: Copyright © 2004, SAS Institute Inc. All rights reserved. Paul Kent VP SAS Platform Research & Development Forthcoming Changes in SAS.](https://reader030.fdocuments.us/reader030/viewer/2022032804/56649e585503460f94b50f26/html5/thumbnails/87.jpg)
Copyright © 2004, SAS Institute Inc. All rights reserved.
Your Turn!!
You tell me next time SAS forgets something it should have remembered
And why remembering that would help SAS improve next time
Thanks for listening!