The future of the SAS Platform - SAS 9 & SAS Viya · Following are several examples of SAS 9.4M4...
Transcript of The future of the SAS Platform - SAS 9 & SAS Viya · Following are several examples of SAS 9.4M4...
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS® USER FORUMDENMARK 2017
The future of the SAS Platform - SAS 9 & SAS ViyaGert Nissen
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS 9 & SAS Viya
SAS codePhytonJavaRLuaRest API
SAS® Visual Data Mining
and Machine Learning
SAS® Visual Investigator
SAS® Visual Analytics
SAS® Visual Statistics
SAS® Visual Forecasting
SAS® Optimization
SAS® Econometrics
?Torben Juul Astrid Mads
Keld & Daniel
Carl-OlowGert Nissen
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Platform Vision
What is going onin the market?
Where are we headed? How do we get there?Where are we today?
Information is subject to change!
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Pervasive Access Providing advanced data management capabilities for SAS solutions and beyond.
Comprehensive Governance Managing, monitoring, and controlling data activity on-premises and in the cloud.
Enterprise Ready Building in security, scalability, and flexibility for the most demanding customers.
Intelligent Data Employing new data quality, discovery, and analytic techniques for deeper data insights.
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS® USER FORUMSWEDEN 2017
SAS® Viya™
Unifying our architecture
SAS®
High-Performance
Architecture
Development Timelines
SAS®
In-Memory
Analytics Server
SAS®
Massively Parallel
Architecture
SAS®
MVA architecture
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Kun på Cloud
Alle data skal loades tilMemory
SAS Viya Myths
Ingen Metadata
Kun Advanced Analytics, ikkeData Management
Kun Open Source kode, omkodning af gamle SAS programmer
Kun peg-og-klik, ingen SAS kode
Ikke bagud kompabitelmed SAS 9
Copyr ight © SAS Inst i tute Inc. Al l r ights reserved.
In-p
lace
/Em
bed
ded
,P
aral
lel&
Ser
ial,
Web
Ser
vice
s, M
Qs
Source-basedEngines
Microservices
UAA
QueryGen
Folders
CAS Mgmt
Data Source Mgmt
AnalyticsGUIs
etc…
BIGUIs
EnvMgr
ModelMgmt
Log
Audit
UAAUAA
Data Mgmt GUIs
In-Memory Runtime Engine
In-Database
In-Hadoop
In-StreamSolutions
APIs
Platform
Analytics
Data ManagementFraud and Security Intelligence
Business VisualizationRisk Management
!
Customer Intelligence
Cloud Analytics Services (CAS)
The following operating systems are supported now: • Red Hat Enterprise Linux 6.7 (64-bit) and later within 6.x • Red Hat Enterprise Linux 7.1 and later within 7.x • Oracle Linux 6.7 and later within 6.x • Oracle Linux 7.1 and later within 7.x
SAS 9.4
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Viya Platform
Cloud ready– But not Cloud only!
– On premise now!
• Resilient, high-availability with failover Protection• Centralized, governed and easy• Automated scaling and elastic processing• Fault tolerant environment crafted for• analytics workload processing• Sophisticated and native search built into
products
Single code portability for enterprise deployment options (e.g. grid, cloud, single cluster, multiple cluster, etc.).
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
• Fault tolerance on the CAS server detects when a node no longer operates and distributes that node’s work to other nodes.
• Processing occurs in CAS server sessions and not in server processes, enabling CAS session monitoring, resource tracking, and resource management.
• In-memory tables can have local (session) or global scope. • The CAS server is able to continue to process tables when memory capacity is exceeded. • All table operations are performed in a in-memory space (caslib) to hold tables, access control lists,
and data source information. • PROC CASUTIL is a new procedure to manage CAS server tables, including loading and saving tables.
Data in tables can be loaded serially or in parallel. • The CHARACTER data type in SAS 9 uses byte semantics and supports fixed widths. The CAS server
supports the VARCHAR data type, which uses character semantics and varying length variables. • The SAS Analytic procedures and the DATA step have been rewritten for parallel processing in
multiple cores or server nodes. The DATA step has some language element restrictions.
How the CAS server works
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Viya REST API
curl -n -u uID:passwd -X GET http://< machine >:8777/cas/sessions
filename in url 'http://<myserver>:8777/cas/sessions' debug user='userID' pass='password';
filename map '/opt/sas/viya/config/user.map' ;
libname in json map=map automap=replace;
data all;
merge in.root
in.idleTime;
run;
proc print data=all;
title 'display of current sessions, showing length of time since last CAS action';
title2 'and total number of CAS actions run in this session';
var uuid name user actioncount isidle hours minutes seconds;
run;
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Viya Authentication
User and group identities are stored and managed by your organization’s identity provider (for example, Microsoft Active Directory). Read-Only access to the provider enables SAS to authenticate users and obtain identity information at sign-in. You can also add users to custom groups that are persisted in SAS Viya.
SAS Environment Manager 2.5 (9.4) uses roles and capabilities to manage authorization to SAS 9.4. SAS Environment Manager 3.1 (SAS Viya) uses rules to manage general authorization (access to objects such as folders and reports) and permissions to manage CAS authorization (access to CAS objects such as caslibs and tables).
Direct LDAP or single sign-on using Integrated Windows Authentication (IWA), Open Authorization (OAuth), or Security Assertion Markup Language (SAML).
Pluggable authentication module (PAM) validates the user’s credentials when accessing SAS Studio
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Viya Custom Groups
The following custom groups are provided with your deployment. These groups provide an easy way to give users and groups access to the appropriate data, content, or functionality.
A custom group is a group that exists in SAS Viya but not in your identity provider. Your deployment includes a set of predefined custom groups, which provide an easy way to give users access to specialized functionality. You can also create your own custom groups, which are useful if you don’t want to (or don’t have permission to) create groups in your identity provider.
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Viya Logging SAS Viya microservices and web applications
Each microservice and web application used in SAS Viyaproduces its own log. Logging levels for each microservice and web application are set in SAS Environment Manager.
SAS Viya serversSAS Viya servers use the SAS logging facility to generate and process log messages. The logging facility enables you to define aspects of logging such as the level of messages that are written to the log, the message format, and the output destination for the log.
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Viya Monitoring
SAS Viya provides monitoring functions through several facilities. Use the monitoring system that matches your needs and your environment:
• SAS Environment Manager is a graphical enterprise web application that provides functions for monitoring the nodes and microservices in a SAS Viya environment. It provides two interfaces for monitoring your environment
• CAS Server Monitor is a graphical web application that is embedded in the CAS server. It provides system-level monitoring for the machines and processes running under the CAS server.
• Grid Monitor provides histograms to view CPU load, memory usage, disk usage, and network performance for each CAS node. Grid Monitor provides a higher level of detail than SAS Environment Manager or CAS Server Monitor
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Viya EncryptionEncryption is the aspect of security that protects data by converting it into an unintelligible form in transmission or in storage.
For data in motion in a new deployment, TLS security is provided and follows the highest standards. At installation SAS Viya provides self-signed certificates to provide HTTP and HTTPS access to SASHomeout of the box. You can increase the encryption strength and coverage by completing additional configuration.
For data at rest in a new deployment, encryption is not automatically enabled. You can configure encryption of data that is added to PATH, HDFS, and DNFS caslibs. SAS Cloud Analytic Services supports encryption of SASHDAT files at the file level and at the directory level.
For more information, see the following documents: Encryption in SAS Viya: Data in MotionEncryption in SAS Viya: Data at Rest
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS 9 Data to SAS ViyaHere are some approaches to accessing SAS 9 data from the SAS Viya platform: • If you have the SAS Visual Analytics 8.1 web application, you can use self-service
import. • If you have SAS Environment Manager 3.1, you can use that web application to add
caslibs and load data. • If you have the SAS Viya 3.2 programming interfaces, you can write code to load data. • If you have SAS/CONNECT for SAS 9 and SAS Viya, you can move and share data
between SAS 9 and SAS Viya environments. • If you have SAS Enterprise Guide or SAS Add-In for Microsoft Office 7.13 or later, you
can use the Upload to CAS task to move data from SAS 9 to CAS.SAS Viya uses UTF-8 always. Manual conversion might needed if automated conversion fails.
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS code i SAS Viya
Data-step code runs out of the box in SAS Viya - Distributed automatically in SAS Viya
PROC SORT - Comment out, it is not required for GROUP BY processing
Majority of Proc SQL code can be converted to Proc FedSQL
Today: not every proc etc is available in SAS Viya – that will change!
Extended with CAS actions – proc CAS, proc CASUTIL and new procs
Copyr ight © SAS Inst i tute Inc. Al l r ights reserved.
&SAS Viya
SAS 9
one SAS platform
SAS platform strategy
Copyr ight © SAS Inst i tute Inc. Al l r ights reserved.
SAS Viya products and UIs
Customer-written code
Customer-written code
SAS 9.4 M4 products and UIs
SAS 9.4 M4
LASR and / or HPA runtimes
Metadata (WIP)-based mid-tier
MVA runtime
(full functionality)
Other runtimes
(ESP, In-Database)
SAS Viya
CAS runtime
Today’s architecture
SAS/CONNECT SAS/CONNECT
Microservices-based mid-tier
Viya MVA runtime(minimal
functionality)
“bridge” to SAS Viya
Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
Following are several examples of SAS 9.4M4 solutions that contain user interface features that you can use to issue SAS/CONNECT statements to bridge the SAS 9.4M4 and SAS Viya environments:
SAS Enterprise MinerFrom your SAS Enterprise Miner process flow diagram running on SAS 9.4, you can remotely submit SAS Data Mining and Machine Learning procedures to run in SAS Viya and then return the results to SAS 9.4 and integrate them into the SAS Enterprise Miner output.
SAS Model ManagerYou can run SAS Data Mining and Machine Learning procedures and train models in your SAS Viya environment, and then upload the models and the models’ metadata to SAS 9.4. From SAS 9.4, you can remote submit code to register the SAS Viya created model and metadata in SAS Model Manager. You can use SAS Model Manager to manage both your SAS 9.4 models and your SAS Viya models. For example, you can use SAS Model Manager to deploy score code derived from both SAS 9.4 and SAS Viya models to a database.
SAS Data Integration StudioYou can use SAS Data Integration Studio on SAS 9.4 to perform tasks such as fetching data from multiple sources and preparing the data for mining. Then, you can use the Data Transfer node to upload the data table to SAS Viya and load it directly into memory.
SAS Enterprise Guide / SAS Add-In for Microsoft OfficeYou can use the custom code nodes in either of these products to upload or download data between the two environments. For example, you could remote submit code to SAS Viya for processing, and then return the computational results back to SAS Enterprise Guide on SAS 9.4.
SAS StudioYou can use the SAS Studio web interface to perform many programming actions in SAS Viya. For example, you could enter code in SAS Studio to access data in your SAS Viya environment, remotely submit SAS Viya procedures to run on the data, and then transfer the results data between the two environments.
SAS Stored ProcessesYou can save SAS/CONNECT SIGNON, RSUBMIT, UPLOAD, and DOWNLOAD statements as SAS Stored Processes, and then use the SAS Stored Processes as another way to bridge your SAS 9.4 and SAS Viya environments.
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS 9 / Viya Convergence Timeline
17q4
Viya 3.3Viya 3.1
16q3
Viya 3.2
17w12
9.4M5
17q316q4
20189.4M4
WE ARE
HERE
TODAY
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Information is subject to change.
ReleaseHighlights
Q3
2017
SAS 9.4 – Products• 9.4M5
– Programming client integration with CAS– New CAS-enabled PROCs
• SAS Studio 3.7– New analytic tasks
• Enterprise Guide 7.15– Support SAS Studio Viya tasks and VA 7.4 reports
• SAS Environment Manager 2.6
• Support for– Advanced Analytics 14.3– SAS Enterprise Miner– SAS Data Integration Server 4.903– SAS Grid Manager– …
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Information is subject to change.
H1 | 2017 H2 | 2017 H1 | 2018SAS Viya 3.2
– SAS Visual Analytics 8.1
– SAS Visual Statistics 8.1
– SAS Visual Data Mining & Machine Learning 8.1
– SAS Visual Forecasting
– SAS Econometrics
– SAS Optimization
– SAS Visual Investigator 10.2
– SAS Visual Scenario Designer 10.2
– SAS Event Stream Processing
– In-Database Technologies
– SAS Studio
SAS Viya 3.3
– SAS Data Preparation– SAS Data Quality – SAS Visual Analytics 8.2– SAS Visual Statistics 8.2– SAS Visual Data Mining & Machine Learning 8.2– SAS Office Analytics – SAS Visual Forecasting– SAS Econometrics– SAS Optimization– “SAS Visual Text Analytics” (new)– SAS Model Manager– SAS Visual Investigator 10.3– SAS Visual Scenario Designer 10.3– SAS Event Stream Processing– In-Database Technologies– SAS Studio
SAS Viya 3.4
– SAS Data Preparation– SAS Data Quality– SAS Data Discovery– SAS Data Integration – SAS Visual Analytics 8.3– SAS Visual Statistics 8.3– SAS Visual Data Mining and Machine Learning 8.3– SAS Office Analytics– SAS Visual Forecasting– SAS Econometrics– SAS Optimization– “SAS Visual Text Analytics”– SAS Model Manager– SAS Visual Investigator 10.4– SAS Visual Scenario Designer 10.4– SAS Event Stream Processing– In-Database Technologies– SAS Studio
Technology Portfolio
• Open environment
• Governed analytics in everyday applications
• Optimization and automation
• Deep Learning and Cognitive Computing
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Differences in the SAS®9 and SAS® Viya™ 3.2 Platforms
Mere information
SAS® Viya™ 3.2: Platform Overview
SAS® Cloud Analytic Services 3.2: Fundamentals
SAS® Viya™: What It Means for SAS® Administration