New releases of SAS Data Management...• The new data quality and cleansing functionality is...
26
Copyright © SAS Institute Inc. All rights reserved. SAS ® USER FORUM DENMARK 2017 New releases of SAS Data Management Lasse Olsen & Gert Nissen SAS Institute
Transcript of New releases of SAS Data Management...• The new data quality and cleansing functionality is...
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS® USER FORUMDENMARK 2017
New releases of SAS Data ManagementLasse Olsen & Gert Nissen
SAS Institute
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS In-Database Technologies
Access and Deliver
Integrate and Transform
Manage Quality
Govern and Master
SAS Data Loader for Hadoop
SAS Federation Server
SAS/ACCESS Software
SAS Data Surveyor for SAP
SAS Event Stream Processing
SAS Data Management SAS Data Quality SAS Data Governance
SAS Master Data Management
SAS Data Integration StudioSAS Data Management StudioSAS Federation ServerSAS Event Stream ProcessingSAS Data Loader for HadoopSAS Business Data NetworkSAS Reference Data ManagerSAS Decision ManagerSAS Data Surveyor for SAPSAS Management ConsoleSAS Environment ManagerSAS Model ManagerSAS Workflow StudioSAS Job Monitor…
SAS Data Management
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Data Developers
Data Stewards
Data Analystspoliciesanalysis
jobs/rulescode
SAS DataManagement
policiesanalysis
jobs/rulescode
policiesanalysis
jobs/rulescode
Data
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Platform versioner
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
What’s new in SAS® 9.4
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS 9.4 Nyheder – kortPlatform
• JSON LIBNAME Engine
• Accessibility support in ODS
• Deployment / config enhancements
• Update of 3rd party components
• Roll-up of defects and hotfixes
Decision Management
• Updated products and enhancements
Data Loader for Hadoop 3.1
Data Management
• Data Integration Studio enhancements
• In-database enhancements
• Hadoop-related enhancements
• Additional enhancements
Others
• Enterprise Guide 7.13
• SAS Studio 3.6
• Add-in for Microsoft Office 7.13
• Updates to SAS Viya bridges
40% to 50% decrease in start-up time for SAS Web Application Server.
SAS Backup Manager, which is an easy-to-use interface for scheduling, configuring, monitoring, and performing integrated backups
SAS Environment Manager
Copyright © SAS Inst itute Inc. A l l r ights reserved.
• Data Management and Integration
What's New in SAS® 9.4
• Documentation
• SAS Environment Manager
• SAS 9.4 Intelligence Platform
• SAS 9.4 Integration Technologies
• SAS 9.4 In-Database Products
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS 9.4 Intelligence Platform
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS Data Integration Studio 4.902 runs on SAS 9.4M4.
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Transforms
• Connect to Viya
• Cloud
• Fork
• Decision manager
Copyright © SAS Inst itute Inc. A l l r ights reserved.
DEMO
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Big data ETL
• Impact analysis across both SAS and Hadoop environments
• Transformation for running Data loader jobs I DI Studio
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Enhancements in DI studio
• Better loop transformation• Revised commandline deployment• In-database processing via SQL pushdown to Hadoop for PROC
TRANSPOSE.• Better package wizard including DM Studio jobs• The SCD Type 2 Loader transformation now supports a Netezza
target for SQL pass-through.
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Upgrade path…
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
SAS/ACCESS
• SAS/ACCESS to Azure, SQL Server, Postgres, and Vertica all have been enhanced to support pushdown of FREQ, MEANS, SUMMARY, TABULATE
• Interface to PC Files now supports writing Microsoft Excel (.xlsx) format
• SAS has added support for connecting to Teradata using Kerberos.
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Metadata drivers and customer challengesLineage services in the data governance ecosystem
Wiki-like Business Glossary Google-like search Data Governance dashboards
Data Lineage Data Remediation Workflows
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Analyticsand Reporting
Mainframe Data via COBOL
ETL
Data Quality
Database
Database
Logical Data Model
Physical Data
Model
Database
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Collecting third-party metadataThird-party tools whose metadata can be imported
(non exhaustive list)
Data Management tools BI tools
Database toolsData modeling/metadata tools
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Governance Impact Analysis Relationship
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Snapshot – new feature BDNPoint-in-time snapshots of the full BDN database • Users can create and delete any number of
snapshots• Users can pull up saved snapshots to browse
terms, attributes, and relationships • against live data
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
What’s new in Data Management Studio
Special QKB to handle GDPR data
SAS Data Quality Accelerator for Teradata
Addition of Netezza as a Supported Database for Data Storage
GEODISTANCE functions
Enhancements for customizing quality knowledge bases
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
What’s new in Hadoop, Fed, ESPSAS Data Loader for Hadoop 3.1
• Multiuser web application is now based on the SAS Intelligence Architecture• Centralized administrative support now manages servers, access, directives,
and QKB updates• New IT-friendly administrative deployment process uses SAS deployment
tools• Additional high-performance connectivity options available through
SAS/ACCESS• Updated support enables the latest Hadoop technologies• Improved integration supports impact analysis and view and run directives
from products such as SAS Data Integration Studio
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
What’s new in Hadoop, Fed, ESPSAS Federation Server 4.2
• SAS Metadata Server replaces DataFlux Authentication Server for authentication and persistence of users, groups, logins (i.e. personal, group, and shared) and domains.
• New data masking rules provide additional encryption support.• SAS Federation Server now supports the DATA Step 2 (DS2) language.• The new data quality and cleansing functionality is implemented using SAS Quality
Knowledge Base (QKB) with FedSQL and DS2.• SAS Federation Server now has the capability of persisting a data cache in memory
through the MDS data store.• You can now use the SAS Federation Server Driver for Apache Hadoop for read/write
access to Hadoop (HIVE).• A new Federation Server driver enables you to share data sources across multiple
SAS Federation Servers.
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
What’s new in Hadoop, Fed, ESPSAS Event Stream Processing 4.3
• SAS Event Stream Processing Analytics• Changes to SAS Event Stream Processing Studio• Enhancements to Streamviewer• New Geofence Window• New Text Topic Window• Access Control• Support for Kerberos Authentication• Enhancements to Compatibility with SAS Viya• Enhancements to Connectors and Adapters• Cluster Manager• New Engine-Level Attribute for the SAS Micro Analytic Service
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
Data Management Roadmap
SAS Viya
• SAS/ACCESS engines– SAS Data Connectors
• SAS In-Database Technologies– SAS Data Connect
Accelerators
SAS 9.4
• SAS MDM• SAS Business Data Network,
SAS Lineage, and SAS Data Remediation– Delivered with SAS Data
Management, SAS Data Governance, SAS Data Quality, SAS MDM
SAS 9.4• SAS Data Management
Platform– Delivered with SAS Data
Management, SAS Data Governance, SAS Data Quality, SAS MDM
SAS 9.4
• SAS Data Integration Studio
• SAS In-Database Technologies
• SAS/ACCESS engines
• Hadoop @ SAS
SAS Viya
• SAS Data Preparation
• SAS Data Quality
• SAS/ACCESS engines– SAS Data Connectors
• SAS In-Database Technologies– SAS Data Connect
Accelerators
– SAS Scoring Accelerators
• SAS Quality Knowledge Base for Contact Information
SAS 9.4
• SAS Data Loader for Hadoop
• SAS Federation Server
• SAS Scalable Data Server
• SAS MDM
SAS Viya
• SAS Data Preparation
• SAS Data Discovery
• SAS Data Integration
• SAS Event Stream Processing
• SAS Event Stream Manager
• SAS Event Stream Processing
• SAS Event Stream Manager
• SAS Decision Manager
• SAS Model Manager
• SAS Workflow Manager
SAS® USER FORUMDENMARK 2017
Copyright © SAS Inst itute Inc. A l l r ights reserved.
